Started by upstream project "osmo-gsm-tester_build-osmo-msc" build number 29255 originally caused by: Started by upstream project "master-osmo-msc" build number 34197 originally caused by: Started by upstream project "master-osmo-mgw" build number 9174 originally caused by: Started by upstream project "master-libosmo-netif" build number 6954 originally caused by: Started by upstream project "master-libosmo-abis" build number 4952 originally caused by: Started by timer Started by upstream project "master-osmo-msc" build number 34198 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9107 originally caused by: Started by upstream project "master-libosmo-netif" build number 6954 Started by upstream project "osmo-gsm-tester_build-osmo-nitb" build number 12964 originally caused by: Started by upstream project "master-openbsc" build number 13160 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9107 originally caused by: Started by upstream project "master-libosmo-netif" build number 6954 originally caused by: Started by upstream project "master-libosmo-abis" build number 4952 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-msc" build number 29256 originally caused by: Started by upstream project "master-osmo-msc" build number 34199 originally caused by: Started by upstream project "master-osmo-iuh" build number 12845 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9107 originally caused by: Started by upstream project "master-libosmo-netif" build number 6954 originally caused by: Started by upstream project "master-libosmo-abis" build number 4952 originally caused by: Started by timer Running as SYSTEM Building remotely on osmo-gsm-tester-prod (osmo-gsm-tester) in workspace /home/jenkins/workspace/osmo-gsm-tester_run-prod The recommended git tool is: NONE No credentials specified > git rev-parse --resolve-git-dir /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/.git # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url https://gerrit.osmocom.org/osmo-gsm-tester # timeout=10 Fetching upstream changes from https://gerrit.osmocom.org/osmo-gsm-tester > git --version # timeout=10 > git --version # 'git version 2.20.1' > git fetch --tags --force --progress -- https://gerrit.osmocom.org/osmo-gsm-tester +refs/heads/*:refs/remotes/origin/* # timeout=10 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10 Checking out Revision bfc438bb2b17f4129018768a1f7bab52f1e96750 (refs/remotes/origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Commit message: "templates: osmo-msc: modernize" > git rev-list --no-walk bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bsc" build number 17650 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts" build number 7504 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-ggsn" build number 6677 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hlr" build number 8697 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-mgw" build number 8942 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hnbgw" build number 2943 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-msc" build number 29256 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu" build number 5148 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-sgsn" build number 30031 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-trx" build number 4673 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-nitb" build number 12964 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-stp" build number 9237 Copied 2 artifacts from "osmo-gsm-tester_build-osmocom-bb" build number 4694 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-sysmo" build number 8035 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-sysmo" build number 5187 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-oc2g" build number 5531 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-oc2g" build number 3905 Copied 2 artifacts from "osmo-gsm-tester_build-open5gs" build number 8 Copied 2 artifacts from "osmo-gsm-tester_build-srslte" build number 19 [osmo-gsm-tester_run-prod] $ /bin/sh /tmp/jenkins7024380123954485113.sh + unlink osmo-gsm-tester/sysmocom/resources.conf + ln -s resources.conf.prod osmo-gsm-tester/sysmocom/resources.conf + PATH=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src:/usr/local/bin:/usr/bin:/bin:/usr/games ./osmo-gsm-tester/contrib/jenkins-run.sh + base=/home/jenkins/workspace/osmo-gsm-tester_run-prod + dirname -- ./osmo-gsm-tester/contrib/jenkins-run.sh + CDPATH= cd -- ./osmo-gsm-tester/contrib + pwd -P + SCRIPT_DIR=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib + OSMO_GSM_TESTER_CONF=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf + date +%F %T + time_start=2022-12-09 03:34:53 + trial_dir_prefix=trial- + rm -rf trial-2353 trial-2353-bin.tgz trial-2353-run.tgz + trial_dir=trial-2354 + mkdir -p trial-2354 + mv open5gs.build-8.tgz osmo-bsc.build-17650.tgz osmo-bts-oc2g.build-5531.tgz osmo-bts-sysmo.build-8035.tgz osmo-bts.build-7504.tgz osmo-ggsn.build-6677.tgz osmo-hlr.build-8697.tgz osmo-hnbgw.build-2943.tgz osmo-mgw.build-8942.tgz osmo-msc.build-29256.tgz osmo-nitb.build-12964.tgz osmo-pcu-oc2g.build-3905.tgz osmo-pcu-sysmo.build-5187.tgz osmo-pcu.build-5148.tgz osmo-sgsn.build-30031.tgz osmo-stp.build-9237.tgz osmo-trx.build-4673.tgz osmocom-bb.build-4694.tgz srslte.build-19.tgz trial-2354 + cat open5gs.build-8.md5 osmo-bsc.build-17650.md5 osmo-bts-oc2g.build-5531.md5 osmo-bts-sysmo.build-8035.md5 osmo-bts.build-7504.md5 osmo-ggsn.build-6677.md5 osmo-hlr.build-8697.md5 osmo-hnbgw.build-2943.md5 osmo-mgw.build-8942.md5 osmo-msc.build-29256.md5 osmo-nitb.build-12964.md5 osmo-pcu-oc2g.build-3905.md5 osmo-pcu-sysmo.build-5187.md5 osmo-pcu.build-5148.md5 osmo-sgsn.build-30031.md5 osmo-stp.build-9237.md5 osmo-trx.build-4673.md5 osmocom-bb.build-4694.md5 srslte.build-19.md5 + rm open5gs.build-8.md5 osmo-bsc.build-17650.md5 osmo-bts-oc2g.build-5531.md5 osmo-bts-sysmo.build-8035.md5 osmo-bts.build-7504.md5 osmo-ggsn.build-6677.md5 osmo-hlr.build-8697.md5 osmo-hnbgw.build-2943.md5 osmo-mgw.build-8942.md5 osmo-msc.build-29256.md5 osmo-nitb.build-12964.md5 osmo-pcu-oc2g.build-3905.md5 osmo-pcu-sysmo.build-5187.md5 osmo-pcu.build-5148.md5 osmo-sgsn.build-30031.md5 osmo-stp.build-9237.md5 osmo-trx.build-4673.md5 osmocom-bb.build-4694.md5 srslte.build-19.md5 + exit_code=1 + which osmo-gsm-tester.py + python3 -u /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo-gsm-tester.py -c /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf trial-2354 combinations: None trial: 'trial-2354' tests: None Running default suites: nitb_sms:sysmo sms:sysmo nitb_ussd:sysmo ussd:sysmo voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:sysmo+mod-bts0-dynts-osmo emergency:sysmo gprs:sysmo gprs:sysmo+mod-bts0-egprs gprs:sysmo+mod-bts0-dynts-ipa gprs:sysmo+mod-bts0-dynts-osmo dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:sysmo+mod-bts0-dynts67-osmo nitb_sms:oc2g sms:oc2g nitb_ussd:oc2g ussd:oc2g voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:oc2g+mod-bts0-dynts-osmo emergency:oc2g gprs:oc2g gprs:oc2g+mod-bts0-egprs gprs:oc2g+mod-bts0-dynts-ipa gprs:oc2g+mod-bts0-dynts-osmo dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:oc2g+mod-bts0-dynts67-osmo nitb_sms:trx-b200 sms:trx-b200 nitb_ussd:trx-b200 ussd:trx-b200 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-b200+mod-bts0-dynts-osmo voice:trx-b200+mod-bts0-trxdversion0 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-b200 gprs:trx-b200 gprs:trx-b200+mod-bts0-egprs gprs:trx-b200+mod-bts0-dynts-ipa gprs:trx-b200+mod-bts0-dynts-osmo gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-b200+mod-bts0-dynts67-osmo nitb_sms:trx-sysmocell5000 sms:trx-sysmocell5000 nitb_ussd:trx-sysmocell5000 ussd:trx-sysmocell5000 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-sysmocell5000+mod-bts0-dynts-osmo emergency:trx-sysmocell5000 gprs:trx-sysmocell5000 gprs:trx-sysmocell5000+mod-bts0-egprs gprs:trx-sysmocell5000+mod-bts0-dynts-ipa gprs:trx-sysmocell5000+mod-bts0-dynts-osmo dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo nitb_sms:trx-umtrx sms:trx-umtrx nitb_ussd:trx-umtrx ussd:trx-umtrx voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-umtrx+mod-bts0-dynts-osmo voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-umtrx gprs:trx-umtrx gprs:trx-umtrx+mod-bts0-egprs gprs:trx-umtrx+mod-bts0-dynts-ipa gprs:trx-umtrx+mod-bts0-dynts-osmo gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-umtrx+mod-bts0-dynts67-osmo nitb_sms:trx-lms sms:trx-lms nitb_ussd:trx-lms ussd:trx-lms voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms+mod-bts0-dynts-osmo emergency:trx-lms gprs:trx-lms gprs:trx-lms+mod-bts0-egprs gprs:trx-lms+mod-bts0-dynts-ipa gprs:trx-lms+mod-bts0-dynts-osmo dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms+mod-bts0-dynts67-osmo nitb_sms:trx-lms-limenet-micro sms:trx-lms-limenet-micro nitb_ussd:trx-lms-limenet-micro ussd:trx-lms-limenet-micro voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo emergency:trx-lms-limenet-micro gprs:trx-lms-limenet-micro gprs:trx-lms-limenet-micro+mod-bts0-egprs gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo nitb_sms:nanobts sms:nanobts+band-1900 nitb_ussd:nanobts+band-1900 ussd:nanobts+band-1900 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any emergency:nanobts+band-1900 gprs:nanobts+band-1900 gprs:nanobts+band-1900+mod-bts0-egprs gprs:nanobts+band-1900+mod-bts0-dynts-ipa dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any sms:nanobts+band-900 nitb_ussd:nanobts+band-900 ussd:nanobts+band-900 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:nanobts+band-900 gprs:nanobts+band-900 gprs:nanobts+band-900+mod-bts0-egprs gprs:nanobts+band-900+mod-bts0-dynts-ipa gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any nitb_smpp smpp encryption 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover_2G:nanobts+bts1-oc2g handover_2G:nanobts+bts1-octphy handover_2G:nanobts+bts1-trx-lms handover_2G:nanobts+bts1-trx-lms-limenet-micro handover_2G:nanobts+bts1-trx-sysmocell5000 handover_2G:nanobts+bts1-sysmo handover_2G:nanobts+bts1-trx-b200 handover_2G:nanobts+bts1-trx-umtrx handover_2G:oc2g+bts1-octphy handover_2G:oc2g+bts1-trx-lms handover_2G:oc2g+bts1-trx-lms-limenet-micro handover_2G:oc2g+bts1-trx-sysmocell5000 handover_2G:oc2g+bts1-sysmo handover_2G:oc2g+bts1-trx-b200 handover_2G:oc2g+bts1-trx-umtrx handover_2G:octphy+bts1-trx-lms handover_2G:octphy+bts1-trx-lms-limenet-micro handover_2G:octphy+bts1-trx-sysmocell5000 handover_2G:octphy+bts1-sysmo handover_2G:octphy+bts1-trx-b200 handover_2G:octphy+bts1-trx-umtrx handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover_2G:trx-lms+bts1-trx-sysmocell5000 handover_2G:trx-lms+bts1-sysmo handover_2G:trx-lms+bts1-trx-b200 handover_2G:trx-lms+bts1-trx-umtrx handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover_2G:trx-sysmocell5000+bts1-sysmo handover_2G:trx-sysmocell5000+bts1-trx-b200 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover_2G:sysmo+bts1-trx-b200 handover_2G:sysmo+bts1-trx-umtrx handover_2G:trx-b200+bts1-trx-umtrx -------------------------------------------------------------------------------------------- trial-2354 -------------------------------------------------------------------------------------------- 03:35:04.347525 tst trial-2354: Detailed log at /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/log --------------------------------------------------------------------- trial-2354 nitb_sms:sysmo --------------------------------------------------------------------- 03:37:13.257671 tst nitb_sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:37:13.261633 tst nitb_sms:sysmo: Verifying 1 x bts (candidates: 11) 03:37:13.283064 tst nitb_sms:sysmo: Verifying 1 x ip_address (candidates: 9) 03:37:13.290930 tst nitb_sms:sysmo: Verifying 2 x modem (candidates: 12) 03:37:13.348237 tst nitb_sms:sysmo: Reserving 1 x bts (candidates: 11) 03:37:13.370513 tst nitb_sms:sysmo: Reserving 1 x ip_address (candidates: 9) 03:37:13.377754 tst nitb_sms:sysmo: Reserving 2 x modem (candidates: 12) 03:37:13.913835 tst nitb_sms:sysmo: RESERVED RESOURCES for nitb_sms: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 nitb_sms:sysmo mo_mt_sms.py ---------------------------------------------- 03:37:13.918952 tst nitb_sms:sysmo: Using 1 x ip_address (candidates: 1) 03:37:13.930202 tst nitb_sms:sysmo: Using 1 x bts (candidates: 1) 03:37:14.317501 tst mo_mt_sms.py: using LAC 18798 03:37:14.568351 tst mo_mt_sms.py: using RAC 183 03:37:14.690981 tst mo_mt_sms.py: using CellId 18798 03:37:14.812301 tst mo_mt_sms.py: using BVCI 18799 03:37:14.926635 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 03:37:15.106345 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 03:37:15.225898 tst mo_mt_sms.py:9: start nitb and bts... 03:37:15.442871 run osmo-nitb_10.42.42.2: Starting osmo-nitb 03:37:17.961447 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19279): Launched 03:37:18.286092 run osmo-nitb_10.42.42.2(pid=19280): Launched 03:37:18.462785 run osmo-nitb_10.42.42.2(pid=19280): ERR: Terminated: ERROR {rc=2} [trial-2354↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19280)] 03:37:18.596853 run osmo-nitb_10.42.42.2(pid=19280): stdout: | (launched: 2022-12-09_03:37:18.225401) 03:37:18.732324 run osmo-nitb_10.42.42.2(pid=19280): stderr: | (launched: 2022-12-09_03:37:18.273565) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:37:18.867652 run osmo-nitb_10.42.42.2(pid=19280): stdout: | (launched: 2022-12-09_03:37:18.225401) 03:37:18.996183 run osmo-nitb_10.42.42.2(pid=19280): stderr: | (launched: 2022-12-09_03:37:18.273565) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:37:19.150379 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=19280): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19280) [trial-2354↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19280)] [trial-2354↪nitb_sms:sysmo↪mo_mt_sms.py:11] 03:37:19.159201 tst mo_mt_sms.py:11: Test FAILED (5.2 sec) 03:37:19.166209 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19279): Terminating (SIGTERM) 03:37:19.378085 --- ParallelTerminationStrategy: PID 19279 died... 03:37:19.400167 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19279): Terminated: ok {rc=0} 03:37:19.490174 bus /sierra_3: Setting Powered False 03:37:20.592710 bus /sierra_3: Setting Powered False 03:37:21.712403 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 nitb_sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 sms:sysmo --------------------------------------------------------------------- 03:37:22.893993 tst sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:37:22.897926 tst sms:sysmo: Verifying 1 x bts (candidates: 11) 03:37:22.918706 tst sms:sysmo: Verifying 6 x ip_address (candidates: 9) 03:37:22.945413 tst sms:sysmo: Verifying 2 x modem (candidates: 12) 03:37:22.999054 tst sms:sysmo: Reserving 1 x bts (candidates: 11) 03:37:23.019940 tst sms:sysmo: Reserving 6 x ip_address (candidates: 9) 03:37:23.046059 tst sms:sysmo: Reserving 2 x modem (candidates: 12) 03:37:23.594070 tst sms:sysmo: RESERVED RESOURCES for sms: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 sms:sysmo mo_mt_sms.py ---------------------------------------------- 03:37:23.599925 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 03:37:23.611408 tst sms:sysmo: Using 1 x bts (candidates: 1) 03:37:23.645155 tst mo_mt_sms.py: using LAC 18799 03:37:23.763349 tst mo_mt_sms.py: using RAC 184 03:37:23.881864 tst mo_mt_sms.py: using CellId 18799 03:37:23.998464 tst mo_mt_sms.py: using BVCI 18800 03:37:24.109155 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 03:37:24.119557 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 03:37:24.130093 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 03:37:24.140447 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 03:37:24.150947 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 03:37:24.161270 tst sms:sysmo: Using 1 x modem (candidates: 2) 03:37:24.277884 tst sms:sysmo: Using 1 x modem (candidates: 2) 03:37:24.403028 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:37:26.159844 run create_hlr_db(pid=19284): Launched 03:37:26.284185 bus /sierra_2: Setting Powered False 03:37:27.349026 run create_hlr_db(pid=19284): Terminated: ok {rc=0} 03:37:27.801623 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19286): Launched 03:37:28.127537 run osmo-hlr_10.42.42.2(pid=19287): Launched 03:37:28.251254 run osmo-stp_10.42.42.5: Starting osmo-stp 03:37:30.808228 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19289): Launched 03:37:31.145500 run osmo-stp_10.42.42.5(pid=19290): Launched 03:37:31.320105 run osmo-msc_10.42.42.6: Starting osmo-msc 03:37:36.875022 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19298): Launched 03:37:37.198375 run osmo-msc_10.42.42.6(pid=19299): Launched 03:37:37.379679 run osmo-stp_10.42.42.5(pid=19290): ERR: Terminated: ERROR {rc=1} [trial-2354↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19290)] 03:37:37.516870 run osmo-stp_10.42.42.5(pid=19290): stdout: | (launched: 2022-12-09_03:37:31.080660) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:37:37.654383 run osmo-stp_10.42.42.5(pid=19290): stderr: | 20221209033731353 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209033731353 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209033731354 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209033731354 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209033731354 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209033731354 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209033731355 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:37:37.791023 run osmo-stp_10.42.42.5(pid=19290): stdout: | (launched: 2022-12-09_03:37:31.080660) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:37:37.919407 run osmo-stp_10.42.42.5(pid=19290): stderr: | 20221209033731353 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209033731353 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209033731354 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209033731354 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209033731354 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209033731354 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209033731355 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:37:38.073361 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=19290): Process ended prematurely: osmo-stp_10.42.42.5(pid=19290) [trial-2354↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19290)] [trial-2354↪sms:sysmo↪mo_mt_sms.py:16] 03:37:38.082376 tst mo_mt_sms.py:16: Test FAILED (14.5 sec) 03:37:38.110805 run osmo-hlr_10.42.42.2(pid=19287): ERR: Terminated: ERROR {rc=237} [trial-2354↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19287)] 03:37:38.162009 run osmo-hlr_10.42.42.2(pid=19287): stdout: | (launched: 2022-12-09_03:37:28.066292) 03:37:38.214984 run osmo-hlr_10.42.42.2(pid=19287): stderr: | 20221209033728269 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209033728269 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209033728269 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209033728269 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209033728269 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209033728269 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209033728286 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/sms:sysmo/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209033728296 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209033728296 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209033728296 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:37:38.288604 run osmo-msc_10.42.42.6(pid=19299): ERR: Terminated: ERROR {rc=2} [trial-2354↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19299)] 03:37:38.340020 run osmo-msc_10.42.42.6(pid=19299): stdout: | (launched: 2022-12-09_03:37:37.137488) 03:37:38.393251 run osmo-msc_10.42.42.6(pid=19299): stderr: | 20221209033737463 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209033737463 DLGLOBAL DEBUG validating counter group 0x7fcd2541cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209033737464 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209033737464 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209033737464 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209033737464 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209033737466 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209033737467 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209033737467 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209033737467 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:37:38.446512 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19286): Terminating (SIGTERM) 03:37:38.489352 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19289): Terminating (SIGTERM) 03:37:38.532258 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19298): Terminating (SIGTERM) 03:37:38.575362 --- ParallelTerminationStrategy: PID 19286 died... 03:37:38.595735 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19286): Terminated: ok {rc=0} 03:37:38.643154 --- ParallelTerminationStrategy: PID 19289 died... 03:37:38.663112 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19289): Terminated: ok {rc=0} 03:37:38.710645 --- ParallelTerminationStrategy: PID 19298 died... 03:37:38.730707 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19298): Terminated: ok {rc=0} 03:37:38.820312 bus /sierra_3: Setting Powered False 03:37:39.922135 bus /sierra_3: Setting Powered False 03:37:41.041428 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 nitb_ussd:sysmo --------------------------------------------------------------------- 03:37:42.256879 tst nitb_ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:37:42.260501 tst nitb_ussd:sysmo: Verifying 1 x bts (candidates: 11) 03:37:42.281551 tst nitb_ussd:sysmo: Verifying 1 x ip_address (candidates: 9) 03:37:42.288236 tst nitb_ussd:sysmo: Verifying 1 x modem (candidates: 12) 03:37:42.322540 tst nitb_ussd:sysmo: Reserving 1 x bts (candidates: 11) 03:37:42.343115 tst nitb_ussd:sysmo: Reserving 1 x ip_address (candidates: 9) 03:37:42.350175 tst nitb_ussd:sysmo: Reserving 1 x modem (candidates: 12) 03:37:42.870567 tst nitb_ussd:sysmo: RESERVED RESOURCES for nitb_ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2354 nitb_ussd:sysmo assert_extension.py ---------------------------------------------- 03:37:42.875735 tst nitb_ussd:sysmo: Using 1 x ip_address (candidates: 1) 03:37:42.886494 tst nitb_ussd:sysmo: Using 1 x bts (candidates: 1) 03:37:42.921053 tst assert_extension.py: using LAC 18800 03:37:43.040899 tst assert_extension.py: using RAC 185 03:37:43.160239 tst assert_extension.py: using CellId 18800 03:37:43.281078 tst assert_extension.py: using BVCI 18801 03:37:43.391956 tst nitb_ussd:sysmo: Using 1 x modem (candidates: 1) 03:37:43.509287 tst assert_extension.py:10: start nitb and bts... 03:37:43.726491 run osmo-nitb_10.42.42.2: Starting osmo-nitb 03:37:44.387335 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19304): Launched 03:37:44.712185 run osmo-nitb_10.42.42.2(pid=19305): Launched 03:37:44.891869 run osmo-nitb_10.42.42.2(pid=19305): ERR: Terminated: ERROR {rc=2} [trial-2354↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19305)] 03:37:45.036763 run osmo-nitb_10.42.42.2(pid=19305): stdout: | (launched: 2022-12-09_03:37:44.651077) 03:37:45.183542 run osmo-nitb_10.42.42.2(pid=19305): stderr: | (launched: 2022-12-09_03:37:44.699249) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:37:45.330221 run osmo-nitb_10.42.42.2(pid=19305): stdout: | (launched: 2022-12-09_03:37:44.651077) 03:37:45.471508 run osmo-nitb_10.42.42.2(pid=19305): stderr: | (launched: 2022-12-09_03:37:44.699249) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f4d467d3268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=19305): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19305) [trial-2354↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19305)] 03:37:45.834379 tst osmo-nitb_10.42.42.2(pid=19305): stdout: | (launched: 2022-12-09_03:37:44.651077) 03:37:45.985464 tst osmo-nitb_10.42.42.2(pid=19305): stderr: | (launched: 2022-12-09_03:37:44.699249) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:37:46.139773 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=19305): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19305) [trial-2354↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19305)] [trial-2354↪nitb_ussd:sysmo↪assert_extension.py:12] 03:37:46.148819 tst assert_extension.py:12: Test FAILED (3.3 sec) 03:37:46.156080 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19304): Terminating (SIGTERM) 03:37:46.369360 --- ParallelTerminationStrategy: PID 19304 died... 03:37:46.393336 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19304): Terminated: ok {rc=0} 03:37:46.484564 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 nitb_ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 ussd:sysmo --------------------------------------------------------------------- 03:37:47.648534 tst ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:37:47.653362 tst ussd:sysmo: Verifying 1 x bts (candidates: 11) 03:37:47.674560 tst ussd:sysmo: Verifying 6 x ip_address (candidates: 9) 03:37:47.701059 tst ussd:sysmo: Verifying 1 x modem (candidates: 12) 03:37:47.736789 tst ussd:sysmo: Reserving 1 x bts (candidates: 11) 03:37:47.757591 tst ussd:sysmo: Reserving 6 x ip_address (candidates: 9) 03:37:47.784781 tst ussd:sysmo: Reserving 1 x modem (candidates: 12) 03:37:48.313062 tst ussd:sysmo: RESERVED RESOURCES for ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2354 ussd:sysmo assert_extension.py ---------------------------------------------- 03:37:48.318365 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 03:37:48.329103 tst ussd:sysmo: Using 1 x bts (candidates: 1) 03:37:48.364449 tst assert_extension.py: using LAC 18801 03:37:48.482925 tst assert_extension.py: using RAC 186 03:37:48.600426 tst assert_extension.py: using CellId 18801 03:37:48.718696 tst assert_extension.py: using BVCI 18802 03:37:48.828713 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 03:37:48.839371 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 03:37:48.850122 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 03:37:48.860410 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 03:37:48.870901 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 03:37:48.881195 tst ussd:sysmo: Using 1 x modem (candidates: 1) 03:37:48.998744 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:37:49.503562 run create_hlr_db(pid=19309): Launched 03:37:49.626572 bus /sierra_2: Setting Powered False 03:37:50.690621 run create_hlr_db(pid=19309): Terminated: ok {rc=0} 03:37:51.145371 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19311): Launched 03:37:51.470987 run osmo-hlr_10.42.42.2(pid=19312): Launched 03:37:51.595040 run osmo-stp_10.42.42.5: Starting osmo-stp 03:37:52.156556 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19314): Launched 03:37:52.482873 run osmo-stp_10.42.42.5(pid=19315): Launched 03:37:52.606584 run osmo-msc_10.42.42.6: Starting osmo-msc 03:37:53.191583 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19317): Launched 03:37:53.519050 run osmo-msc_10.42.42.6(pid=19318): Launched 03:37:53.699923 run osmo-stp_10.42.42.5(pid=19315): ERR: Terminated: ERROR {rc=1} [trial-2354↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19315)] 03:37:53.837589 run osmo-stp_10.42.42.5(pid=19315): stdout: | (launched: 2022-12-09_03:37:52.421598) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:37:53.975543 run osmo-stp_10.42.42.5(pid=19315): stderr: | 20221209033752617 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209033752618 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209033752618 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209033752618 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209033752619 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209033752619 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209033752619 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:37:54.112787 run osmo-stp_10.42.42.5(pid=19315): stdout: | (launched: 2022-12-09_03:37:52.421598) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:37:54.242135 run osmo-stp_10.42.42.5(pid=19315): stderr: | 20221209033752617 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209033752618 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209033752618 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209033752618 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209033752619 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209033752619 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209033752619 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:37:54.396818 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=19315): Process ended prematurely: osmo-stp_10.42.42.5(pid=19315) [trial-2354↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19315)] [trial-2354↪ussd:sysmo↪assert_extension.py:17] 03:37:54.405936 tst assert_extension.py:17: Test FAILED (6.1 sec) 03:37:54.434344 run osmo-hlr_10.42.42.2(pid=19312): ERR: Terminated: ERROR {rc=237} [trial-2354↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19312)] 03:37:54.486184 run osmo-hlr_10.42.42.2(pid=19312): stdout: | (launched: 2022-12-09_03:37:51.409990) 03:37:54.539716 run osmo-hlr_10.42.42.2(pid=19312): stderr: | 20221209033751613 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209033751613 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209033751613 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209033751613 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209033751613 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209033751613 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209033751630 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/ussd:sysmo/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209033751638 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209033751638 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209033751638 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:37:54.614128 run osmo-msc_10.42.42.6(pid=19318): ERR: Terminated: ERROR {rc=2} [trial-2354↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19318)] 03:37:54.665900 run osmo-msc_10.42.42.6(pid=19318): stdout: | (launched: 2022-12-09_03:37:53.457766) 03:37:54.719109 run osmo-msc_10.42.42.6(pid=19318): stderr: | 20221209033753782 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209033753782 DLGLOBAL DEBUG validating counter group 0x7fef3ca53c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209033753782 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209033753782 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209033753782 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209033753783 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209033753784 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209033753785 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209033753785 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209033753785 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:37:54.773042 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19311): Terminating (SIGTERM) 03:37:54.816243 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19314): Terminating (SIGTERM) 03:37:54.859917 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19317): Terminating (SIGTERM) 03:37:54.903221 --- ParallelTerminationStrategy: PID 19311 died... 03:37:54.923678 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19311): Terminated: ok {rc=0} 03:37:54.971531 --- ParallelTerminationStrategy: PID 19314 died... 03:37:54.991579 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19314): Terminated: ok {rc=0} 03:37:55.038899 --- ParallelTerminationStrategy: PID 19317 died... 03:37:55.058798 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19317): Terminated: ok {rc=0} 03:37:55.148055 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 03:37:56.347481 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:37:56.355087 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 03:37:56.377680 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 03:37:56.405353 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 03:37:56.456267 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 03:37:56.477577 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 03:37:56.505106 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 03:37:57.057546 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 03:37:57.111993 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:37:57.123508 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 03:37:57.182807 tst mo_mt_call.py: using LAC 18802 03:37:57.310199 tst mo_mt_call.py: using RAC 187 03:37:57.437088 tst mo_mt_call.py: using CellId 18802 03:37:57.563898 tst mo_mt_call.py: using BVCI 18803 03:37:57.682833 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:37:57.694449 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:37:57.705841 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:37:57.717333 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:37:57.728870 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:37:57.740526 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 03:37:57.857969 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 03:37:57.975975 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:37:58.456342 run create_hlr_db(pid=19323): Launched 03:37:58.582904 bus /sierra_2: Setting Powered False 03:37:59.644679 run create_hlr_db(pid=19323): Terminated: ok {rc=0} 03:38:00.097202 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19325): Launched 03:38:00.431952 run osmo-hlr_10.42.42.2(pid=19326): Launched 03:38:00.558661 run osmo-stp_10.42.42.5: Starting osmo-stp 03:38:01.183732 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19328): Launched 03:38:01.624594 run osmo-stp_10.42.42.5(pid=19351): Launched 03:38:01.939073 run osmo-msc_10.42.42.6: Starting osmo-msc 03:38:02.629735 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19382): Launched 03:38:03.085518 run osmo-msc_10.42.42.6(pid=19410): Launched 03:38:03.471269 run osmo-stp_10.42.42.5(pid=19351): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19351)] 03:38:03.770526 run osmo-stp_10.42.42.5(pid=19351): stdout: | (launched: 2022-12-09_03:38:01.556032) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:38:03.991265 run osmo-stp_10.42.42.5(pid=19351): stderr: | 20221209033801808 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209033801817 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209033801817 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209033801818 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209033801818 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209033801818 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209033801818 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:38:04.158888 run osmo-stp_10.42.42.5(pid=19351): stdout: | (launched: 2022-12-09_03:38:01.556032) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:38:04.327062 run osmo-stp_10.42.42.5(pid=19351): stderr: | 20221209033801808 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209033801817 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209033801817 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209033801818 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209033801818 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209033801818 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209033801818 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:38:04.528131 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19351): Process ended prematurely: osmo-stp_10.42.42.5(pid=19351) [trial-2354↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19351)] [trial-2354↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 03:38:04.541372 tst mo_mt_call.py:8: Test FAILED (7.5 sec) 03:38:04.579052 run osmo-hlr_10.42.42.2(pid=19326): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19326)] 03:38:04.640323 run osmo-hlr_10.42.42.2(pid=19326): stdout: | (launched: 2022-12-09_03:38:00.370020) 03:38:04.705574 run osmo-hlr_10.42.42.2(pid=19326): stderr: | 20221209033800570 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209033800571 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209033800571 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209033800571 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209033800571 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209033800571 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209033800585 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209033800594 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209033800594 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209033800594 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:38:04.798132 run osmo-msc_10.42.42.6(pid=19410): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19410)] 03:38:04.861618 run osmo-msc_10.42.42.6(pid=19410): stdout: | (launched: 2022-12-09_03:38:03.021482) 03:38:04.917279 run osmo-msc_10.42.42.6(pid=19410): stderr: | 20221209033803588 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209033803588 DLGLOBAL DEBUG validating counter group 0x7f46a7203c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209033803588 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209033803588 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209033803588 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209033803589 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209033803590 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209033803591 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209033803591 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209033803591 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:38:04.973630 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19325): Terminating (SIGTERM) 03:38:05.018751 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19328): Terminating (SIGTERM) 03:38:05.067561 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19382): Terminating (SIGTERM) 03:38:05.113680 --- ParallelTerminationStrategy: PID 19325 died... 03:38:05.134072 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19325): Terminated: ok {rc=0} 03:38:05.181566 --- ParallelTerminationStrategy: PID 19328 died... 03:38:05.201049 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19328): Terminated: ok {rc=0} 03:38:05.247563 --- ParallelTerminationStrategy: PID 19382 died... 03:38:05.268527 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19382): Terminated: ok {rc=0} 03:38:05.357410 bus /sierra_3: Setting Powered False 03:38:06.457135 bus /sierra_3: Setting Powered False 03:38:07.579267 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2354 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 03:38:08.732108 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:38:08.745174 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 03:38:08.861609 tst mo_mt_call_osmux.py: using LAC 18803 03:38:08.986414 tst mo_mt_call_osmux.py: using RAC 188 03:38:09.108727 tst mo_mt_call_osmux.py: using CellId 18803 03:38:09.229491 tst mo_mt_call_osmux.py: using BVCI 18804 03:38:09.345674 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:38:09.357655 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:38:09.369549 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:38:09.380851 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:38:09.392716 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:38:09.404472 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 03:38:09.527215 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 03:38:09.649655 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:38:10.151927 run create_hlr_db(pid=19605): Launched 03:38:10.318240 bus /sierra_2: Setting Powered False 03:38:11.381638 run create_hlr_db(pid=19605): Terminated: ok {rc=0} 03:38:11.834374 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19607): Launched 03:38:12.175566 run osmo-hlr_10.42.42.2(pid=19608): Launched 03:38:12.421905 run osmo-stp_10.42.42.5: Starting osmo-stp 03:38:13.164028 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19610): Launched 03:38:13.498724 run osmo-stp_10.42.42.5(pid=19611): Launched 03:38:13.745860 run osmo-msc_10.42.42.6: Starting osmo-msc 03:38:14.488460 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19613): Launched 03:38:14.840489 run osmo-msc_10.42.42.6(pid=19614): Launched 03:38:15.207274 run osmo-stp_10.42.42.5(pid=19611): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19611)] 03:38:15.502005 run osmo-stp_10.42.42.5(pid=19611): stdout: | (launched: 2022-12-09_03:38:13.435326) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:38:15.673836 run osmo-stp_10.42.42.5(pid=19611): stderr: | 20221209033813776 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209033813776 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209033813776 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209033813781 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209033813781 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209033813781 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209033813781 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:38:15.816433 run osmo-stp_10.42.42.5(pid=19611): stdout: | (launched: 2022-12-09_03:38:13.435326) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:38:15.997826 run osmo-stp_10.42.42.5(pid=19611): stderr: | 20221209033813776 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209033813776 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209033813776 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209033813781 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209033813781 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209033813781 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209033813781 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:38:16.160603 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19611): Process ended prematurely: osmo-stp_10.42.42.5(pid=19611) [trial-2354↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19611)] [trial-2354↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 03:38:16.171342 tst mo_mt_call_osmux.py:8: Test FAILED (7.5 sec) 03:38:16.203259 run osmo-hlr_10.42.42.2(pid=19608): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19608)] 03:38:16.257621 run osmo-hlr_10.42.42.2(pid=19608): stdout: | (launched: 2022-12-09_03:38:12.112252) 03:38:16.313408 run osmo-hlr_10.42.42.2(pid=19608): stderr: | 20221209033812466 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209033812466 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209033812466 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209033812466 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209033812466 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209033812467 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209033812486 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209033812503 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209033812504 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209033812504 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:38:16.390866 run osmo-msc_10.42.42.6(pid=19614): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19614)] 03:38:16.445565 run osmo-msc_10.42.42.6(pid=19614): stdout: | (launched: 2022-12-09_03:38:14.775178) 03:38:16.501444 run osmo-msc_10.42.42.6(pid=19614): stderr: | 20221209033815290 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209033815290 DLGLOBAL DEBUG validating counter group 0x7fa7b7056c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209033815290 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209033815291 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209033815291 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209033815291 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209033815293 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209033815293 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209033815293 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209033815293 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:38:16.557992 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19607): Terminating (SIGTERM) 03:38:16.603194 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19610): Terminating (SIGTERM) 03:38:16.648520 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19613): Terminating (SIGTERM) 03:38:16.694443 --- ParallelTerminationStrategy: PID 19607 died... 03:38:16.715756 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19607): Terminated: ok {rc=0} 03:38:16.768125 --- ParallelTerminationStrategy: PID 19610 died... 03:38:16.789346 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19610): Terminated: ok {rc=0} 03:38:16.840289 --- ParallelTerminationStrategy: PID 19613 died... 03:38:16.861427 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19613): Terminated: ok {rc=0} 03:38:16.972150 bus /sierra_3: Setting Powered False 03:38:18.100477 bus /sierra_3: Setting Powered False 03:38:19.218646 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 03:38:20.461487 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:38:20.469648 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 03:38:20.492221 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 03:38:20.520829 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 03:38:20.572940 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 03:38:20.595073 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 03:38:20.622386 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 03:38:21.176764 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 03:38:21.228520 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:38:21.240157 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 03:38:21.298004 tst mo_mt_call.py: using LAC 18804 03:38:21.422905 tst mo_mt_call.py: using RAC 189 03:38:21.550625 tst mo_mt_call.py: using CellId 18804 03:38:21.677954 tst mo_mt_call.py: using BVCI 18805 03:38:21.794196 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:38:21.805897 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:38:21.817202 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:38:21.828652 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:38:21.840222 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:38:21.851643 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 03:38:21.974556 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 03:38:22.097815 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:38:22.604214 run create_hlr_db(pid=19620): Launched 03:38:22.771775 bus /sierra_2: Setting Powered False 03:38:23.835508 run create_hlr_db(pid=19620): Terminated: ok {rc=0} 03:38:24.287601 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19622): Launched 03:38:24.629941 run osmo-hlr_10.42.42.2(pid=19623): Launched 03:38:24.875418 run osmo-stp_10.42.42.5: Starting osmo-stp 03:38:25.509657 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19625): Launched 03:38:25.841181 run osmo-stp_10.42.42.5(pid=19626): Launched 03:38:25.967015 run osmo-msc_10.42.42.6: Starting osmo-msc 03:38:26.565230 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19628): Launched 03:38:26.896148 run osmo-msc_10.42.42.6(pid=19629): Launched 03:38:27.079698 run osmo-stp_10.42.42.5(pid=19626): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19626)] 03:38:27.218717 run osmo-stp_10.42.42.5(pid=19626): stdout: | (launched: 2022-12-09_03:38:25.779153) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:38:27.358858 run osmo-stp_10.42.42.5(pid=19626): stderr: | 20221209033825975 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209033825975 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209033825975 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209033825976 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209033825976 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209033825976 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209033825976 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:38:27.498783 run osmo-stp_10.42.42.5(pid=19626): stdout: | (launched: 2022-12-09_03:38:25.779153) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:38:27.630473 run osmo-stp_10.42.42.5(pid=19626): stderr: | 20221209033825975 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209033825975 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209033825975 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209033825976 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209033825976 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209033825976 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209033825976 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:38:27.788259 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19626): Process ended prematurely: osmo-stp_10.42.42.5(pid=19626) [trial-2354↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19626)] [trial-2354↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 03:38:27.798251 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 03:38:27.826650 run osmo-hlr_10.42.42.2(pid=19623): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19623)] 03:38:27.878122 run osmo-hlr_10.42.42.2(pid=19623): stdout: | (launched: 2022-12-09_03:38:24.565310) 03:38:27.930877 run osmo-hlr_10.42.42.2(pid=19623): stderr: | 20221209033824928 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209033824928 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209033824928 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209033824928 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209033824928 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209033824928 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209033824945 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209033824959 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209033824959 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209033824959 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:38:28.003937 run osmo-msc_10.42.42.6(pid=19629): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19629)] 03:38:28.055004 run osmo-msc_10.42.42.6(pid=19629): stdout: | (launched: 2022-12-09_03:38:26.834320) 03:38:28.107698 run osmo-msc_10.42.42.6(pid=19629): stderr: | 20221209033827159 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209033827159 DLGLOBAL DEBUG validating counter group 0x7f0eb68f9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209033827159 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209033827159 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209033827159 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209033827160 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209033827161 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209033827162 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209033827162 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209033827162 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:38:28.160940 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19622): Terminating (SIGTERM) 03:38:28.203661 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19625): Terminating (SIGTERM) 03:38:28.246271 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19628): Terminating (SIGTERM) 03:38:28.289066 --- ParallelTerminationStrategy: PID 19622 died... 03:38:28.309186 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19622): Terminated: ok {rc=0} 03:38:28.356312 --- ParallelTerminationStrategy: PID 19625 died... 03:38:28.376086 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19625): Terminated: ok {rc=0} 03:38:28.423350 --- ParallelTerminationStrategy: PID 19628 died... 03:38:28.443151 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19628): Terminated: ok {rc=0} 03:38:28.532813 bus /sierra_3: Setting Powered False 03:38:29.633372 bus /sierra_3: Setting Powered False 03:38:30.750625 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2354 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 03:38:31.917038 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:38:31.934582 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 03:38:32.005259 tst mo_mt_call_osmux.py: using LAC 18805 03:38:32.173453 tst mo_mt_call_osmux.py: using RAC 190 03:38:32.309050 tst mo_mt_call_osmux.py: using CellId 18805 03:38:32.446676 tst mo_mt_call_osmux.py: using BVCI 18806 03:38:32.569193 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:38:32.580870 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:38:32.592441 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:38:32.604149 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:38:32.615681 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:38:32.627328 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 03:38:32.748444 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 03:38:32.870479 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:38:33.386912 run create_hlr_db(pid=19631): Launched 03:38:33.513241 bus /sierra_2: Setting Powered False 03:38:34.577945 run create_hlr_db(pid=19631): Terminated: ok {rc=0} 03:38:35.038790 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19633): Launched 03:38:35.372663 run osmo-hlr_10.42.42.2(pid=19634): Launched 03:38:35.499761 run osmo-stp_10.42.42.5: Starting osmo-stp 03:38:36.068372 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19636): Launched 03:38:36.400640 run osmo-stp_10.42.42.5(pid=19637): Launched 03:38:36.527085 run osmo-msc_10.42.42.6: Starting osmo-msc 03:38:37.125659 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19639): Launched 03:38:37.458606 run osmo-msc_10.42.42.6(pid=19640): Launched 03:38:37.642874 run osmo-stp_10.42.42.5(pid=19637): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19637)] 03:38:37.782398 run osmo-stp_10.42.42.5(pid=19637): stdout: | (launched: 2022-12-09_03:38:36.338300) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:38:37.922357 run osmo-stp_10.42.42.5(pid=19637): stderr: | 20221209033836533 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209033836533 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209033836534 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209033836534 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209033836534 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209033836535 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209033836535 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:38:38.061665 run osmo-stp_10.42.42.5(pid=19637): stdout: | (launched: 2022-12-09_03:38:36.338300) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:38:38.193543 run osmo-stp_10.42.42.5(pid=19637): stderr: | 20221209033836533 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209033836533 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209033836534 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209033836534 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209033836534 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209033836535 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209033836535 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:38:38.351324 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19637): Process ended prematurely: osmo-stp_10.42.42.5(pid=19637) [trial-2354↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19637)] [trial-2354↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 03:38:38.361104 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 03:38:38.390096 run osmo-hlr_10.42.42.2(pid=19634): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19634)] 03:38:38.441370 run osmo-hlr_10.42.42.2(pid=19634): stdout: | (launched: 2022-12-09_03:38:35.310503) 03:38:38.494457 run osmo-hlr_10.42.42.2(pid=19634): stderr: | 20221209033835512 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209033835512 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209033835512 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209033835512 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209033835512 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209033835512 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209033835591 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209033835601 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209033835601 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209033835601 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:38:38.567932 run osmo-msc_10.42.42.6(pid=19640): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19640)] 03:38:38.619069 run osmo-msc_10.42.42.6(pid=19640): stdout: | (launched: 2022-12-09_03:38:37.396482) 03:38:38.671910 run osmo-msc_10.42.42.6(pid=19640): stderr: | 20221209033837724 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209033837724 DLGLOBAL DEBUG validating counter group 0x7ff0979b5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209033837724 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209033837724 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209033837725 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209033837725 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209033837726 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209033837727 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209033837727 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209033837727 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:38:38.725421 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19633): Terminating (SIGTERM) 03:38:38.768092 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19636): Terminating (SIGTERM) 03:38:38.810835 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19639): Terminating (SIGTERM) 03:38:38.853744 --- ParallelTerminationStrategy: PID 19633 died... 03:38:38.873953 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19633): Terminated: ok {rc=0} 03:38:38.921545 --- ParallelTerminationStrategy: PID 19636 died... 03:38:38.941577 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19636): Terminated: ok {rc=0} 03:38:38.988897 --- ParallelTerminationStrategy: PID 19639 died... 03:38:39.009382 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19639): Terminated: ok {rc=0} 03:38:39.100318 bus /sierra_3: Setting Powered False 03:38:40.199198 bus /sierra_3: Setting Powered False 03:38:41.316924 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 03:38:42.555503 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:38:42.563280 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 03:38:42.584271 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 03:38:42.612156 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 03:38:42.662936 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 03:38:42.683396 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 03:38:42.709426 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 03:38:43.261597 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 03:38:43.310730 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:38:43.321779 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 03:38:43.376283 tst mo_mt_call.py: using LAC 18806 03:38:43.497767 tst mo_mt_call.py: using RAC 191 03:38:43.619686 tst mo_mt_call.py: using CellId 18806 03:38:43.741037 tst mo_mt_call.py: using BVCI 18807 03:38:43.852751 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:38:43.863954 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:38:43.874837 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:38:43.885778 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:38:43.896550 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:38:43.907508 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 03:38:44.028215 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 03:38:44.148901 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:38:44.665392 run create_hlr_db(pid=19645): Launched 03:38:44.791995 bus /sierra_2: Setting Powered False 03:38:45.857715 run create_hlr_db(pid=19645): Terminated: ok {rc=0} 03:38:46.334986 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19647): Launched 03:38:46.661112 run osmo-hlr_10.42.42.2(pid=19648): Launched 03:38:46.911164 run osmo-stp_10.42.42.5: Starting osmo-stp 03:38:47.557371 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19650): Launched 03:38:47.867477 run osmo-stp_10.42.42.5(pid=19651): Launched 03:38:47.984133 run osmo-msc_10.42.42.6: Starting osmo-msc 03:38:48.543307 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19653): Launched 03:38:48.853966 run osmo-msc_10.42.42.6(pid=19654): Launched 03:38:49.026109 run osmo-stp_10.42.42.5(pid=19651): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19651)] 03:38:49.156280 run osmo-stp_10.42.42.5(pid=19651): stdout: | (launched: 2022-12-09_03:38:47.809106) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:38:49.287408 run osmo-stp_10.42.42.5(pid=19651): stderr: | 20221209033847982 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209033847982 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209033847983 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209033847983 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209033847984 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209033847984 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209033847984 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:38:49.416255 run osmo-stp_10.42.42.5(pid=19651): stdout: | (launched: 2022-12-09_03:38:47.809106) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:38:49.539209 run osmo-stp_10.42.42.5(pid=19651): stderr: | 20221209033847982 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209033847982 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209033847983 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209033847983 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209033847984 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209033847984 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209033847984 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:38:49.686334 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19651): Process ended prematurely: osmo-stp_10.42.42.5(pid=19651) [trial-2354↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19651)] [trial-2354↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 03:38:49.695081 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 03:38:49.721496 run osmo-hlr_10.42.42.2(pid=19648): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19648)] 03:38:49.769879 run osmo-hlr_10.42.42.2(pid=19648): stdout: | (launched: 2022-12-09_03:38:46.598469) 03:38:49.820050 run osmo-hlr_10.42.42.2(pid=19648): stderr: | 20221209033846945 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209033846945 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209033846945 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209033846945 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209033846945 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209033846945 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209033846961 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209033846972 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209033846973 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209033846973 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:38:49.889802 run osmo-msc_10.42.42.6(pid=19654): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19654)] 03:38:49.938176 run osmo-msc_10.42.42.6(pid=19654): stdout: | (launched: 2022-12-09_03:38:48.795246) 03:38:49.988216 run osmo-msc_10.42.42.6(pid=19654): stderr: | 20221209033849070 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209033849070 DLGLOBAL DEBUG validating counter group 0x7fa435df6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209033849071 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209033849071 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209033849071 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209033849071 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209033849073 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209033849073 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209033849073 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209033849073 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:38:50.039046 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19647): Terminating (SIGTERM) 03:38:50.078966 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19650): Terminating (SIGTERM) 03:38:50.118938 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19653): Terminating (SIGTERM) 03:38:50.158947 --- ParallelTerminationStrategy: PID 19647 died... 03:38:50.178118 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19647): Terminated: ok {rc=0} 03:38:50.222091 --- ParallelTerminationStrategy: PID 19650 died... 03:38:50.240687 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19650): Terminated: ok {rc=0} 03:38:50.285157 --- ParallelTerminationStrategy: PID 19653 died... 03:38:50.303887 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19653): Terminated: ok {rc=0} 03:38:50.391507 bus /sierra_3: Setting Powered False 03:38:51.492210 bus /sierra_3: Setting Powered False 03:38:52.610485 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2354 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 03:38:53.757325 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:38:53.768923 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 03:38:53.825140 tst mo_mt_call_osmux.py: using LAC 18807 03:38:53.947467 tst mo_mt_call_osmux.py: using RAC 192 03:38:54.073343 tst mo_mt_call_osmux.py: using CellId 18807 03:38:54.193986 tst mo_mt_call_osmux.py: using BVCI 18808 03:38:54.305475 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:38:54.316388 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:38:54.327340 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:38:54.338183 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:38:54.348923 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:38:54.359797 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 03:38:54.478016 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 03:38:54.595273 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:38:55.077645 run create_hlr_db(pid=19656): Launched 03:38:55.203828 bus /sierra_2: Setting Powered False 03:38:56.264676 run create_hlr_db(pid=19656): Terminated: ok {rc=0} 03:38:56.696861 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19658): Launched 03:38:57.008239 run osmo-hlr_10.42.42.2(pid=19659): Launched 03:38:57.126287 run osmo-stp_10.42.42.5: Starting osmo-stp 03:38:57.659852 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19661): Launched 03:38:57.971596 run osmo-stp_10.42.42.5(pid=19662): Launched 03:38:58.089562 run osmo-msc_10.42.42.6: Starting osmo-msc 03:38:58.651380 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19664): Launched 03:38:58.963373 run osmo-msc_10.42.42.6(pid=19665): Launched 03:38:59.136054 run osmo-stp_10.42.42.5(pid=19662): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19662)] 03:38:59.275644 run osmo-stp_10.42.42.5(pid=19662): stdout: | (launched: 2022-12-09_03:38:57.911663) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:38:59.418671 run osmo-stp_10.42.42.5(pid=19662): stderr: | 20221209033858086 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209033858086 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209033858086 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209033858086 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209033858089 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209033858089 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209033858089 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:38:59.557180 run osmo-stp_10.42.42.5(pid=19662): stdout: | (launched: 2022-12-09_03:38:57.911663) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:38:59.689530 run osmo-stp_10.42.42.5(pid=19662): stderr: | 20221209033858086 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209033858086 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209033858086 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209033858086 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209033858089 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209033858089 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209033858089 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:38:59.847700 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19662): Process ended prematurely: osmo-stp_10.42.42.5(pid=19662) [trial-2354↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19662)] [trial-2354↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 03:38:59.857544 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 03:38:59.886760 run osmo-hlr_10.42.42.2(pid=19659): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19659)] 03:38:59.938574 run osmo-hlr_10.42.42.2(pid=19659): stdout: | (launched: 2022-12-09_03:38:56.949321) 03:38:59.992431 run osmo-hlr_10.42.42.2(pid=19659): stderr: | 20221209033857131 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209033857131 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209033857131 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209033857131 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209033857131 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209033857131 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209033857144 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209033857154 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209033857154 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209033857154 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:39:00.066584 run osmo-msc_10.42.42.6(pid=19665): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19665)] 03:39:00.118528 run osmo-msc_10.42.42.6(pid=19665): stdout: | (launched: 2022-12-09_03:38:58.904156) 03:39:00.172013 run osmo-msc_10.42.42.6(pid=19665): stderr: | 20221209033859178 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209033859178 DLGLOBAL DEBUG validating counter group 0x7f0b68f60c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209033859178 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209033859178 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209033859178 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209033859178 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209033859180 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209033859181 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209033859181 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209033859181 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:39:00.225966 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19658): Terminating (SIGTERM) 03:39:00.269928 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19661): Terminating (SIGTERM) 03:39:00.313397 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19664): Terminating (SIGTERM) 03:39:00.357102 --- ParallelTerminationStrategy: PID 19658 died... 03:39:00.377535 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19658): Terminated: ok {rc=0} 03:39:00.425832 --- ParallelTerminationStrategy: PID 19661 died... 03:39:00.446073 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19661): Terminated: ok {rc=0} 03:39:00.493653 --- ParallelTerminationStrategy: PID 19664 died... 03:39:00.513665 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19664): Terminated: ok {rc=0} 03:39:00.603975 bus /sierra_3: Setting Powered False 03:39:01.706505 bus /sierra_3: Setting Powered False 03:39:02.830010 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 03:39:04.077735 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:39:04.085779 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 03:39:04.106272 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 03:39:04.132525 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 03:39:04.184279 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 03:39:04.204921 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 03:39:04.231015 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 03:39:04.784209 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 03:39:04.837938 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:39:04.849492 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 03:39:04.910293 tst mo_mt_call.py: using LAC 18808 03:39:05.038449 tst mo_mt_call.py: using RAC 193 03:39:05.166375 tst mo_mt_call.py: using CellId 18808 03:39:05.294442 tst mo_mt_call.py: using BVCI 18809 03:39:05.415187 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:39:05.426763 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:39:05.438245 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:39:05.449948 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:39:05.461579 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:39:05.473451 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 03:39:05.589710 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 03:39:05.708191 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:39:06.222656 run create_hlr_db(pid=19670): Launched 03:39:06.347821 bus /sierra_2: Setting Powered False 03:39:07.409727 run create_hlr_db(pid=19670): Terminated: ok {rc=0} 03:39:07.869700 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19672): Launched 03:39:08.209329 run osmo-hlr_10.42.42.2(pid=19673): Launched 03:39:08.335562 run osmo-stp_10.42.42.5: Starting osmo-stp 03:39:08.908208 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19675): Launched 03:39:09.239151 run osmo-stp_10.42.42.5(pid=19676): Launched 03:39:09.365827 run osmo-msc_10.42.42.6: Starting osmo-msc 03:39:09.963411 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19678): Launched 03:39:10.295617 run osmo-msc_10.42.42.6(pid=19679): Launched 03:39:10.480241 run osmo-stp_10.42.42.5(pid=19676): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19676)] 03:39:10.619151 run osmo-stp_10.42.42.5(pid=19676): stdout: | (launched: 2022-12-09_03:39:09.177483) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:39:10.759104 run osmo-stp_10.42.42.5(pid=19676): stderr: | 20221209033909372 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209033909372 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209033909372 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209033909373 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209033909373 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209033909373 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209033909373 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:39:10.897682 run osmo-stp_10.42.42.5(pid=19676): stdout: | (launched: 2022-12-09_03:39:09.177483) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:39:11.029209 run osmo-stp_10.42.42.5(pid=19676): stderr: | 20221209033909372 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209033909372 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209033909372 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209033909373 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209033909373 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209033909373 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209033909373 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:39:11.186999 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19676): Process ended prematurely: osmo-stp_10.42.42.5(pid=19676) [trial-2354↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19676)] [trial-2354↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 03:39:11.196411 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 03:39:11.225065 run osmo-hlr_10.42.42.2(pid=19673): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19673)] 03:39:11.276100 run osmo-hlr_10.42.42.2(pid=19673): stdout: | (launched: 2022-12-09_03:39:08.145880) 03:39:11.329097 run osmo-hlr_10.42.42.2(pid=19673): stderr: | 20221209033908348 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209033908348 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209033908348 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209033908348 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209033908348 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209033908348 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209033908360 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209033908370 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209033908370 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209033908370 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:39:11.402588 run osmo-msc_10.42.42.6(pid=19679): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19679)] 03:39:11.453726 run osmo-msc_10.42.42.6(pid=19679): stdout: | (launched: 2022-12-09_03:39:10.233700) 03:39:11.506761 run osmo-msc_10.42.42.6(pid=19679): stderr: | 20221209033910560 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209033910560 DLGLOBAL DEBUG validating counter group 0x7f0fb8759c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209033910560 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209033910560 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209033910560 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209033910560 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209033910562 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209033910563 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209033910563 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209033910563 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:39:11.560062 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19672): Terminating (SIGTERM) 03:39:11.602835 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19675): Terminating (SIGTERM) 03:39:11.645232 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19678): Terminating (SIGTERM) 03:39:11.687805 --- ParallelTerminationStrategy: PID 19672 died... 03:39:11.707897 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19672): Terminated: ok {rc=0} 03:39:11.755004 --- ParallelTerminationStrategy: PID 19675 died... 03:39:11.774644 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19675): Terminated: ok {rc=0} 03:39:11.821756 --- ParallelTerminationStrategy: PID 19678 died... 03:39:11.841440 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19678): Terminated: ok {rc=0} 03:39:11.931261 bus /sierra_3: Setting Powered False 03:39:13.032082 bus /sierra_3: Setting Powered False 03:39:14.149636 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2354 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 03:39:15.301536 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:39:15.313761 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 03:39:15.371356 tst mo_mt_call_osmux.py: using LAC 18809 03:39:15.502552 tst mo_mt_call_osmux.py: using RAC 194 03:39:15.631508 tst mo_mt_call_osmux.py: using CellId 18809 03:39:15.759895 tst mo_mt_call_osmux.py: using BVCI 18810 03:39:15.888649 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:39:15.900679 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:39:15.912663 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:39:15.926163 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:39:15.939149 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:39:15.951474 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 03:39:16.106740 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 03:39:16.256765 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:39:16.763631 run create_hlr_db(pid=19681): Launched 03:39:16.930599 bus /sierra_2: Setting Powered False 03:39:17.995803 run create_hlr_db(pid=19681): Terminated: ok {rc=0} 03:39:18.457942 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19684): Launched 03:39:18.791863 run osmo-hlr_10.42.42.2(pid=19685): Launched 03:39:18.917707 run osmo-stp_10.42.42.5: Starting osmo-stp 03:39:19.488089 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19687): Launched 03:39:19.821052 run osmo-stp_10.42.42.5(pid=19688): Launched 03:39:19.946876 run osmo-msc_10.42.42.6: Starting osmo-msc 03:39:20.546888 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19690): Launched 03:39:20.879570 run osmo-msc_10.42.42.6(pid=19691): Launched 03:39:21.063777 run osmo-stp_10.42.42.5(pid=19688): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19688)] 03:39:21.202874 run osmo-stp_10.42.42.5(pid=19688): stdout: | (launched: 2022-12-09_03:39:19.758787) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:39:21.342969 run osmo-stp_10.42.42.5(pid=19688): stderr: | 20221209033919957 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209033919957 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209033919957 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209033919958 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209033919958 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209033919958 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209033919958 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:39:21.481743 run osmo-stp_10.42.42.5(pid=19688): stdout: | (launched: 2022-12-09_03:39:19.758787) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:39:21.613476 run osmo-stp_10.42.42.5(pid=19688): stderr: | 20221209033919957 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209033919957 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209033919957 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209033919958 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209033919958 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209033919958 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209033919958 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:39:21.771036 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19688): Process ended prematurely: osmo-stp_10.42.42.5(pid=19688) [trial-2354↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19688)] [trial-2354↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 03:39:21.780573 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 03:39:21.809317 run osmo-hlr_10.42.42.2(pid=19685): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19685)] 03:39:21.860760 run osmo-hlr_10.42.42.2(pid=19685): stdout: | (launched: 2022-12-09_03:39:18.729499) 03:39:21.914499 run osmo-hlr_10.42.42.2(pid=19685): stderr: | 20221209033918931 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209033918931 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209033918931 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209033918932 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209033918932 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209033918932 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209033918944 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209033918952 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209033918953 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209033918953 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:39:21.988562 run osmo-msc_10.42.42.6(pid=19691): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19691)] 03:39:22.040025 run osmo-msc_10.42.42.6(pid=19691): stdout: | (launched: 2022-12-09_03:39:20.817426) 03:39:22.093416 run osmo-msc_10.42.42.6(pid=19691): stderr: | 20221209033921141 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209033921141 DLGLOBAL DEBUG validating counter group 0x7f9c08fcfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209033921141 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209033921141 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209033921142 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209033921142 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209033921143 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209033921144 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209033921144 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209033921144 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:39:22.146969 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19684): Terminating (SIGTERM) 03:39:22.189778 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19687): Terminating (SIGTERM) 03:39:22.232552 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19690): Terminating (SIGTERM) 03:39:22.276194 --- ParallelTerminationStrategy: PID 19684 died... 03:39:22.296519 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19684): Terminated: ok {rc=0} 03:39:22.343911 --- ParallelTerminationStrategy: PID 19687 died... 03:39:22.363702 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19687): Terminated: ok {rc=0} 03:39:22.411290 --- ParallelTerminationStrategy: PID 19690 died... 03:39:22.431044 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19690): Terminated: ok {rc=0} 03:39:22.520168 bus /sierra_3: Setting Powered False 03:39:23.620594 bus /sierra_3: Setting Powered False 03:39:24.736105 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 03:39:25.967315 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:39:25.973834 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 03:39:25.994809 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 03:39:26.021382 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 03:39:26.074601 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 03:39:26.095557 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 03:39:26.121744 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 03:39:26.669282 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 03:39:26.718433 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:39:26.729491 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 03:39:26.785333 tst mo_mt_call.py: using LAC 18810 03:39:26.908464 tst mo_mt_call.py: using RAC 195 03:39:27.032572 tst mo_mt_call.py: using CellId 18810 03:39:27.158665 tst mo_mt_call.py: using BVCI 18811 03:39:27.272920 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:39:27.284023 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:39:27.294814 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:39:27.305610 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:39:27.316428 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:39:27.327306 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 03:39:27.448562 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 03:39:27.572022 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:39:28.088084 run create_hlr_db(pid=19696): Launched 03:39:28.214120 bus /sierra_2: Setting Powered False 03:39:29.279311 run create_hlr_db(pid=19696): Terminated: ok {rc=0} 03:39:29.723767 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19698): Launched 03:39:30.035606 run osmo-hlr_10.42.42.2(pid=19699): Launched 03:39:30.154529 run osmo-stp_10.42.42.5: Starting osmo-stp 03:39:30.690471 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19701): Launched 03:39:31.042733 run osmo-stp_10.42.42.5(pid=19702): Launched 03:39:31.284689 run osmo-msc_10.42.42.6: Starting osmo-msc 03:39:31.985551 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19704): Launched 03:39:32.335822 run osmo-msc_10.42.42.6(pid=19705): Launched 03:39:32.521599 run osmo-stp_10.42.42.5(pid=19702): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19702)] 03:39:32.663570 run osmo-stp_10.42.42.5(pid=19702): stdout: | (launched: 2022-12-09_03:39:30.966078) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:39:32.804859 run osmo-stp_10.42.42.5(pid=19702): stderr: | 20221209033931277 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209033931278 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209033931278 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209033931278 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209033931287 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209033931287 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209033931287 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:39:32.943374 run osmo-stp_10.42.42.5(pid=19702): stdout: | (launched: 2022-12-09_03:39:30.966078) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:39:33.075649 run osmo-stp_10.42.42.5(pid=19702): stderr: | 20221209033931277 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209033931278 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209033931278 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209033931278 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209033931287 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209033931287 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209033931287 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:39:33.233635 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19702): Process ended prematurely: osmo-stp_10.42.42.5(pid=19702) [trial-2354↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19702)] [trial-2354↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 03:39:33.243277 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 03:39:33.271957 run osmo-hlr_10.42.42.2(pid=19699): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19699)] 03:39:33.322922 run osmo-hlr_10.42.42.2(pid=19699): stdout: | (launched: 2022-12-09_03:39:29.976588) 03:39:33.376010 run osmo-hlr_10.42.42.2(pid=19699): stderr: | 20221209033930157 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209033930157 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209033930157 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209033930157 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209033930157 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209033930157 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209033930170 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209033930178 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209033930178 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209033930178 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:39:33.450135 run osmo-msc_10.42.42.6(pid=19705): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19705)] 03:39:33.501291 run osmo-msc_10.42.42.6(pid=19705): stdout: | (launched: 2022-12-09_03:39:32.272818) 03:39:33.554277 run osmo-msc_10.42.42.6(pid=19705): stderr: | 20221209033932598 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209033932598 DLGLOBAL DEBUG validating counter group 0x7fe768588c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209033932598 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209033932598 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209033932598 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209033932599 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209033932600 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209033932601 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209033932601 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209033932601 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:39:33.607634 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19698): Terminating (SIGTERM) 03:39:33.651137 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19701): Terminating (SIGTERM) 03:39:33.693897 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19704): Terminating (SIGTERM) 03:39:33.737019 --- ParallelTerminationStrategy: PID 19698 died... 03:39:33.757363 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19698): Terminated: ok {rc=0} 03:39:33.805079 --- ParallelTerminationStrategy: PID 19701 died... 03:39:33.825049 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19701): Terminated: ok {rc=0} 03:39:33.872607 --- ParallelTerminationStrategy: PID 19704 died... 03:39:33.892732 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19704): Terminated: ok {rc=0} 03:39:33.983108 bus /sierra_3: Setting Powered False 03:39:35.083933 bus /sierra_3: Setting Powered False 03:39:36.202705 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2354 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 03:39:37.354459 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:39:37.366643 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 03:39:37.424778 tst mo_mt_call_osmux.py: using LAC 18811 03:39:37.558444 tst mo_mt_call_osmux.py: using RAC 196 03:39:37.679952 tst mo_mt_call_osmux.py: using CellId 18811 03:39:37.801358 tst mo_mt_call_osmux.py: using BVCI 18812 03:39:37.915863 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:39:37.927278 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:39:37.938467 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:39:37.949797 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:39:37.960916 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:39:37.972324 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 03:39:38.091936 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 03:39:38.213659 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:39:38.693531 run create_hlr_db(pid=19707): Launched 03:39:38.820091 bus /sierra_2: Setting Powered False 03:39:39.880888 run create_hlr_db(pid=19707): Terminated: ok {rc=0} 03:39:40.321404 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19709): Launched 03:39:40.630966 run osmo-hlr_10.42.42.2(pid=19710): Launched 03:39:40.747675 run osmo-stp_10.42.42.5: Starting osmo-stp 03:39:41.298538 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19712): Launched 03:39:41.608372 run osmo-stp_10.42.42.5(pid=19713): Launched 03:39:41.726367 run osmo-msc_10.42.42.6: Starting osmo-msc 03:39:42.284589 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19715): Launched 03:39:42.595920 run osmo-msc_10.42.42.6(pid=19716): Launched 03:39:42.768101 run osmo-stp_10.42.42.5(pid=19713): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19713)] 03:39:42.898126 run osmo-stp_10.42.42.5(pid=19713): stdout: | (launched: 2022-12-09_03:39:41.550164) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:39:43.028377 run osmo-stp_10.42.42.5(pid=19713): stderr: | 20221209033941723 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209033941723 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209033941723 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209033941724 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209033941724 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209033941724 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209033941724 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:39:43.157129 run osmo-stp_10.42.42.5(pid=19713): stdout: | (launched: 2022-12-09_03:39:41.550164) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:39:43.280243 run osmo-stp_10.42.42.5(pid=19713): stderr: | 20221209033941723 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209033941723 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209033941723 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209033941724 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209033941724 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209033941724 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209033941724 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:39:43.427347 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19713): Process ended prematurely: osmo-stp_10.42.42.5(pid=19713) [trial-2354↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19713)] [trial-2354↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 03:39:43.436400 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 03:39:43.462805 run osmo-hlr_10.42.42.2(pid=19710): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19710)] 03:39:43.510670 run osmo-hlr_10.42.42.2(pid=19710): stdout: | (launched: 2022-12-09_03:39:40.572555) 03:39:43.560347 run osmo-hlr_10.42.42.2(pid=19710): stderr: | 20221209033940754 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209033940754 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209033940754 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209033940754 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209033940754 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209033940754 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209033940766 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209033940775 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209033940776 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209033940776 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:39:43.629488 run osmo-msc_10.42.42.6(pid=19716): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19716)] 03:39:43.677701 run osmo-msc_10.42.42.6(pid=19716): stdout: | (launched: 2022-12-09_03:39:42.537069) 03:39:43.728121 run osmo-msc_10.42.42.6(pid=19716): stderr: | 20221209033942813 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209033942814 DLGLOBAL DEBUG validating counter group 0x7fb317c35c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209033942814 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209033942814 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209033942814 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209033942814 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209033942816 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209033942816 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209033942816 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209033942816 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:39:43.778118 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19709): Terminating (SIGTERM) 03:39:43.818034 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19712): Terminating (SIGTERM) 03:39:43.857905 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19715): Terminating (SIGTERM) 03:39:43.897993 --- ParallelTerminationStrategy: PID 19709 died... 03:39:43.917234 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19709): Terminated: ok {rc=0} 03:39:43.962314 --- ParallelTerminationStrategy: PID 19712 died... 03:39:43.981620 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19712): Terminated: ok {rc=0} 03:39:44.026231 --- ParallelTerminationStrategy: PID 19715 died... 03:39:44.045377 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19715): Terminated: ok {rc=0} 03:39:44.132013 bus /sierra_3: Setting Powered False 03:39:45.232803 bus /sierra_3: Setting Powered False 03:39:46.347436 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 03:39:47.587818 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:39:47.594326 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 03:39:47.615200 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 03:39:47.641770 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 03:39:47.694875 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 03:39:47.716052 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 03:39:47.742984 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 03:39:48.291357 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 03:39:48.340913 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:39:48.352194 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 03:39:48.412930 tst mo_mt_call.py: using LAC 18812 03:39:48.533625 tst mo_mt_call.py: using RAC 197 03:39:48.652642 tst mo_mt_call.py: using CellId 18812 03:39:48.772319 tst mo_mt_call.py: using BVCI 18813 03:39:48.894696 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:39:48.906512 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:39:48.918155 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:39:48.930418 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:39:48.942129 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:39:48.953858 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:39:49.071494 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:39:49.190535 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:39:49.706193 run create_hlr_db(pid=19721): Launched 03:39:49.832682 bus /sierra_2: Setting Powered False 03:39:50.898454 run create_hlr_db(pid=19721): Terminated: ok {rc=0} 03:39:51.342696 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19723): Launched 03:39:51.654150 run osmo-hlr_10.42.42.2(pid=19724): Launched 03:39:51.772469 run osmo-stp_10.42.42.5: Starting osmo-stp 03:39:52.306476 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19726): Launched 03:39:52.618091 run osmo-stp_10.42.42.5(pid=19727): Launched 03:39:52.735556 run osmo-msc_10.42.42.6: Starting osmo-msc 03:39:53.295653 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19729): Launched 03:39:53.607603 run osmo-msc_10.42.42.6(pid=19730): Launched 03:39:53.780008 run osmo-stp_10.42.42.5(pid=19727): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19727)] 03:39:53.910692 run osmo-stp_10.42.42.5(pid=19727): stdout: | (launched: 2022-12-09_03:39:52.558836) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:39:54.040823 run osmo-stp_10.42.42.5(pid=19727): stderr: | 20221209033952734 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209033952734 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209033952734 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209033952734 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209033952735 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209033952735 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209033952735 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:39:54.169843 run osmo-stp_10.42.42.5(pid=19727): stdout: | (launched: 2022-12-09_03:39:52.558836) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:39:54.293548 run osmo-stp_10.42.42.5(pid=19727): stderr: | 20221209033952734 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209033952734 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209033952734 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209033952734 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209033952735 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209033952735 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209033952735 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:39:54.441310 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19727): Process ended prematurely: osmo-stp_10.42.42.5(pid=19727) [trial-2354↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19727)] [trial-2354↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 03:39:54.450365 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 03:39:54.477423 run osmo-hlr_10.42.42.2(pid=19724): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19724)] 03:39:54.525979 run osmo-hlr_10.42.42.2(pid=19724): stdout: | (launched: 2022-12-09_03:39:51.595560) 03:39:54.576349 run osmo-hlr_10.42.42.2(pid=19724): stderr: | 20221209033951775 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209033951775 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209033951776 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209033951776 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209033951776 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209033951776 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209033951789 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209033951799 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209033951799 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209033951799 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:39:54.646513 run osmo-msc_10.42.42.6(pid=19730): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19730)] 03:39:54.695077 run osmo-msc_10.42.42.6(pid=19730): stdout: | (launched: 2022-12-09_03:39:53.549285) 03:39:54.745304 run osmo-msc_10.42.42.6(pid=19730): stderr: | 20221209033953826 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209033953826 DLGLOBAL DEBUG validating counter group 0x7f5a5f6f6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209033953826 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209033953826 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209033953827 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209033953827 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209033953829 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209033953830 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209033953830 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209033953830 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:39:54.795532 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19723): Terminating (SIGTERM) 03:39:54.836094 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19726): Terminating (SIGTERM) 03:39:54.876555 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19729): Terminating (SIGTERM) 03:39:54.917248 --- ParallelTerminationStrategy: PID 19723 died... 03:39:54.936568 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19723): Terminated: ok {rc=0} 03:39:54.981581 --- ParallelTerminationStrategy: PID 19726 died... 03:39:55.000697 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19726): Terminated: ok {rc=0} 03:39:55.045805 --- ParallelTerminationStrategy: PID 19729 died... 03:39:55.064771 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19729): Terminated: ok {rc=0} 03:39:55.152719 bus /sierra_3: Setting Powered False 03:39:56.254434 bus /sierra_3: Setting Powered False 03:39:57.369619 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2354 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 03:39:58.520256 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:39:58.532540 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 03:39:58.591047 tst mo_mt_call_osmux.py: using LAC 18813 03:39:58.721966 tst mo_mt_call_osmux.py: using RAC 198 03:39:58.852893 tst mo_mt_call_osmux.py: using CellId 18813 03:39:58.982658 tst mo_mt_call_osmux.py: using BVCI 18814 03:39:59.102940 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:39:59.114614 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:39:59.126227 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:39:59.137986 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:39:59.149678 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:39:59.161456 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:39:59.283714 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:39:59.405893 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:39:59.892079 run create_hlr_db(pid=19732): Launched 03:40:00.019594 bus /sierra_2: Setting Powered False 03:40:01.080606 run create_hlr_db(pid=19732): Terminated: ok {rc=0} 03:40:01.539924 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19743): Launched 03:40:01.875922 run osmo-hlr_10.42.42.2(pid=19744): Launched 03:40:02.090535 run osmo-stp_10.42.42.5: Starting osmo-stp 03:40:02.638834 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19746): Launched 03:40:02.949675 run osmo-stp_10.42.42.5(pid=19747): Launched 03:40:03.067190 run osmo-msc_10.42.42.6: Starting osmo-msc 03:40:03.626423 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19749): Launched 03:40:03.937214 run osmo-msc_10.42.42.6(pid=19750): Launched 03:40:04.108315 run osmo-stp_10.42.42.5(pid=19747): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19747)] 03:40:04.238022 run osmo-stp_10.42.42.5(pid=19747): stdout: | (launched: 2022-12-09_03:40:02.890817) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:40:04.367719 run osmo-stp_10.42.42.5(pid=19747): stderr: | 20221209034003064 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034003064 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034003064 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034003065 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034003065 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034003065 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034003065 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:40:04.496096 run osmo-stp_10.42.42.5(pid=19747): stdout: | (launched: 2022-12-09_03:40:02.890817) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:40:04.618992 run osmo-stp_10.42.42.5(pid=19747): stderr: | 20221209034003064 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034003064 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034003064 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034003065 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034003065 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034003065 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034003065 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:40:04.765825 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19747): Process ended prematurely: osmo-stp_10.42.42.5(pid=19747) [trial-2354↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19747)] [trial-2354↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 03:40:04.774591 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 03:40:04.801337 run osmo-hlr_10.42.42.2(pid=19744): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19744)] 03:40:04.849699 run osmo-hlr_10.42.42.2(pid=19744): stdout: | (launched: 2022-12-09_03:40:01.810584) 03:40:04.899678 run osmo-hlr_10.42.42.2(pid=19744): stderr: | 20221209034002194 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209034002194 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209034002194 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209034002194 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209034002194 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209034002194 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209034002214 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209034002231 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209034002231 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209034002231 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:40:04.969561 run osmo-msc_10.42.42.6(pid=19750): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19750)] 03:40:05.017768 run osmo-msc_10.42.42.6(pid=19750): stdout: | (launched: 2022-12-09_03:40:03.878491) 03:40:05.067654 run osmo-msc_10.42.42.6(pid=19750): stderr: | 20221209034004154 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209034004154 DLGLOBAL DEBUG validating counter group 0x7f7207df4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209034004154 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209034004154 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209034004154 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209034004154 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209034004156 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209034004157 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209034004157 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209034004157 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:40:05.117832 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19743): Terminating (SIGTERM) 03:40:05.157751 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19746): Terminating (SIGTERM) 03:40:05.197817 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19749): Terminating (SIGTERM) 03:40:05.238074 --- ParallelTerminationStrategy: PID 19743 died... 03:40:05.257375 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19743): Terminated: ok {rc=0} 03:40:05.301874 --- ParallelTerminationStrategy: PID 19746 died... 03:40:05.320539 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19746): Terminated: ok {rc=0} 03:40:05.364223 --- ParallelTerminationStrategy: PID 19749 died... 03:40:05.382896 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19749): Terminated: ok {rc=0} 03:40:05.466120 bus /sierra_3: Setting Powered False 03:40:06.562387 bus /sierra_3: Setting Powered False 03:40:07.676349 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 voice:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 03:40:08.912604 tst voice:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:40:08.918239 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 03:40:08.938939 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 03:40:08.965717 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 03:40:09.018539 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 03:40:09.039635 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 03:40:09.065945 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 03:40:09.612881 tst voice:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 03:40:09.662345 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:40:09.673296 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 03:40:09.729667 tst mo_mt_call.py: using LAC 18814 03:40:09.852816 tst mo_mt_call.py: using RAC 199 03:40:09.976109 tst mo_mt_call.py: using CellId 18814 03:40:10.097952 tst mo_mt_call.py: using BVCI 18815 03:40:10.219536 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:40:10.231195 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:40:10.242548 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:40:10.254691 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:40:10.267048 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:40:10.279256 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 03:40:10.399706 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 03:40:10.518240 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:40:11.000782 run create_hlr_db(pid=19755): Launched 03:40:11.127425 bus /sierra_2: Setting Powered False 03:40:12.188385 run create_hlr_db(pid=19755): Terminated: ok {rc=0} 03:40:12.642016 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19757): Launched 03:40:12.974338 run osmo-hlr_10.42.42.2(pid=19758): Launched 03:40:13.100546 run osmo-stp_10.42.42.5: Starting osmo-stp 03:40:13.676035 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19760): Launched 03:40:14.009017 run osmo-stp_10.42.42.5(pid=19761): Launched 03:40:14.135204 run osmo-msc_10.42.42.6: Starting osmo-msc 03:40:14.735895 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19763): Launched 03:40:15.068075 run osmo-msc_10.42.42.6(pid=19764): Launched 03:40:15.255080 run osmo-stp_10.42.42.5(pid=19761): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19761)] 03:40:15.395326 run osmo-stp_10.42.42.5(pid=19761): stdout: | (launched: 2022-12-09_03:40:13.946806) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:40:15.536099 run osmo-stp_10.42.42.5(pid=19761): stderr: | 20221209034014144 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034014145 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034014145 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034014145 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034014146 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034014146 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034014146 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:40:15.675137 run osmo-stp_10.42.42.5(pid=19761): stdout: | (launched: 2022-12-09_03:40:13.946806) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:40:15.807275 run osmo-stp_10.42.42.5(pid=19761): stderr: | 20221209034014144 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034014145 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034014145 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034014145 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034014146 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034014146 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034014146 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:40:15.993753 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19761): Process ended prematurely: osmo-stp_10.42.42.5(pid=19761) [trial-2354↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19761)] [trial-2354↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 03:40:16.004212 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 03:40:16.036820 run osmo-hlr_10.42.42.2(pid=19758): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19758)] 03:40:16.105603 run osmo-hlr_10.42.42.2(pid=19758): stdout: | (launched: 2022-12-09_03:40:12.912258) 03:40:16.175605 run osmo-hlr_10.42.42.2(pid=19758): stderr: | 20221209034013113 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209034013113 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209034013113 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209034013113 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209034013113 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209034013113 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209034013127 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209034013137 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209034013137 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209034013137 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:40:16.256932 run osmo-msc_10.42.42.6(pid=19764): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19764)] 03:40:16.308759 run osmo-msc_10.42.42.6(pid=19764): stdout: | (launched: 2022-12-09_03:40:15.005877) 03:40:16.361263 run osmo-msc_10.42.42.6(pid=19764): stderr: | 20221209034015331 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209034015331 DLGLOBAL DEBUG validating counter group 0x7fbb0a217c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209034015331 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209034015331 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209034015331 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209034015332 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209034015333 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209034015334 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209034015334 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209034015334 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:40:16.413157 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19757): Terminating (SIGTERM) 03:40:16.455656 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19760): Terminating (SIGTERM) 03:40:16.500852 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19763): Terminating (SIGTERM) 03:40:16.545654 --- ParallelTerminationStrategy: PID 19757 died... 03:40:16.565941 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19757): Terminated: ok {rc=0} 03:40:16.614409 --- ParallelTerminationStrategy: PID 19760 died... 03:40:16.634898 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19760): Terminated: ok {rc=0} 03:40:16.682489 --- ParallelTerminationStrategy: PID 19763 died... 03:40:16.702056 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19763): Terminated: ok {rc=0} 03:40:16.790037 bus /sierra_3: Setting Powered False 03:40:17.891540 bus /sierra_3: Setting Powered False 03:40:19.012487 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2354 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 03:40:20.162133 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:40:20.173881 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 03:40:20.231850 tst mo_mt_call_osmux.py: using LAC 18815 03:40:20.355288 tst mo_mt_call_osmux.py: using RAC 200 03:40:20.476647 tst mo_mt_call_osmux.py: using CellId 18815 03:40:20.601225 tst mo_mt_call_osmux.py: using BVCI 18816 03:40:20.714854 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:40:20.726087 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:40:20.736796 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:40:20.747775 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:40:20.758721 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:40:20.769732 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 03:40:20.890285 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 03:40:21.008606 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:40:21.490039 run create_hlr_db(pid=19766): Launched 03:40:21.615541 bus /sierra_2: Setting Powered False 03:40:22.677549 run create_hlr_db(pid=19766): Terminated: ok {rc=0} 03:40:23.109188 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19768): Launched 03:40:23.419996 run osmo-hlr_10.42.42.2(pid=19769): Launched 03:40:23.543307 run osmo-stp_10.42.42.5: Starting osmo-stp 03:40:24.076104 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19771): Launched 03:40:24.386477 run osmo-stp_10.42.42.5(pid=19772): Launched 03:40:24.504138 run osmo-msc_10.42.42.6: Starting osmo-msc 03:40:25.063073 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19776): Launched 03:40:25.373177 run osmo-msc_10.42.42.6(pid=19777): Launched 03:40:25.545122 run osmo-stp_10.42.42.5(pid=19772): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19772)] 03:40:25.674478 run osmo-stp_10.42.42.5(pid=19772): stdout: | (launched: 2022-12-09_03:40:24.327823) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:40:25.804554 run osmo-stp_10.42.42.5(pid=19772): stderr: | 20221209034024504 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034024504 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034024504 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034024505 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034024505 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034024505 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034024505 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:40:25.932893 run osmo-stp_10.42.42.5(pid=19772): stdout: | (launched: 2022-12-09_03:40:24.327823) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:40:26.056604 run osmo-stp_10.42.42.5(pid=19772): stderr: | 20221209034024504 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034024504 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034024504 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034024505 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034024505 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034024505 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034024505 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:40:26.203720 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19772): Process ended prematurely: osmo-stp_10.42.42.5(pid=19772) [trial-2354↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19772)] [trial-2354↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 03:40:26.212846 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 03:40:26.239786 run osmo-hlr_10.42.42.2(pid=19769): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19769)] 03:40:26.288721 run osmo-hlr_10.42.42.2(pid=19769): stdout: | (launched: 2022-12-09_03:40:23.360636) 03:40:26.339301 run osmo-hlr_10.42.42.2(pid=19769): stderr: | 20221209034023544 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209034023544 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209034023544 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209034023544 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209034023544 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209034023544 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209034023556 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209034023565 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209034023565 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209034023565 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:40:26.409533 run osmo-msc_10.42.42.6(pid=19777): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19777)] 03:40:26.457882 run osmo-msc_10.42.42.6(pid=19777): stdout: | (launched: 2022-12-09_03:40:25.314209) 03:40:26.507730 run osmo-msc_10.42.42.6(pid=19777): stderr: | 20221209034025589 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209034025589 DLGLOBAL DEBUG validating counter group 0x7f98a1bc9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209034025589 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209034025589 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209034025590 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209034025590 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209034025591 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209034025592 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209034025592 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209034025592 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:40:26.557931 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19768): Terminating (SIGTERM) 03:40:26.598017 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19771): Terminating (SIGTERM) 03:40:26.638128 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19776): Terminating (SIGTERM) 03:40:26.678508 --- ParallelTerminationStrategy: PID 19768 died... 03:40:26.697729 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19768): Terminated: ok {rc=0} 03:40:26.742282 --- ParallelTerminationStrategy: PID 19771 died... 03:40:26.761130 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19771): Terminated: ok {rc=0} 03:40:26.805671 --- ParallelTerminationStrategy: PID 19776 died... 03:40:26.824488 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19776): Terminated: ok {rc=0} 03:40:26.909196 bus /sierra_3: Setting Powered False 03:40:28.009164 bus /sierra_3: Setting Powered False 03:40:29.127948 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 voice:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 emergency:sysmo --------------------------------------------------------------------- 03:40:30.360721 tst emergency:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:40:30.365099 tst emergency:sysmo: Verifying 1 x bts (candidates: 11) 03:40:30.385870 tst emergency:sysmo: Verifying 6 x ip_address (candidates: 9) 03:40:30.412806 tst emergency:sysmo: Verifying 4 x modem (candidates: 12) 03:40:30.496772 tst emergency:sysmo: Reserving 1 x bts (candidates: 11) 03:40:30.517538 tst emergency:sysmo: Reserving 6 x ip_address (candidates: 9) 03:40:30.544140 tst emergency:sysmo: Reserving 4 x modem (candidates: 12) 03:40:31.128076 tst emergency:sysmo: RESERVED RESOURCES for emergency: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2354 emergency:sysmo emergency_mo_mt_call.py ---------------------------------------------- 03:40:31.135634 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 03:40:31.147735 tst emergency:sysmo: Using 1 x bts (candidates: 1) 03:40:31.184933 tst emergency_mo_mt_call.py: using LAC 18816 03:40:31.345703 tst emergency_mo_mt_call.py: using RAC 201 03:40:31.477268 tst emergency_mo_mt_call.py: using CellId 18816 03:40:31.633816 tst emergency_mo_mt_call.py: using BVCI 18817 03:40:31.784527 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 03:40:31.797534 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 03:40:31.811815 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 03:40:31.826422 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 03:40:31.840861 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 03:40:31.854868 tst emergency:sysmo: Using 1 x modem (candidates: 4) 03:40:31.994583 tst emergency:sysmo: Using 1 x modem (candidates: 4) 03:40:32.139607 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:40:32.630115 run create_hlr_db(pid=19782): Launched 03:40:32.754133 bus /sierra_2: Setting Powered False 03:40:33.814336 run create_hlr_db(pid=19782): Terminated: ok {rc=0} 03:40:34.240296 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19784): Launched 03:40:34.545060 run osmo-hlr_10.42.42.2(pid=19785): Launched 03:40:34.660154 run osmo-stp_10.42.42.5: Starting osmo-stp 03:40:35.200683 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19787): Launched 03:40:35.507269 run osmo-stp_10.42.42.5(pid=19788): Launched 03:40:35.633393 tst emergency_mo_mt_call.py: using MSISDN 7012 03:40:35.788555 run osmo-msc_10.42.42.6: Starting osmo-msc 03:40:36.338175 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19790): Launched 03:40:36.643356 run osmo-msc_10.42.42.6(pid=19791): Launched 03:40:36.812745 run osmo-stp_10.42.42.5(pid=19788): ERR: Terminated: ERROR {rc=1} [trial-2354↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19788)] 03:40:36.941193 run osmo-stp_10.42.42.5(pid=19788): stdout: | (launched: 2022-12-09_03:40:35.449211) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:40:37.070024 run osmo-stp_10.42.42.5(pid=19788): stderr: | 20221209034035624 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034035624 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034035624 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034035624 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034035625 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034035625 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034035625 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:40:37.196788 run osmo-stp_10.42.42.5(pid=19788): stdout: | (launched: 2022-12-09_03:40:35.449211) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:40:37.317573 run osmo-stp_10.42.42.5(pid=19788): stderr: | 20221209034035624 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034035624 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034035624 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034035624 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034035625 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034035625 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034035625 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:40:37.461633 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=19788): Process ended prematurely: osmo-stp_10.42.42.5(pid=19788) [trial-2354↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19788)] [trial-2354↪emergency:sysmo↪emergency_mo_mt_call.py:19] 03:40:37.470127 tst emergency_mo_mt_call.py:19: Test FAILED (6.3 sec) 03:40:37.496786 run osmo-hlr_10.42.42.2(pid=19785): ERR: Terminated: ERROR {rc=237} [trial-2354↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19785)] 03:40:37.545744 run osmo-hlr_10.42.42.2(pid=19785): stdout: | (launched: 2022-12-09_03:40:34.487332) 03:40:37.596257 run osmo-hlr_10.42.42.2(pid=19785): stderr: | 20221209034034670 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209034034670 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209034034670 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209034034670 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209034034670 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209034034670 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209034034682 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/emergency:sysmo/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209034034691 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209034034691 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209034034691 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:40:37.666608 run osmo-msc_10.42.42.6(pid=19791): ERR: Terminated: ERROR {rc=2} [trial-2354↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19791)] 03:40:37.714943 run osmo-msc_10.42.42.6(pid=19791): stdout: | (launched: 2022-12-09_03:40:36.585279) 03:40:37.764890 run osmo-msc_10.42.42.6(pid=19791): stderr: | 20221209034036863 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209034036864 DLGLOBAL DEBUG validating counter group 0x7ff0a99a7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209034036864 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209034036864 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209034036864 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209034036865 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209034036866 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209034036867 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209034036867 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209034036867 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:40:37.815592 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19784): Terminating (SIGTERM) 03:40:37.856087 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19787): Terminating (SIGTERM) 03:40:37.896714 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19790): Terminating (SIGTERM) 03:40:37.937622 --- ParallelTerminationStrategy: PID 19784 died... 03:40:37.957114 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19784): Terminated: ok {rc=0} 03:40:38.002297 --- ParallelTerminationStrategy: PID 19787 died... 03:40:38.021387 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19787): Terminated: ok {rc=0} 03:40:38.067061 --- ParallelTerminationStrategy: PID 19790 died... 03:40:38.085986 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19790): Terminated: ok {rc=0} 03:40:38.174318 bus /sierra_3: Setting Powered False 03:40:39.276459 bus /sierra_3: Setting Powered False 03:40:40.395325 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2354 emergency:sysmo emergency_preemptive_call.py ---------------------------------------------- 03:40:41.485176 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 03:40:41.496443 tst emergency:sysmo: Using 1 x bts (candidates: 1) 03:40:41.533077 tst emergency_preemptive_call.py: using LAC 18817 03:40:41.653436 tst emergency_preemptive_call.py: using RAC 202 03:40:41.782593 tst emergency_preemptive_call.py: using CellId 18817 03:40:41.915070 tst emergency_preemptive_call.py: using BVCI 18818 03:40:42.032647 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 03:40:42.043424 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 03:40:42.054087 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 03:40:42.064556 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 03:40:42.075164 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 03:40:42.086148 tst emergency:sysmo: Using 1 x modem (candidates: 4) 03:40:42.202091 tst emergency:sysmo: Using 1 x modem (candidates: 4) 03:40:42.317899 tst emergency:sysmo: Using 1 x modem (candidates: 4) 03:40:42.432550 tst emergency:sysmo: Using 1 x modem (candidates: 4) 03:40:42.550778 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:40:43.057494 run create_hlr_db(pid=19794): Launched 03:40:43.180097 bus /sierra_2: Setting Powered False 03:40:44.244480 run create_hlr_db(pid=19794): Terminated: ok {rc=0} 03:40:44.682298 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19796): Launched 03:40:44.989186 run osmo-hlr_10.42.42.2(pid=19797): Launched 03:40:45.104828 run osmo-stp_10.42.42.5: Starting osmo-stp 03:40:45.644279 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19799): Launched 03:40:45.957771 run osmo-stp_10.42.42.5(pid=19800): Launched 03:40:46.116097 tst emergency_preemptive_call.py: using MSISDN 7013 03:40:46.406929 run osmo-msc_10.42.42.6: Starting osmo-msc 03:40:47.034698 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19802): Launched 03:40:47.383813 run osmo-msc_10.42.42.6(pid=19803): Launched 03:40:47.587289 run osmo-stp_10.42.42.5(pid=19800): ERR: Terminated: ERROR {rc=1} [trial-2354↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19800)] 03:40:47.729833 run osmo-stp_10.42.42.5(pid=19800): stdout: | (launched: 2022-12-09_03:40:45.895551) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:40:47.871475 run osmo-stp_10.42.42.5(pid=19800): stderr: | 20221209034046198 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034046198 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034046198 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034046199 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034046199 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034046200 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034046200 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:40:48.010372 run osmo-stp_10.42.42.5(pid=19800): stdout: | (launched: 2022-12-09_03:40:45.895551) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:40:48.140729 run osmo-stp_10.42.42.5(pid=19800): stderr: | 20221209034046198 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034046198 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034046198 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034046199 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034046199 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034046200 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034046200 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:40:48.296244 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=19800): Process ended prematurely: osmo-stp_10.42.42.5(pid=19800) [trial-2354↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19800)] [trial-2354↪emergency:sysmo↪emergency_preemptive_call.py:32] 03:40:48.305294 tst emergency_preemptive_call.py:32: Test FAILED (6.8 sec) 03:40:48.333304 run osmo-hlr_10.42.42.2(pid=19797): ERR: Terminated: ERROR {rc=237} [trial-2354↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19797)] 03:40:48.384858 run osmo-hlr_10.42.42.2(pid=19797): stdout: | (launched: 2022-12-09_03:40:44.931131) 03:40:48.437837 run osmo-hlr_10.42.42.2(pid=19797): stderr: | 20221209034045110 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209034045110 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209034045110 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209034045110 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209034045110 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209034045110 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209034045122 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/emergency:sysmo/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209034045131 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209034045132 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209034045132 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:40:48.512009 run osmo-msc_10.42.42.6(pid=19803): ERR: Terminated: ERROR {rc=2} [trial-2354↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19803)] 03:40:48.563318 run osmo-msc_10.42.42.6(pid=19803): stdout: | (launched: 2022-12-09_03:40:47.319784) 03:40:48.616213 run osmo-msc_10.42.42.6(pid=19803): stderr: | 20221209034047659 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209034047659 DLGLOBAL DEBUG validating counter group 0x7f739e31fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209034047659 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209034047659 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209034047659 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209034047660 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209034047662 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209034047662 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209034047662 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209034047662 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:40:48.669612 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19796): Terminating (SIGTERM) 03:40:48.712328 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19799): Terminating (SIGTERM) 03:40:48.755079 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19802): Terminating (SIGTERM) 03:40:48.798060 --- ParallelTerminationStrategy: PID 19796 died... 03:40:48.818423 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19796): Terminated: ok {rc=0} 03:40:48.865897 --- ParallelTerminationStrategy: PID 19799 died... 03:40:48.886133 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19799): Terminated: ok {rc=0} 03:40:48.933488 --- ParallelTerminationStrategy: PID 19802 died... 03:40:48.953404 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19802): Terminated: ok {rc=0} 03:40:49.042873 bus /sierra_9: Setting Powered False 03:40:50.140614 bus /sierra_9: Setting Powered False 03:40:51.257041 bus /sierra_8: Setting Powered False 03:40:52.358204 bus /sierra_8: Setting Powered False 03:40:53.475097 bus /sierra_3: Setting Powered False 03:40:54.572559 bus /sierra_3: Setting Powered False 03:40:55.687316 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 emergency:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 gprs:sysmo --------------------------------------------------------------------- 03:40:56.946942 tst gprs:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:40:56.951523 tst gprs:sysmo: Verifying 1 x bts (candidates: 11) 03:40:56.973364 tst gprs:sysmo: Verifying 9 x ip_address (candidates: 9) 03:40:57.013425 tst gprs:sysmo: Verifying 4 x modem (candidates: 12) 03:40:57.102492 tst gprs:sysmo: Reserving 1 x bts (candidates: 11) 03:40:57.123732 tst gprs:sysmo: Reserving 9 x ip_address (candidates: 9) 03:40:57.163442 tst gprs:sysmo: Reserving 4 x modem (candidates: 12) 03:40:57.753347 tst gprs:sysmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2354 gprs:sysmo cs_paging_gprs_active.py ---------------------------------------------- 03:40:57.805895 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:40:57.816369 tst gprs:sysmo: Using 1 x bts (candidates: 1) 03:40:57.851572 tst cs_paging_gprs_active.py: using LAC 18818 03:40:57.974554 tst cs_paging_gprs_active.py: using RAC 203 03:40:58.101572 tst cs_paging_gprs_active.py: using CellId 18818 03:40:58.221931 tst cs_paging_gprs_active.py: using BVCI 18819 03:40:58.336536 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:40:58.347107 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:40:58.357557 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:40:58.367859 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:40:58.378108 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:40:58.388394 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:40:58.398803 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:40:58.409065 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:40:58.419499 tst gprs:sysmo: Using 1 x modem (candidates: 4) 03:40:58.537842 tst gprs:sysmo: Using 1 x modem (candidates: 4) 03:40:58.658202 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 03:40:58.883553 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:40:59.220247 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19808): Launched 03:40:59.511142 run iperf3-srv_10.42.42.10(pid=19809): Launched 03:40:59.635796 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 03:40:59.859604 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:41:00.195104 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19810): Launched 03:41:00.487206 run iperf3-srv_10.42.42.10(pid=19811): Launched 03:41:00.611375 tst cs_paging_gprs_active.py:38: start network... 03:41:00.835092 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:41:01.363622 run create_hlr_db(pid=19812): Launched 03:41:01.521419 bus /sierra_2: Setting Powered False 03:41:02.586678 run create_hlr_db(pid=19812): Terminated: ok {rc=0} 03:41:03.032141 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19814): Launched 03:41:03.345240 run osmo-hlr_10.42.42.2(pid=19815): Launched 03:41:03.463481 run osmo-stp_10.42.42.5: Starting osmo-stp 03:41:03.998439 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19817): Launched 03:41:04.309056 run osmo-stp_10.42.42.5(pid=19818): Launched 03:41:04.427639 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:41:05.938665 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19820): Launched 03:41:06.056569 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:41:06.321162 run patchelf(pid=19821): Launched 03:41:06.494005 run osmo-stp_10.42.42.5(pid=19818): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19818)] 03:41:06.624493 run osmo-stp_10.42.42.5(pid=19818): stdout: | (launched: 2022-12-09_03:41:04.250545) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:41:06.756300 run osmo-stp_10.42.42.5(pid=19818): stderr: | 20221209034104422 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034104422 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034104423 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034104423 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034104424 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034104424 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034104424 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:41:06.888264 run osmo-stp_10.42.42.5(pid=19818): stdout: | (launched: 2022-12-09_03:41:04.250545) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:41:07.015270 run osmo-stp_10.42.42.5(pid=19818): stderr: | 20221209034104422 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034104422 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034104423 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034104423 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034104424 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034104424 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034104424 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:41:07.165611 run patchelf(pid=19821): Terminating (SIGINT) 03:41:07.339682 run patchelf(pid=19821): Terminated: ok {rc=0} 03:41:07.465415 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=19818): Process ended prematurely: osmo-stp_10.42.42.5(pid=19818) [trial-2354↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19818)] [trial-2354↪gprs:sysmo↪cs_paging_gprs_active.py:38] 03:41:07.474783 tst cs_paging_gprs_active.py:38: Test FAILED (9.7 sec) 03:41:07.502301 run osmo-hlr_10.42.42.2(pid=19815): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:sysmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19815)] 03:41:07.550598 run osmo-hlr_10.42.42.2(pid=19815): stdout: | (launched: 2022-12-09_03:41:03.286207) 03:41:07.600397 run osmo-hlr_10.42.42.2(pid=19815): stderr: | 20221209034103465 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209034103466 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209034103466 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209034103466 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209034103466 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209034103466 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209034103479 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:sysmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209034103488 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209034103488 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209034103488 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:41:07.650633 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19808): Terminating (SIGTERM) 03:41:07.690822 run iperf3-srv_10.42.42.10(pid=19809): Terminating (SIGTERM) 03:41:07.730884 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19810): Terminating (SIGTERM) 03:41:07.771043 run iperf3-srv_10.42.42.10(pid=19811): Terminating (SIGTERM) 03:41:07.811033 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19814): Terminating (SIGTERM) 03:41:07.851373 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19817): Terminating (SIGTERM) 03:41:07.891380 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19820): Terminating (SIGTERM) 03:41:07.931715 --- ParallelTerminationStrategy: PID 19808 died... 03:41:07.950958 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19808): Terminated: ok {rc=0} 03:41:07.995310 --- ParallelTerminationStrategy: PID 19809 died... 03:41:08.014011 run iperf3-srv_10.42.42.10(pid=19809): Terminated {rc=256} 03:41:08.058298 --- ParallelTerminationStrategy: PID 19810 died... 03:41:08.077177 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19810): Terminated: ok {rc=0} 03:41:08.121708 --- ParallelTerminationStrategy: PID 19811 died... 03:41:08.140618 run iperf3-srv_10.42.42.10(pid=19811): Terminated {rc=256} 03:41:08.184891 --- ParallelTerminationStrategy: PID 19814 died... 03:41:08.204105 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19814): Terminated: ok {rc=0} 03:41:08.248524 --- ParallelTerminationStrategy: PID 19817 died... 03:41:08.267403 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19817): Terminated: ok {rc=0} 03:41:08.311963 --- ParallelTerminationStrategy: PID 19820 died... 03:41:08.330947 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19820): Terminated: ok {rc=0} 03:41:08.418907 bus /gobi_0: Setting Powered False 03:41:09.519117 bus /gobi_0: Setting Powered False 03:41:10.636164 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:sysmo iperf3.py ---------------------------------------------- 03:41:11.786428 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:41:11.797637 tst gprs:sysmo: Using 1 x bts (candidates: 1) 03:41:11.833118 tst iperf3.py: using LAC 18819 03:41:11.955411 tst iperf3.py: using RAC 204 03:41:12.080903 tst iperf3.py: using CellId 18819 03:41:12.210440 tst iperf3.py: using BVCI 18820 03:41:12.325294 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:41:12.335777 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:41:12.346290 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:41:12.356486 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:41:12.366839 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:41:12.377289 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:41:12.387816 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:41:12.398528 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:41:12.409179 tst gprs:sysmo: Using 1 x modem (candidates: 4) 03:41:12.525251 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 03:41:12.750839 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:41:13.086864 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19822): Launched 03:41:13.376730 run iperf3-srv_10.42.42.10(pid=19823): Launched 03:41:13.501335 tst iperf3.py:8: start network... 03:41:13.724603 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:41:14.239532 run create_hlr_db(pid=19824): Launched 03:41:14.373792 bus /gobi_6: Setting Powered False 03:41:15.438994 run create_hlr_db(pid=19824): Terminated: ok {rc=0} 03:41:15.897765 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19826): Launched 03:41:16.242090 run osmo-hlr_10.42.42.2(pid=19827): Launched 03:41:16.498067 run osmo-stp_10.42.42.5: Starting osmo-stp 03:41:17.216232 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19829): Launched 03:41:17.565185 run osmo-stp_10.42.42.5(pid=19830): Launched 03:41:17.695616 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:41:18.269968 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19832): Launched 03:41:18.397546 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:41:18.681315 run patchelf(pid=19833): Launched 03:41:18.855316 run osmo-stp_10.42.42.5(pid=19830): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19830)] 03:41:18.985753 run osmo-stp_10.42.42.5(pid=19830): stdout: | (launched: 2022-12-09_03:41:17.502471) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:41:19.117874 run osmo-stp_10.42.42.5(pid=19830): stderr: | 20221209034117696 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034117696 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034117697 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034117697 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034117697 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034117697 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034117698 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:41:19.249822 run osmo-stp_10.42.42.5(pid=19830): stdout: | (launched: 2022-12-09_03:41:17.502471) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:41:19.375965 run osmo-stp_10.42.42.5(pid=19830): stderr: | 20221209034117696 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034117696 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034117697 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034117697 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034117697 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034117697 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034117698 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:41:19.525645 run patchelf(pid=19833): Terminating (SIGINT) 03:41:19.700025 run patchelf(pid=19833): Terminated: ok {rc=0} 03:41:19.825626 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19830): Process ended prematurely: osmo-stp_10.42.42.5(pid=19830) [trial-2354↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19830)] [trial-2354↪gprs:sysmo↪iperf3.py:8] 03:41:19.835078 tst iperf3.py:8: Test FAILED (8.1 sec) 03:41:19.862480 run osmo-hlr_10.42.42.2(pid=19827): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:sysmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19827)] 03:41:19.910631 run osmo-hlr_10.42.42.2(pid=19827): stdout: | (launched: 2022-12-09_03:41:16.175251) 03:41:19.960730 run osmo-hlr_10.42.42.2(pid=19827): stderr: | 20221209034116489 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209034116489 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209034116489 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209034116489 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209034116489 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209034116489 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209034116511 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:sysmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209034116525 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209034116525 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209034116525 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:41:20.011412 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19822): Terminating (SIGTERM) 03:41:20.051657 run iperf3-srv_10.42.42.10(pid=19823): Terminating (SIGTERM) 03:41:20.091798 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19826): Terminating (SIGTERM) 03:41:20.132193 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19829): Terminating (SIGTERM) 03:41:20.172263 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19832): Terminating (SIGTERM) 03:41:20.212707 --- ParallelTerminationStrategy: PID 19822 died... 03:41:20.232059 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19822): Terminated: ok {rc=0} 03:41:20.276643 --- ParallelTerminationStrategy: PID 19823 died... 03:41:20.295566 run iperf3-srv_10.42.42.10(pid=19823): Terminated {rc=256} 03:41:20.340431 --- ParallelTerminationStrategy: PID 19826 died... 03:41:20.359476 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19826): Terminated: ok {rc=0} 03:41:20.404143 --- ParallelTerminationStrategy: PID 19829 died... 03:41:20.423037 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19829): Terminated: ok {rc=0} 03:41:20.468077 --- ParallelTerminationStrategy: PID 19832 died... 03:41:20.487240 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19832): Terminated: ok {rc=0} 03:41:20.574014 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:sysmo iperf3m4.py ---------------------------------------------- 03:41:21.727073 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:41:21.738428 tst gprs:sysmo: Using 1 x bts (candidates: 1) 03:41:21.772798 tst iperf3m4.py: using LAC 18820 03:41:21.895024 tst iperf3m4.py: using RAC 205 03:41:22.018512 tst iperf3m4.py: using CellId 18820 03:41:22.141366 tst iperf3m4.py: using BVCI 18821 03:41:22.256347 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:41:22.267016 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:41:22.277625 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:41:22.288522 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:41:22.299301 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:41:22.310111 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:41:22.321181 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:41:22.332020 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:41:22.342996 tst gprs:sysmo: Using 1 x modem (candidates: 4) 03:41:22.465304 tst gprs:sysmo: Using 1 x modem (candidates: 4) 03:41:22.589419 tst gprs:sysmo: Using 1 x modem (candidates: 4) 03:41:22.709945 tst gprs:sysmo: Using 1 x modem (candidates: 4) 03:41:22.826666 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 03:41:23.034563 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:41:23.348814 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19834): Launched 03:41:23.620936 run iperf3-srv_10.42.42.10(pid=19835): Launched 03:41:23.737798 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 03:41:23.944909 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:41:24.258633 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19836): Launched 03:41:24.531494 run iperf3-srv_10.42.42.10(pid=19837): Launched 03:41:24.647907 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 03:41:24.854401 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:41:25.166787 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19838): Launched 03:41:25.438137 run iperf3-srv_10.42.42.10(pid=19839): Launched 03:41:25.553691 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 03:41:25.760319 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:41:26.072738 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19840): Launched 03:41:26.359406 run iperf3-srv_10.42.42.10(pid=19841): Launched 03:41:26.475316 tst iperf3m4.py:8: start network... 03:41:26.682956 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:41:27.164487 run create_hlr_db(pid=19842): Launched 03:41:27.281526 bus /gobi_6: Setting Powered False 03:41:28.343069 run create_hlr_db(pid=19842): Terminated: ok {rc=0} 03:41:28.797312 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19844): Launched 03:41:29.130321 run osmo-hlr_10.42.42.2(pid=19845): Launched 03:41:29.257175 run osmo-stp_10.42.42.5: Starting osmo-stp 03:41:29.831591 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19847): Launched 03:41:30.163911 run osmo-stp_10.42.42.5(pid=19848): Launched 03:41:30.292603 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:41:30.873717 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19850): Launched 03:41:31.005979 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:41:31.324455 run patchelf(pid=19851): Launched 03:41:31.525362 run osmo-stp_10.42.42.5(pid=19848): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19848)] 03:41:31.671906 run osmo-stp_10.42.42.5(pid=19848): stdout: | (launched: 2022-12-09_03:41:30.101485) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:41:31.811418 run osmo-stp_10.42.42.5(pid=19848): stderr: | 20221209034130298 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034130298 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034130299 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034130299 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034130299 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034130299 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034130299 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:41:31.951247 run osmo-stp_10.42.42.5(pid=19848): stdout: | (launched: 2022-12-09_03:41:30.101485) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:41:32.083580 run osmo-stp_10.42.42.5(pid=19848): stderr: | 20221209034130298 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034130298 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034130299 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034130299 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034130299 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034130299 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034130299 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:41:32.244269 run patchelf(pid=19851): Terminating (SIGINT) 03:41:32.431352 run patchelf(pid=19851): Terminated: ok {rc=0} 03:41:32.566777 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19848): Process ended prematurely: osmo-stp_10.42.42.5(pid=19848) [trial-2354↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19848)] [trial-2354↪gprs:sysmo↪iperf3m4.py:8] 03:41:32.577449 tst iperf3m4.py:8: Test FAILED (10.9 sec) 03:41:32.608524 run osmo-hlr_10.42.42.2(pid=19845): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:sysmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19845)] 03:41:32.660704 run osmo-hlr_10.42.42.2(pid=19845): stdout: | (launched: 2022-12-09_03:41:29.067766) 03:41:32.714682 run osmo-hlr_10.42.42.2(pid=19845): stderr: | 20221209034129271 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209034129271 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209034129271 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209034129271 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209034129271 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209034129271 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209034129283 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:sysmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209034129292 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209034129292 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209034129292 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:41:32.768921 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19834): Terminating (SIGTERM) 03:41:32.812501 run iperf3-srv_10.42.42.10(pid=19835): Terminating (SIGTERM) 03:41:32.855858 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19836): Terminating (SIGTERM) 03:41:32.899402 run iperf3-srv_10.42.42.10(pid=19837): Terminating (SIGTERM) 03:41:32.942831 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19838): Terminating (SIGTERM) 03:41:32.986709 run iperf3-srv_10.42.42.10(pid=19839): Terminating (SIGTERM) 03:41:33.030274 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19840): Terminating (SIGTERM) 03:41:33.073588 run iperf3-srv_10.42.42.10(pid=19841): Terminating (SIGTERM) 03:41:33.116800 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19844): Terminating (SIGTERM) 03:41:33.160371 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19847): Terminating (SIGTERM) 03:41:33.203753 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19850): Terminating (SIGTERM) 03:41:33.247155 --- ParallelTerminationStrategy: PID 19834 died... 03:41:33.267433 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19834): Terminated: ok {rc=0} 03:41:33.315511 --- ParallelTerminationStrategy: PID 19835 died... 03:41:33.335820 run iperf3-srv_10.42.42.10(pid=19835): Terminated {rc=256} 03:41:33.383469 --- ParallelTerminationStrategy: PID 19836 died... 03:41:33.403608 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19836): Terminated: ok {rc=0} 03:41:33.451579 --- ParallelTerminationStrategy: PID 19837 died... 03:41:33.472075 run iperf3-srv_10.42.42.10(pid=19837): Terminated {rc=256} 03:41:33.520171 --- ParallelTerminationStrategy: PID 19838 died... 03:41:33.540482 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19838): Terminated: ok {rc=0} 03:41:33.588419 --- ParallelTerminationStrategy: PID 19839 died... 03:41:33.608618 run iperf3-srv_10.42.42.10(pid=19839): Terminated {rc=256} 03:41:33.656593 --- ParallelTerminationStrategy: PID 19840 died... 03:41:33.676643 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19840): Terminated: ok {rc=0} 03:41:33.724560 --- ParallelTerminationStrategy: PID 19841 died... 03:41:33.744667 run iperf3-srv_10.42.42.10(pid=19841): Terminated {rc=256} 03:41:33.792867 --- ParallelTerminationStrategy: PID 19844 died... 03:41:33.813456 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19844): Terminated: ok {rc=0} 03:41:33.861233 --- ParallelTerminationStrategy: PID 19847 died... 03:41:33.881191 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19847): Terminated: ok {rc=0} 03:41:33.928891 --- ParallelTerminationStrategy: PID 19850 died... 03:41:33.949421 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19850): Terminated: ok {rc=0} 03:41:34.040598 bus /gobi_4: Setting Powered False 03:41:35.142677 bus /gobi_4: Setting Powered False 03:41:36.262261 bus /gobi_1: Setting Powered False 03:41:37.362253 bus /gobi_1: Setting Powered False 03:41:38.480082 bus /gobi_0: Setting Powered False 03:41:39.581168 bus /gobi_0: Setting Powered False 03:41:40.703987 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:sysmo ping.py ---------------------------------------------- 03:41:41.810977 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:41:41.822887 tst gprs:sysmo: Using 1 x bts (candidates: 1) 03:41:41.858716 tst ping.py: using LAC 18821 03:41:41.987985 tst ping.py: using RAC 206 03:41:42.115535 tst ping.py: using CellId 18821 03:41:42.243010 tst ping.py: using BVCI 18822 03:41:42.363313 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:41:42.374479 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:41:42.385619 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:41:42.396687 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:41:42.407744 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:41:42.418842 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:41:42.430118 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:41:42.441464 tst gprs:sysmo: Using 1 x modem (candidates: 4) 03:41:42.560393 tst ping.py:19: start network... 03:41:42.779880 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:41:43.287163 run create_hlr_db(pid=19852): Launched 03:41:43.410317 bus /gobi_6: Setting Powered False 03:41:44.475401 run create_hlr_db(pid=19852): Terminated: ok {rc=0} 03:41:44.912925 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19854): Launched 03:41:45.219833 run osmo-hlr_10.42.42.2(pid=19855): Launched 03:41:45.335727 run osmo-stp_10.42.42.5: Starting osmo-stp 03:41:45.889646 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19857): Launched 03:41:46.240582 run osmo-stp_10.42.42.5(pid=19858): Launched 03:41:46.464726 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:41:47.131690 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19860): Launched 03:41:47.290030 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:41:47.570382 run patchelf(pid=19861): Launched 03:41:47.751943 run osmo-stp_10.42.42.5(pid=19858): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19858)] 03:41:47.890247 run osmo-stp_10.42.42.5(pid=19858): stdout: | (launched: 2022-12-09_03:41:46.176010) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:41:48.030445 run osmo-stp_10.42.42.5(pid=19858): stderr: | 20221209034146439 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034146439 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034146440 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034146440 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034146441 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034146441 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034146441 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:41:48.170728 run osmo-stp_10.42.42.5(pid=19858): stdout: | (launched: 2022-12-09_03:41:46.176010) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:41:48.304510 run osmo-stp_10.42.42.5(pid=19858): stderr: | 20221209034146439 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034146439 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034146440 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034146440 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034146441 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034146441 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034146441 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:41:48.462886 run patchelf(pid=19861): Terminating (SIGINT) 03:41:48.646408 run patchelf(pid=19861): Terminated: ok {rc=0} 03:41:48.778745 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=19858): Process ended prematurely: osmo-stp_10.42.42.5(pid=19858) [trial-2354↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19858)] [trial-2354↪gprs:sysmo↪ping.py:22] 03:41:48.788210 tst ping.py:22: Test FAILED (7.0 sec) 03:41:48.817403 run osmo-hlr_10.42.42.2(pid=19855): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:sysmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19855)] 03:41:48.869116 run osmo-hlr_10.42.42.2(pid=19855): stdout: | (launched: 2022-12-09_03:41:45.161579) 03:41:48.922691 run osmo-hlr_10.42.42.2(pid=19855): stderr: | 20221209034145340 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209034145340 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209034145340 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209034145340 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209034145340 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209034145340 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209034145352 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:sysmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209034145361 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209034145361 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209034145361 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:41:48.976631 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19854): Terminating (SIGTERM) 03:41:49.019703 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19857): Terminating (SIGTERM) 03:41:49.063143 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19860): Terminating (SIGTERM) 03:41:49.106607 --- ParallelTerminationStrategy: PID 19854 died... 03:41:49.127229 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19854): Terminated: ok {rc=0} 03:41:49.175388 --- ParallelTerminationStrategy: PID 19857 died... 03:41:49.195619 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19857): Terminated: ok {rc=0} 03:41:49.243507 --- ParallelTerminationStrategy: PID 19860 died... 03:41:49.263705 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19860): Terminated: ok {rc=0} 03:41:49.353897 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:sysmo ping_idle_ping.py ---------------------------------------------- 03:41:50.444035 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:41:50.455262 tst gprs:sysmo: Using 1 x bts (candidates: 1) 03:41:50.494273 tst ping_idle_ping.py: using LAC 18822 03:41:50.614287 tst ping_idle_ping.py: using RAC 207 03:41:50.734497 tst ping_idle_ping.py: using CellId 18822 03:41:50.853251 tst ping_idle_ping.py: using BVCI 18823 03:41:50.963498 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:41:50.974073 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:41:50.984510 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:41:50.994947 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:41:51.005319 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:41:51.015595 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:41:51.026221 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:41:51.036695 tst gprs:sysmo: Using 1 x modem (candidates: 4) 03:41:51.162638 tst ping_idle_ping.py:24: start network... 03:41:51.383905 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:41:51.892701 run create_hlr_db(pid=19862): Launched 03:41:52.019463 bus /gobi_6: Setting Powered False 03:41:53.083732 run create_hlr_db(pid=19862): Terminated: ok {rc=0} 03:41:53.520552 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19864): Launched 03:41:53.827322 run osmo-hlr_10.42.42.2(pid=19865): Launched 03:41:53.943571 run osmo-stp_10.42.42.5: Starting osmo-stp 03:41:54.469059 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19867): Launched 03:41:54.775436 run osmo-stp_10.42.42.5(pid=19868): Launched 03:41:54.891546 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:41:55.419788 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19870): Launched 03:41:55.536667 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:41:55.796520 run patchelf(pid=19871): Launched 03:41:55.966003 run osmo-stp_10.42.42.5(pid=19868): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19868)] 03:41:56.094754 run osmo-stp_10.42.42.5(pid=19868): stdout: | (launched: 2022-12-09_03:41:54.716510) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:41:56.225343 run osmo-stp_10.42.42.5(pid=19868): stderr: | 20221209034154891 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034154891 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034154891 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034154891 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034154892 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034154892 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034154892 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:41:56.355555 run osmo-stp_10.42.42.5(pid=19868): stdout: | (launched: 2022-12-09_03:41:54.716510) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:41:56.480384 run osmo-stp_10.42.42.5(pid=19868): stderr: | 20221209034154891 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034154891 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034154891 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034154891 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034154892 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034154892 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034154892 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:41:56.628063 run patchelf(pid=19871): Terminating (SIGINT) 03:41:56.800728 run patchelf(pid=19871): Terminated: ok {rc=0} 03:41:56.924767 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=19868): Process ended prematurely: osmo-stp_10.42.42.5(pid=19868) [trial-2354↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19868)] [trial-2354↪gprs:sysmo↪ping_idle_ping.py:27] 03:41:56.933709 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 03:41:56.960559 run osmo-hlr_10.42.42.2(pid=19865): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:sysmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19865)] 03:41:57.008671 run osmo-hlr_10.42.42.2(pid=19865): stdout: | (launched: 2022-12-09_03:41:53.769281) 03:41:57.058619 run osmo-hlr_10.42.42.2(pid=19865): stderr: | 20221209034153947 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209034153947 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209034153947 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209034153947 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209034153947 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209034153948 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209034153960 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:sysmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209034153969 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209034153969 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209034153969 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:41:57.109168 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19864): Terminating (SIGTERM) 03:41:57.149170 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19867): Terminating (SIGTERM) 03:41:57.189448 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19870): Terminating (SIGTERM) 03:41:57.229687 --- ParallelTerminationStrategy: PID 19864 died... 03:41:57.248784 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19864): Terminated: ok {rc=0} 03:41:57.292773 --- ParallelTerminationStrategy: PID 19867 died... 03:41:57.311557 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19867): Terminated: ok {rc=0} 03:41:57.355947 --- ParallelTerminationStrategy: PID 19870 died... 03:41:57.374671 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19870): Terminated: ok {rc=0} 03:41:57.461094 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2354 gprs:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 gprs:sysmo+mod-bts0-egprs --------------------------------------------------------------------- 03:41:58.746568 tst gprs:sysmo+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:41:58.752084 tst gprs:sysmo+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 03:41:58.773465 tst gprs:sysmo+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 03:41:58.811811 tst gprs:sysmo+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 03:41:58.904435 tst gprs:sysmo+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 03:41:58.925316 tst gprs:sysmo+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 03:41:58.963171 tst gprs:sysmo+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 03:41:59.550009 tst gprs:sysmo+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2354 gprs:sysmo+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 03:41:59.607377 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:41:59.618761 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:41:59.656712 tst cs_paging_gprs_active.py: using LAC 18823 03:41:59.786686 tst cs_paging_gprs_active.py: using RAC 208 03:41:59.920250 tst cs_paging_gprs_active.py: using CellId 18823 03:42:00.050920 tst cs_paging_gprs_active.py: using BVCI 18824 03:42:00.171982 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:42:00.183304 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:42:00.194397 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:42:00.205846 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:42:00.217680 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:42:00.229026 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:42:00.240656 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:42:00.251982 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:42:00.263726 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:42:00.385738 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:42:00.506296 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 03:42:00.730782 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:42:01.144349 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19883): Launched 03:42:01.435653 run iperf3-srv_10.42.42.10(pid=19884): Launched 03:42:01.568248 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 03:42:01.784673 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:42:02.112112 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19885): Launched 03:42:02.403058 run iperf3-srv_10.42.42.10(pid=19886): Launched 03:42:02.520920 tst cs_paging_gprs_active.py:38: start network... 03:42:02.730194 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:42:03.215864 run create_hlr_db(pid=19887): Launched 03:42:03.343645 bus /gobi_6: Setting Powered False 03:42:04.405799 run create_hlr_db(pid=19887): Terminated: ok {rc=0} 03:42:04.860826 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19889): Launched 03:42:05.195021 run osmo-hlr_10.42.42.2(pid=19890): Launched 03:42:05.321932 run osmo-stp_10.42.42.5: Starting osmo-stp 03:42:05.899160 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19892): Launched 03:42:06.233211 run osmo-stp_10.42.42.5(pid=19893): Launched 03:42:06.359581 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:42:06.935422 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19895): Launched 03:42:07.062613 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:42:07.345295 run patchelf(pid=19896): Launched 03:42:07.530539 run osmo-stp_10.42.42.5(pid=19893): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19893)] 03:42:07.671204 run osmo-stp_10.42.42.5(pid=19893): stdout: | (launched: 2022-12-09_03:42:06.170613) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:42:07.812729 run osmo-stp_10.42.42.5(pid=19893): stderr: | 20221209034206367 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034206367 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034206368 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034206368 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034206368 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034206369 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034206369 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:42:07.954628 run osmo-stp_10.42.42.5(pid=19893): stdout: | (launched: 2022-12-09_03:42:06.170613) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:42:08.091359 run osmo-stp_10.42.42.5(pid=19893): stderr: | 20221209034206367 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034206367 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034206368 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034206368 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034206368 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034206369 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034206369 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:42:08.252782 run patchelf(pid=19896): Terminating (SIGINT) 03:42:08.439631 run patchelf(pid=19896): Terminated: ok {rc=0} 03:42:08.575170 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=19893): Process ended prematurely: osmo-stp_10.42.42.5(pid=19893) [trial-2354↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19893)] [trial-2354↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 03:42:08.585573 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 03:42:08.615184 run osmo-hlr_10.42.42.2(pid=19890): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19890)] 03:42:08.666469 run osmo-hlr_10.42.42.2(pid=19890): stdout: | (launched: 2022-12-09_03:42:05.132505) 03:42:08.719559 run osmo-hlr_10.42.42.2(pid=19890): stderr: | 20221209034205334 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209034205334 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209034205335 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209034205335 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209034205335 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209034205335 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209034205347 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:sysmo+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209034205356 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209034205356 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209034205356 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:42:08.773436 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19883): Terminating (SIGTERM) 03:42:08.816387 run iperf3-srv_10.42.42.10(pid=19884): Terminating (SIGTERM) 03:42:08.859522 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19885): Terminating (SIGTERM) 03:42:08.902883 run iperf3-srv_10.42.42.10(pid=19886): Terminating (SIGTERM) 03:42:08.945817 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19889): Terminating (SIGTERM) 03:42:08.988933 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19892): Terminating (SIGTERM) 03:42:09.031697 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19895): Terminating (SIGTERM) 03:42:09.075219 --- ParallelTerminationStrategy: PID 19883 died... 03:42:09.095579 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19883): Terminated: ok {rc=0} 03:42:09.142974 --- ParallelTerminationStrategy: PID 19884 died... 03:42:09.162835 run iperf3-srv_10.42.42.10(pid=19884): Terminated {rc=256} 03:42:09.210125 --- ParallelTerminationStrategy: PID 19885 died... 03:42:09.230250 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19885): Terminated: ok {rc=0} 03:42:09.277701 --- ParallelTerminationStrategy: PID 19886 died... 03:42:09.297634 run iperf3-srv_10.42.42.10(pid=19886): Terminated {rc=256} 03:42:09.345151 --- ParallelTerminationStrategy: PID 19889 died... 03:42:09.364939 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19889): Terminated: ok {rc=0} 03:42:09.412513 --- ParallelTerminationStrategy: PID 19892 died... 03:42:09.432412 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19892): Terminated: ok {rc=0} 03:42:09.480239 --- ParallelTerminationStrategy: PID 19895 died... 03:42:09.500673 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19895): Terminated: ok {rc=0} 03:42:09.590850 bus /gobi_0: Setting Powered False 03:42:10.690812 bus /gobi_0: Setting Powered False 03:42:11.809098 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:sysmo+mod-bts0-egprs iperf3.py ---------------------------------------------- 03:42:12.960935 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:42:12.973208 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:42:13.011106 tst iperf3.py: using LAC 18824 03:42:13.141092 tst iperf3.py: using RAC 209 03:42:13.269150 tst iperf3.py: using CellId 18824 03:42:13.398471 tst iperf3.py: using BVCI 18825 03:42:13.519254 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:42:13.530652 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:42:13.542025 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:42:13.553635 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:42:13.565030 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:42:13.576261 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:42:13.587838 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:42:13.599250 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:42:13.610874 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:42:13.733434 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 03:42:13.958351 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:42:14.292813 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19897): Launched 03:42:14.583260 run iperf3-srv_10.42.42.10(pid=19898): Launched 03:42:14.707476 tst iperf3.py:8: start network... 03:42:14.931484 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:42:15.447240 run create_hlr_db(pid=19899): Launched 03:42:15.573881 bus /gobi_6: Setting Powered False 03:42:16.654029 run create_hlr_db(pid=19899): Terminated: ok {rc=0} 03:42:17.107315 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19901): Launched 03:42:17.432793 run osmo-hlr_10.42.42.2(pid=19902): Launched 03:42:17.552246 run osmo-stp_10.42.42.5: Starting osmo-stp 03:42:18.132916 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19904): Launched 03:42:18.466156 run osmo-stp_10.42.42.5(pid=19905): Launched 03:42:18.593067 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:42:19.167680 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19907): Launched 03:42:19.294581 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:42:19.578177 run patchelf(pid=19908): Launched 03:42:19.763850 run osmo-stp_10.42.42.5(pid=19905): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19905)] 03:42:19.903436 run osmo-stp_10.42.42.5(pid=19905): stdout: | (launched: 2022-12-09_03:42:18.403699) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:42:20.044722 run osmo-stp_10.42.42.5(pid=19905): stderr: | 20221209034218600 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034218600 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034218600 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034218601 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034218601 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034218601 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034218601 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:42:20.186463 run osmo-stp_10.42.42.5(pid=19905): stdout: | (launched: 2022-12-09_03:42:18.403699) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:42:20.322025 run osmo-stp_10.42.42.5(pid=19905): stderr: | 20221209034218600 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034218600 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034218600 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034218601 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034218601 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034218601 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034218601 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:42:20.482584 run patchelf(pid=19908): Terminating (SIGINT) 03:42:20.669210 run patchelf(pid=19908): Terminated: ok {rc=0} 03:42:20.803097 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19905): Process ended prematurely: osmo-stp_10.42.42.5(pid=19905) [trial-2354↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19905)] [trial-2354↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8] 03:42:20.813310 tst iperf3.py:8: Test FAILED (7.9 sec) 03:42:20.842910 run osmo-hlr_10.42.42.2(pid=19902): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:sysmo+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19902)] 03:42:20.894783 run osmo-hlr_10.42.42.2(pid=19902): stdout: | (launched: 2022-12-09_03:42:17.373589) 03:42:20.948053 run osmo-hlr_10.42.42.2(pid=19902): stderr: | 20221209034217554 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209034217554 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209034217554 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209034217554 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209034217554 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209034217554 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209034217571 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:sysmo+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209034217582 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209034217582 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209034217582 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:42:21.001891 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19897): Terminating (SIGTERM) 03:42:21.044865 run iperf3-srv_10.42.42.10(pid=19898): Terminating (SIGTERM) 03:42:21.087882 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19901): Terminating (SIGTERM) 03:42:21.131029 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19904): Terminating (SIGTERM) 03:42:21.173684 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19907): Terminating (SIGTERM) 03:42:21.216653 --- ParallelTerminationStrategy: PID 19897 died... 03:42:21.237142 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19897): Terminated: ok {rc=0} 03:42:21.284385 --- ParallelTerminationStrategy: PID 19898 died... 03:42:21.304074 run iperf3-srv_10.42.42.10(pid=19898): Terminated {rc=256} 03:42:21.351198 --- ParallelTerminationStrategy: PID 19901 died... 03:42:21.371109 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19901): Terminated: ok {rc=0} 03:42:21.418296 --- ParallelTerminationStrategy: PID 19904 died... 03:42:21.438299 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19904): Terminated: ok {rc=0} 03:42:21.485488 --- ParallelTerminationStrategy: PID 19907 died... 03:42:21.505809 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19907): Terminated: ok {rc=0} 03:42:21.595055 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:sysmo+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 03:42:22.746575 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:42:22.758827 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:42:22.796716 tst iperf3m4.py: using LAC 18825 03:42:22.930704 tst iperf3m4.py: using RAC 210 03:42:23.060408 tst iperf3m4.py: using CellId 18825 03:42:23.188120 tst iperf3m4.py: using BVCI 18826 03:42:23.308262 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:42:23.319652 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:42:23.330882 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:42:23.342293 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:42:23.353707 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:42:23.364853 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:42:23.376441 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:42:23.387864 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:42:23.399580 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:42:23.519632 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:42:23.641967 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:42:23.763884 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:42:23.882203 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 03:42:24.091572 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:42:24.407907 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19909): Launched 03:42:24.680198 run iperf3-srv_10.42.42.10(pid=19910): Launched 03:42:24.796753 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 03:42:25.004445 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:42:25.318154 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19911): Launched 03:42:25.589864 run iperf3-srv_10.42.42.10(pid=19912): Launched 03:42:25.706309 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 03:42:25.913132 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:42:26.225943 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19913): Launched 03:42:26.497749 run iperf3-srv_10.42.42.10(pid=19914): Launched 03:42:26.623926 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 03:42:26.848557 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:42:27.185080 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19915): Launched 03:42:27.475333 run iperf3-srv_10.42.42.10(pid=19916): Launched 03:42:27.600492 tst iperf3m4.py:8: start network... 03:42:27.824514 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:42:28.340477 run create_hlr_db(pid=19917): Launched 03:42:28.466897 bus /gobi_6: Setting Powered False 03:42:29.532489 run create_hlr_db(pid=19917): Terminated: ok {rc=0} 03:42:29.975334 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19919): Launched 03:42:30.287025 run osmo-hlr_10.42.42.2(pid=19920): Launched 03:42:30.404512 run osmo-stp_10.42.42.5: Starting osmo-stp 03:42:30.947285 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19922): Launched 03:42:31.340197 run osmo-stp_10.42.42.5(pid=19923): Launched 03:42:31.715963 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:42:32.405438 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19925): Launched 03:42:32.523337 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:42:32.786705 run patchelf(pid=19926): Launched 03:42:32.957678 run osmo-stp_10.42.42.5(pid=19923): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19923)] 03:42:33.089537 run osmo-stp_10.42.42.5(pid=19923): stdout: | (launched: 2022-12-09_03:42:31.259881) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:42:33.221461 run osmo-stp_10.42.42.5(pid=19923): stderr: | 20221209034231526 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034231526 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034231527 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034231528 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034231529 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034231529 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034231529 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:42:33.353774 run osmo-stp_10.42.42.5(pid=19923): stdout: | (launched: 2022-12-09_03:42:31.259881) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:42:33.479929 run osmo-stp_10.42.42.5(pid=19923): stderr: | 20221209034231526 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034231526 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034231527 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034231528 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034231529 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034231529 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034231529 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:42:33.629730 run patchelf(pid=19926): Terminating (SIGINT) 03:42:33.803674 run patchelf(pid=19926): Terminated: ok {rc=0} 03:42:33.929300 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19923): Process ended prematurely: osmo-stp_10.42.42.5(pid=19923) [trial-2354↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19923)] [trial-2354↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8] 03:42:33.938816 tst iperf3m4.py:8: Test FAILED (11.2 sec) 03:42:33.966492 run osmo-hlr_10.42.42.2(pid=19920): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19920)] 03:42:34.014785 run osmo-hlr_10.42.42.2(pid=19920): stdout: | (launched: 2022-12-09_03:42:30.228232) 03:42:34.064931 run osmo-hlr_10.42.42.2(pid=19920): stderr: | 20221209034230407 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209034230407 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209034230407 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209034230407 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209034230407 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209034230407 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209034230419 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:sysmo+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209034230428 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209034230428 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209034230429 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:42:34.115703 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19909): Terminating (SIGTERM) 03:42:34.155592 run iperf3-srv_10.42.42.10(pid=19910): Terminating (SIGTERM) 03:42:34.195608 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19911): Terminating (SIGTERM) 03:42:34.235519 run iperf3-srv_10.42.42.10(pid=19912): Terminating (SIGTERM) 03:42:34.275323 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19913): Terminating (SIGTERM) 03:42:34.315217 run iperf3-srv_10.42.42.10(pid=19914): Terminating (SIGTERM) 03:42:34.355014 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19915): Terminating (SIGTERM) 03:42:34.394689 run iperf3-srv_10.42.42.10(pid=19916): Terminating (SIGTERM) 03:42:34.434437 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19919): Terminating (SIGTERM) 03:42:34.474601 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19922): Terminating (SIGTERM) 03:42:34.514542 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19925): Terminating (SIGTERM) 03:42:34.554726 --- ParallelTerminationStrategy: PID 19909 died... 03:42:34.574088 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19909): Terminated: ok {rc=0} 03:42:34.618806 --- ParallelTerminationStrategy: PID 19910 died... 03:42:34.637642 run iperf3-srv_10.42.42.10(pid=19910): Terminated {rc=256} 03:42:34.682461 --- ParallelTerminationStrategy: PID 19911 died... 03:42:34.701454 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19911): Terminated: ok {rc=0} 03:42:34.745971 --- ParallelTerminationStrategy: PID 19912 died... 03:42:34.764939 run iperf3-srv_10.42.42.10(pid=19912): Terminated {rc=256} 03:42:34.809335 --- ParallelTerminationStrategy: PID 19913 died... 03:42:34.828380 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19913): Terminated: ok {rc=0} 03:42:34.873223 --- ParallelTerminationStrategy: PID 19914 died... 03:42:34.892181 run iperf3-srv_10.42.42.10(pid=19914): Terminated {rc=256} 03:42:34.936529 --- ParallelTerminationStrategy: PID 19915 died... 03:42:34.955476 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19915): Terminated: ok {rc=0} 03:42:35.000804 --- ParallelTerminationStrategy: PID 19916 died... 03:42:35.020303 run iperf3-srv_10.42.42.10(pid=19916): Terminated {rc=256} 03:42:35.065286 --- ParallelTerminationStrategy: PID 19919 died... 03:42:35.084279 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19919): Terminated: ok {rc=0} 03:42:35.129141 --- ParallelTerminationStrategy: PID 19922 died... 03:42:35.148335 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19922): Terminated: ok {rc=0} 03:42:35.193161 --- ParallelTerminationStrategy: PID 19925 died... 03:42:35.212296 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19925): Terminated: ok {rc=0} 03:42:35.301075 bus /gobi_4: Setting Powered False 03:42:36.402605 bus /gobi_4: Setting Powered False 03:42:37.517637 bus /gobi_1: Setting Powered False 03:42:38.616737 bus /gobi_1: Setting Powered False 03:42:39.739419 bus /gobi_0: Setting Powered False 03:42:40.839771 bus /gobi_0: Setting Powered False 03:42:41.961700 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:sysmo+mod-bts0-egprs ping.py ---------------------------------------------- 03:42:43.065404 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:42:43.077682 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:42:43.116702 tst ping.py: using LAC 18826 03:42:43.247014 tst ping.py: using RAC 211 03:42:43.367489 tst ping.py: using CellId 18826 03:42:43.488836 tst ping.py: using BVCI 18827 03:42:43.599865 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:42:43.610848 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:42:43.621833 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:42:43.632413 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:42:43.642951 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:42:43.653501 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:42:43.664260 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:42:43.674989 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:42:43.797643 tst ping.py:19: start network... 03:42:44.017850 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:42:44.526705 run create_hlr_db(pid=19927): Launched 03:42:44.651751 bus /gobi_6: Setting Powered False 03:42:45.715475 run create_hlr_db(pid=19927): Terminated: ok {rc=0} 03:42:46.206118 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19929): Launched 03:42:46.549173 run osmo-hlr_10.42.42.2(pid=19930): Launched 03:42:46.798827 run osmo-stp_10.42.42.5: Starting osmo-stp 03:42:47.447032 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19932): Launched 03:42:47.774409 run osmo-stp_10.42.42.5(pid=19933): Launched 03:42:47.899314 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:42:48.462030 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19935): Launched 03:42:48.587363 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:42:48.864447 run patchelf(pid=19936): Launched 03:42:49.045197 run osmo-stp_10.42.42.5(pid=19933): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19933)] 03:42:49.183032 run osmo-stp_10.42.42.5(pid=19933): stdout: | (launched: 2022-12-09_03:42:47.713374) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:42:49.322664 run osmo-stp_10.42.42.5(pid=19933): stderr: | 20221209034247906 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034247906 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034247906 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034247906 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034247907 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034247907 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034247907 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:42:49.462165 run osmo-stp_10.42.42.5(pid=19933): stdout: | (launched: 2022-12-09_03:42:47.713374) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:42:49.596440 run osmo-stp_10.42.42.5(pid=19933): stderr: | 20221209034247906 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034247906 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034247906 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034247906 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034247907 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034247907 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034247907 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:42:49.755100 run patchelf(pid=19936): Terminating (SIGINT) 03:42:49.937539 run patchelf(pid=19936): Terminated: ok {rc=0} 03:42:50.069399 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=19933): Process ended prematurely: osmo-stp_10.42.42.5(pid=19933) [trial-2354↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19933)] [trial-2354↪gprs:sysmo+mod-bts0-egprs↪ping.py:22] 03:42:50.079074 tst ping.py:22: Test FAILED (7.0 sec) 03:42:50.108751 run osmo-hlr_10.42.42.2(pid=19930): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:sysmo+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19930)] 03:42:50.160035 run osmo-hlr_10.42.42.2(pid=19930): stdout: | (launched: 2022-12-09_03:42:46.486110) 03:42:50.212922 run osmo-hlr_10.42.42.2(pid=19930): stderr: | 20221209034246790 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209034246790 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209034246790 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209034246790 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209034246790 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209034246790 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209034246810 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:sysmo+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209034246818 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209034246818 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209034246818 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:42:50.266151 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19929): Terminating (SIGTERM) 03:42:50.308900 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19932): Terminating (SIGTERM) 03:42:50.351696 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19935): Terminating (SIGTERM) 03:42:50.394688 --- ParallelTerminationStrategy: PID 19929 died... 03:42:50.415086 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19929): Terminated: ok {rc=0} 03:42:50.462461 --- ParallelTerminationStrategy: PID 19932 died... 03:42:50.482344 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19932): Terminated: ok {rc=0} 03:42:50.530081 --- ParallelTerminationStrategy: PID 19935 died... 03:42:50.550098 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19935): Terminated: ok {rc=0} 03:42:50.640022 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:sysmo+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 03:42:51.730288 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:42:51.742948 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:42:51.782403 tst ping_idle_ping.py: using LAC 18827 03:42:51.930397 tst ping_idle_ping.py: using RAC 212 03:42:52.051775 tst ping_idle_ping.py: using CellId 18827 03:42:52.177867 tst ping_idle_ping.py: using BVCI 18828 03:42:52.290127 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:42:52.301178 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:42:52.312055 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:42:52.323082 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:42:52.334150 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:42:52.344790 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:42:52.355660 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:42:52.366470 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:42:52.493908 tst ping_idle_ping.py:24: start network... 03:42:52.714108 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:42:53.220647 run create_hlr_db(pid=19937): Launched 03:42:53.345531 bus /gobi_6: Setting Powered False 03:42:54.409654 run create_hlr_db(pid=19937): Terminated: ok {rc=0} 03:42:54.847129 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19939): Launched 03:42:55.154293 run osmo-hlr_10.42.42.2(pid=19940): Launched 03:42:55.270628 run osmo-stp_10.42.42.5: Starting osmo-stp 03:42:55.797995 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19942): Launched 03:42:56.104567 run osmo-stp_10.42.42.5(pid=19943): Launched 03:42:56.220351 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:42:56.749624 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19945): Launched 03:42:56.866169 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:42:57.126140 run patchelf(pid=19946): Launched 03:42:57.295876 run osmo-stp_10.42.42.5(pid=19943): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19943)] 03:42:57.424611 run osmo-stp_10.42.42.5(pid=19943): stdout: | (launched: 2022-12-09_03:42:56.046187) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:42:57.555443 run osmo-stp_10.42.42.5(pid=19943): stderr: | 20221209034256218 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034256218 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034256218 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034256219 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034256219 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034256219 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034256219 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:42:57.685854 run osmo-stp_10.42.42.5(pid=19943): stdout: | (launched: 2022-12-09_03:42:56.046187) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:42:57.811244 run osmo-stp_10.42.42.5(pid=19943): stderr: | 20221209034256218 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034256218 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034256218 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034256219 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034256219 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034256219 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034256219 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:42:57.959390 run patchelf(pid=19946): Terminating (SIGINT) 03:42:58.131875 run patchelf(pid=19946): Terminated: ok {rc=0} 03:42:58.255718 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=19943): Process ended prematurely: osmo-stp_10.42.42.5(pid=19943) [trial-2354↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19943)] [trial-2354↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27] 03:42:58.264662 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 03:42:58.291775 run osmo-hlr_10.42.42.2(pid=19940): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19940)] 03:42:58.340287 run osmo-hlr_10.42.42.2(pid=19940): stdout: | (launched: 2022-12-09_03:42:55.095966) 03:42:58.390726 run osmo-hlr_10.42.42.2(pid=19940): stderr: | 20221209034255273 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209034255273 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209034255273 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209034255273 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209034255273 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209034255273 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209034255311 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:sysmo+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209034255322 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209034255322 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209034255322 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:42:58.441625 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19939): Terminating (SIGTERM) 03:42:58.482237 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19942): Terminating (SIGTERM) 03:42:58.522852 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19945): Terminating (SIGTERM) 03:42:58.563820 --- ParallelTerminationStrategy: PID 19939 died... 03:42:58.583434 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19939): Terminated: ok {rc=0} 03:42:58.629783 --- ParallelTerminationStrategy: PID 19942 died... 03:42:58.648691 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19942): Terminated: ok {rc=0} 03:42:58.693710 --- ParallelTerminationStrategy: PID 19945 died... 03:42:58.712637 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19945): Terminated: ok {rc=0} 03:42:58.797783 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2354 gprs:sysmo+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 gprs:sysmo+mod-bts0-dynts-ipa --------------------------------------------------------------------- 03:43:00.086270 tst gprs:sysmo+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:43:00.092345 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 03:43:00.113487 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 03:43:00.152029 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 03:43:00.240609 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 03:43:00.262249 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 03:43:00.302298 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 03:43:00.917452 tst gprs:sysmo+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2354 gprs:sysmo+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 03:43:00.974525 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:43:00.990858 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 03:43:01.064570 tst cs_paging_gprs_active.py: using LAC 18828 03:43:01.188052 tst cs_paging_gprs_active.py: using RAC 213 03:43:01.319944 tst cs_paging_gprs_active.py: using CellId 18828 03:43:01.448065 tst cs_paging_gprs_active.py: using BVCI 18829 03:43:01.600002 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:43:01.611869 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:43:01.623491 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:43:01.635199 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:43:01.646733 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:43:01.658219 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:43:01.669959 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:43:01.681392 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:43:01.693066 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:43:01.813631 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:43:01.935353 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 03:43:02.190760 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:43:02.529797 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19950): Launched 03:43:02.820906 run iperf3-srv_10.42.42.10(pid=19951): Launched 03:43:02.945191 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 03:43:03.168586 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:43:03.503906 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19952): Launched 03:43:03.794048 run iperf3-srv_10.42.42.10(pid=19953): Launched 03:43:03.919729 tst cs_paging_gprs_active.py:38: start network... 03:43:04.142970 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:43:04.659475 run create_hlr_db(pid=19954): Launched 03:43:04.785788 bus /gobi_6: Setting Powered False 03:43:05.851195 run create_hlr_db(pid=19954): Terminated: ok {rc=0} 03:43:06.296010 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19956): Launched 03:43:06.610025 run osmo-hlr_10.42.42.2(pid=19957): Launched 03:43:06.728825 run osmo-stp_10.42.42.5: Starting osmo-stp 03:43:07.279263 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19959): Launched 03:43:07.591766 run osmo-stp_10.42.42.5(pid=19960): Launched 03:43:07.709233 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:43:08.245339 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19962): Launched 03:43:08.363311 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:43:08.627848 run patchelf(pid=19963): Launched 03:43:08.800088 run osmo-stp_10.42.42.5(pid=19960): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19960)] 03:43:08.931086 run osmo-stp_10.42.42.5(pid=19960): stdout: | (launched: 2022-12-09_03:43:07.533288) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:43:09.063713 run osmo-stp_10.42.42.5(pid=19960): stderr: | 20221209034307704 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034307704 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034307705 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034307705 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034307707 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034307707 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034307708 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:43:09.196071 run osmo-stp_10.42.42.5(pid=19960): stdout: | (launched: 2022-12-09_03:43:07.533288) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:43:09.323495 run osmo-stp_10.42.42.5(pid=19960): stderr: | 20221209034307704 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034307704 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034307705 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034307705 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034307707 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034307707 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034307708 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:43:09.473918 run patchelf(pid=19963): Terminating (SIGINT) 03:43:09.648858 run patchelf(pid=19963): Terminated: ok {rc=0} 03:43:09.774658 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=19960): Process ended prematurely: osmo-stp_10.42.42.5(pid=19960) [trial-2354↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19960)] [trial-2354↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 03:43:09.784022 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 03:43:09.811658 run osmo-hlr_10.42.42.2(pid=19957): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19957)] 03:43:09.860012 run osmo-hlr_10.42.42.2(pid=19957): stdout: | (launched: 2022-12-09_03:43:06.550601) 03:43:09.910200 run osmo-hlr_10.42.42.2(pid=19957): stderr: | 20221209034306730 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209034306730 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209034306730 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209034306730 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209034306730 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209034306730 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209034306742 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:sysmo+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209034306750 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209034306750 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209034306750 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:43:09.960888 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19950): Terminating (SIGTERM) 03:43:10.001591 run iperf3-srv_10.42.42.10(pid=19951): Terminating (SIGTERM) 03:43:10.042348 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19952): Terminating (SIGTERM) 03:43:10.082991 run iperf3-srv_10.42.42.10(pid=19953): Terminating (SIGTERM) 03:43:10.123987 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19956): Terminating (SIGTERM) 03:43:10.164763 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19959): Terminating (SIGTERM) 03:43:10.205099 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19962): Terminating (SIGTERM) 03:43:10.246298 --- ParallelTerminationStrategy: PID 19950 died... 03:43:10.265896 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19950): Terminated: ok {rc=0} 03:43:10.310791 --- ParallelTerminationStrategy: PID 19951 died... 03:43:10.329742 run iperf3-srv_10.42.42.10(pid=19951): Terminated {rc=256} 03:43:10.374081 --- ParallelTerminationStrategy: PID 19952 died... 03:43:10.392889 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19952): Terminated: ok {rc=0} 03:43:10.437546 --- ParallelTerminationStrategy: PID 19953 died... 03:43:10.456428 run iperf3-srv_10.42.42.10(pid=19953): Terminated {rc=256} 03:43:10.501169 --- ParallelTerminationStrategy: PID 19956 died... 03:43:10.520237 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19956): Terminated: ok {rc=0} 03:43:10.564868 --- ParallelTerminationStrategy: PID 19959 died... 03:43:10.584291 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19959): Terminated: ok {rc=0} 03:43:10.629183 --- ParallelTerminationStrategy: PID 19962 died... 03:43:10.648031 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19962): Terminated: ok {rc=0} 03:43:10.733402 bus /gobi_0: Setting Powered False 03:43:11.832908 bus /gobi_0: Setting Powered False 03:43:12.954203 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:sysmo+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 03:43:14.103414 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:43:14.115099 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 03:43:14.174561 tst iperf3.py: using LAC 18829 03:43:14.296897 tst iperf3.py: using RAC 214 03:43:14.419108 tst iperf3.py: using CellId 18829 03:43:14.541829 tst iperf3.py: using BVCI 18830 03:43:14.653502 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:43:14.664308 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:43:14.675171 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:43:14.685892 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:43:14.696397 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:43:14.707083 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:43:14.717930 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:43:14.728499 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:43:14.739289 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:43:14.854319 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 03:43:15.061828 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:43:15.375186 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19964): Launched 03:43:15.647512 run iperf3-srv_10.42.42.10(pid=19965): Launched 03:43:15.763472 tst iperf3.py:8: start network... 03:43:15.996093 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:43:16.528576 run create_hlr_db(pid=19966): Launched 03:43:16.692622 bus /gobi_6: Setting Powered False 03:43:17.754527 run create_hlr_db(pid=19966): Terminated: ok {rc=0} 03:43:18.214879 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19968): Launched 03:43:18.527761 run osmo-hlr_10.42.42.2(pid=19969): Launched 03:43:18.644098 run osmo-stp_10.42.42.5: Starting osmo-stp 03:43:19.272170 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19983): Launched 03:43:19.583036 run osmo-stp_10.42.42.5(pid=19984): Launched 03:43:19.699371 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:43:20.234266 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19986): Launched 03:43:20.351731 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:43:20.615030 run patchelf(pid=19987): Launched 03:43:20.786353 run osmo-stp_10.42.42.5(pid=19984): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19984)] 03:43:20.916419 run osmo-stp_10.42.42.5(pid=19984): stdout: | (launched: 2022-12-09_03:43:19.524127) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:43:21.048302 run osmo-stp_10.42.42.5(pid=19984): stderr: | 20221209034319699 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034319699 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034319700 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034319700 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034319701 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034319701 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034319701 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:43:21.180393 run osmo-stp_10.42.42.5(pid=19984): stdout: | (launched: 2022-12-09_03:43:19.524127) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:43:21.306723 run osmo-stp_10.42.42.5(pid=19984): stderr: | 20221209034319699 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034319699 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034319700 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034319700 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034319701 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034319701 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034319701 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:43:21.457432 run patchelf(pid=19987): Terminating (SIGINT) 03:43:21.631409 run patchelf(pid=19987): Terminated: ok {rc=0} 03:43:21.756805 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19984): Process ended prematurely: osmo-stp_10.42.42.5(pid=19984) [trial-2354↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19984)] [trial-2354↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8] 03:43:21.766369 tst iperf3.py:8: Test FAILED (7.7 sec) 03:43:21.794028 run osmo-hlr_10.42.42.2(pid=19969): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19969)] 03:43:21.842165 run osmo-hlr_10.42.42.2(pid=19969): stdout: | (launched: 2022-12-09_03:43:18.468242) 03:43:21.892313 run osmo-hlr_10.42.42.2(pid=19969): stderr: | 20221209034318650 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209034318650 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209034318650 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209034318650 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209034318650 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209034318650 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209034318662 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:sysmo+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209034318671 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209034318672 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209034318672 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:43:21.942865 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19964): Terminating (SIGTERM) 03:43:21.982850 run iperf3-srv_10.42.42.10(pid=19965): Terminating (SIGTERM) 03:43:22.022686 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19968): Terminating (SIGTERM) 03:43:22.062604 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19983): Terminating (SIGTERM) 03:43:22.102451 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19986): Terminating (SIGTERM) 03:43:22.142422 --- ParallelTerminationStrategy: PID 19964 died... 03:43:22.161946 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19964): Terminated: ok {rc=0} 03:43:22.206013 --- ParallelTerminationStrategy: PID 19965 died... 03:43:22.224593 run iperf3-srv_10.42.42.10(pid=19965): Terminated {rc=256} 03:43:22.268428 --- ParallelTerminationStrategy: PID 19968 died... 03:43:22.287140 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19968): Terminated: ok {rc=0} 03:43:22.330909 --- ParallelTerminationStrategy: PID 19983 died... 03:43:22.349706 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19983): Terminated: ok {rc=0} 03:43:22.393692 --- ParallelTerminationStrategy: PID 19986 died... 03:43:22.412913 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19986): Terminated: ok {rc=0} 03:43:22.497106 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:sysmo+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 03:43:23.648175 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:43:23.663552 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 03:43:23.720703 tst iperf3m4.py: using LAC 18830 03:43:23.850548 tst iperf3m4.py: using RAC 215 03:43:23.981580 tst iperf3m4.py: using CellId 18830 03:43:24.104201 tst iperf3m4.py: using BVCI 18831 03:43:24.218267 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:43:24.229277 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:43:24.239990 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:43:24.250707 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:43:24.261279 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:43:24.271876 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:43:24.282724 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:43:24.293355 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:43:24.304103 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:43:24.425196 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:43:24.549323 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:43:24.669467 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:43:24.792554 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 03:43:25.016918 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:43:25.353499 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19988): Launched 03:43:25.645671 run iperf3-srv_10.42.42.10(pid=19989): Launched 03:43:25.770698 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 03:43:25.994576 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:43:26.330306 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19990): Launched 03:43:26.623810 run iperf3-srv_10.42.42.10(pid=19991): Launched 03:43:26.748367 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 03:43:26.971663 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:43:27.306298 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19992): Launched 03:43:27.598405 run iperf3-srv_10.42.42.10(pid=19993): Launched 03:43:27.724541 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 03:43:27.948020 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:43:28.283231 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19994): Launched 03:43:28.574588 run iperf3-srv_10.42.42.10(pid=19995): Launched 03:43:28.699227 tst iperf3m4.py:8: start network... 03:43:28.922946 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:43:29.440353 run create_hlr_db(pid=19996): Launched 03:43:29.567343 bus /gobi_6: Setting Powered False 03:43:30.632940 run create_hlr_db(pid=19996): Terminated: ok {rc=0} 03:43:31.114127 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19998): Launched 03:43:31.464747 run osmo-hlr_10.42.42.2(pid=19999): Launched 03:43:31.734183 run osmo-stp_10.42.42.5: Starting osmo-stp 03:43:32.501163 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20001): Launched 03:43:32.834151 run osmo-stp_10.42.42.5(pid=20002): Launched 03:43:32.961081 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:43:33.535202 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20004): Launched 03:43:33.662285 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:43:33.944438 run patchelf(pid=20005): Launched 03:43:34.130345 run osmo-stp_10.42.42.5(pid=20002): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20002)] 03:43:34.269714 run osmo-stp_10.42.42.5(pid=20002): stdout: | (launched: 2022-12-09_03:43:32.771512) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:43:34.411109 run osmo-stp_10.42.42.5(pid=20002): stderr: | 20221209034332967 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034332968 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034332968 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034332968 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034332969 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034332969 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034332969 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:43:34.552694 run osmo-stp_10.42.42.5(pid=20002): stdout: | (launched: 2022-12-09_03:43:32.771512) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:43:34.688312 run osmo-stp_10.42.42.5(pid=20002): stderr: | 20221209034332967 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034332968 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034332968 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034332968 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034332969 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034332969 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034332969 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:43:34.848783 run patchelf(pid=20005): Terminating (SIGINT) 03:43:35.034657 run patchelf(pid=20005): Terminated: ok {rc=0} 03:43:35.168605 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20002): Process ended prematurely: osmo-stp_10.42.42.5(pid=20002) [trial-2354↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20002)] [trial-2354↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8] 03:43:35.178841 tst iperf3m4.py:8: Test FAILED (11.6 sec) 03:43:35.208210 run osmo-hlr_10.42.42.2(pid=19999): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19999)] 03:43:35.259849 run osmo-hlr_10.42.42.2(pid=19999): stdout: | (launched: 2022-12-09_03:43:31.399358) 03:43:35.312841 run osmo-hlr_10.42.42.2(pid=19999): stderr: | 20221209034331676 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209034331676 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209034331676 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209034331676 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209034331676 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209034331677 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209034331700 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:sysmo+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209034331724 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209034331724 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209034331724 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:43:35.366062 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19988): Terminating (SIGTERM) 03:43:35.408632 run iperf3-srv_10.42.42.10(pid=19989): Terminating (SIGTERM) 03:43:35.451455 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19990): Terminating (SIGTERM) 03:43:35.494527 run iperf3-srv_10.42.42.10(pid=19991): Terminating (SIGTERM) 03:43:35.538040 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19992): Terminating (SIGTERM) 03:43:35.581028 run iperf3-srv_10.42.42.10(pid=19993): Terminating (SIGTERM) 03:43:35.623489 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19994): Terminating (SIGTERM) 03:43:35.666253 run iperf3-srv_10.42.42.10(pid=19995): Terminating (SIGTERM) 03:43:35.708707 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19998): Terminating (SIGTERM) 03:43:35.751802 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20001): Terminating (SIGTERM) 03:43:35.794380 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20004): Terminating (SIGTERM) 03:43:35.837310 --- ParallelTerminationStrategy: PID 19988 died... 03:43:35.857639 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19988): Terminated: ok {rc=0} 03:43:35.904907 --- ParallelTerminationStrategy: PID 19989 died... 03:43:35.924711 run iperf3-srv_10.42.42.10(pid=19989): Terminated {rc=256} 03:43:35.971779 --- ParallelTerminationStrategy: PID 19990 died... 03:43:35.991671 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19990): Terminated: ok {rc=0} 03:43:36.038778 --- ParallelTerminationStrategy: PID 19991 died... 03:43:36.058598 run iperf3-srv_10.42.42.10(pid=19991): Terminated {rc=256} 03:43:36.105667 --- ParallelTerminationStrategy: PID 19992 died... 03:43:36.125464 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19992): Terminated: ok {rc=0} 03:43:36.172551 --- ParallelTerminationStrategy: PID 19993 died... 03:43:36.192268 run iperf3-srv_10.42.42.10(pid=19993): Terminated {rc=256} 03:43:36.239422 --- ParallelTerminationStrategy: PID 19994 died... 03:43:36.259181 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19994): Terminated: ok {rc=0} 03:43:36.306454 --- ParallelTerminationStrategy: PID 19995 died... 03:43:36.326387 run iperf3-srv_10.42.42.10(pid=19995): Terminated {rc=256} 03:43:36.373617 --- ParallelTerminationStrategy: PID 19998 died... 03:43:36.393601 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19998): Terminated: ok {rc=0} 03:43:36.440816 --- ParallelTerminationStrategy: PID 20001 died... 03:43:36.461141 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20001): Terminated: ok {rc=0} 03:43:36.508503 --- ParallelTerminationStrategy: PID 20004 died... 03:43:36.528689 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20004): Terminated: ok {rc=0} 03:43:36.618774 bus /gobi_4: Setting Powered False 03:43:37.719465 bus /gobi_4: Setting Powered False 03:43:38.837738 bus /gobi_1: Setting Powered False 03:43:39.939704 bus /gobi_1: Setting Powered False 03:43:41.062818 bus /gobi_0: Setting Powered False 03:43:42.165386 bus /gobi_0: Setting Powered False 03:43:43.280815 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:sysmo+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 03:43:44.384412 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:43:44.396450 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 03:43:44.469867 tst ping.py: using LAC 18831 03:43:44.603014 tst ping.py: using RAC 216 03:43:44.731416 tst ping.py: using CellId 18831 03:43:44.858748 tst ping.py: using BVCI 18832 03:43:44.979399 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:43:44.990832 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:43:45.002042 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:43:45.013642 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:43:45.024825 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:43:45.036101 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:43:45.047656 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:43:45.059007 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:43:45.178920 tst ping.py:19: start network... 03:43:45.383942 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:43:45.886292 run create_hlr_db(pid=20006): Launched 03:43:46.061344 bus /gobi_6: Setting Powered False 03:43:47.120895 run create_hlr_db(pid=20006): Terminated: ok {rc=0} 03:43:47.567026 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20008): Launched 03:43:47.874153 run osmo-hlr_10.42.42.2(pid=20009): Launched 03:43:47.988762 run osmo-stp_10.42.42.5: Starting osmo-stp 03:43:48.540343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20011): Launched 03:43:48.846803 run osmo-stp_10.42.42.5(pid=20012): Launched 03:43:48.961857 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:43:49.487643 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20014): Launched 03:43:49.603442 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:43:49.862811 run patchelf(pid=20015): Launched 03:43:50.030545 run osmo-stp_10.42.42.5(pid=20012): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20012)] 03:43:50.158371 run osmo-stp_10.42.42.5(pid=20012): stdout: | (launched: 2022-12-09_03:43:48.788535) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:43:50.287988 run osmo-stp_10.42.42.5(pid=20012): stderr: | 20221209034348963 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034348963 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034348963 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034348964 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034348964 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034348964 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034348964 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:43:50.417537 run osmo-stp_10.42.42.5(pid=20012): stdout: | (launched: 2022-12-09_03:43:48.788535) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:43:50.541704 run osmo-stp_10.42.42.5(pid=20012): stderr: | 20221209034348963 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034348963 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034348963 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034348964 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034348964 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034348964 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034348964 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:43:50.688478 run patchelf(pid=20015): Terminating (SIGINT) 03:43:50.859191 run patchelf(pid=20015): Terminated: ok {rc=0} 03:43:50.981449 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=20012): Process ended prematurely: osmo-stp_10.42.42.5(pid=20012) [trial-2354↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20012)] [trial-2354↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22] 03:43:50.990250 tst ping.py:22: Test FAILED (6.6 sec) 03:43:51.017206 run osmo-hlr_10.42.42.2(pid=20009): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20009)] 03:43:51.065527 run osmo-hlr_10.42.42.2(pid=20009): stdout: | (launched: 2022-12-09_03:43:47.815933) 03:43:51.115177 run osmo-hlr_10.42.42.2(pid=20009): stderr: | 20221209034347998 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209034347998 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209034347998 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209034347998 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209034347998 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209034347998 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209034348010 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:sysmo+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209034348021 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209034348021 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209034348021 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:43:51.165785 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20008): Terminating (SIGTERM) 03:43:51.205890 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20011): Terminating (SIGTERM) 03:43:51.245929 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20014): Terminating (SIGTERM) 03:43:51.286264 --- ParallelTerminationStrategy: PID 20008 died... 03:43:51.305526 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20008): Terminated: ok {rc=0} 03:43:51.349978 --- ParallelTerminationStrategy: PID 20011 died... 03:43:51.368814 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20011): Terminated: ok {rc=0} 03:43:51.412841 --- ParallelTerminationStrategy: PID 20014 died... 03:43:51.431947 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20014): Terminated: ok {rc=0} 03:43:51.518155 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:sysmo+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 03:43:52.607248 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:43:52.618676 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 03:43:52.676023 tst ping_idle_ping.py: using LAC 18832 03:43:52.796682 tst ping_idle_ping.py: using RAC 217 03:43:52.917328 tst ping_idle_ping.py: using CellId 18832 03:43:53.036431 tst ping_idle_ping.py: using BVCI 18833 03:43:53.147717 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:43:53.159054 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:43:53.169719 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:43:53.180240 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:43:53.190890 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:43:53.201418 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:43:53.212107 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:43:53.222726 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:43:53.338129 tst ping_idle_ping.py:24: start network... 03:43:53.540910 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:43:54.017120 run create_hlr_db(pid=20016): Launched 03:43:54.141222 bus /gobi_6: Setting Powered False 03:43:55.202250 run create_hlr_db(pid=20016): Terminated: ok {rc=0} 03:43:55.652564 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20018): Launched 03:43:55.982883 run osmo-hlr_10.42.42.2(pid=20019): Launched 03:43:56.109395 run osmo-stp_10.42.42.5: Starting osmo-stp 03:43:56.679642 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20021): Launched 03:43:57.008314 run osmo-stp_10.42.42.5(pid=20022): Launched 03:43:57.132941 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:43:57.700732 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20024): Launched 03:43:57.825786 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:43:58.104236 run patchelf(pid=20025): Launched 03:43:58.285718 run osmo-stp_10.42.42.5(pid=20022): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20022)] 03:43:58.423944 run osmo-stp_10.42.42.5(pid=20022): stdout: | (launched: 2022-12-09_03:43:56.946819) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:43:58.564112 run osmo-stp_10.42.42.5(pid=20022): stderr: | 20221209034357141 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034357141 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034357141 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034357142 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034357142 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034357142 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034357142 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:43:58.704289 run osmo-stp_10.42.42.5(pid=20022): stdout: | (launched: 2022-12-09_03:43:56.946819) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:43:58.838511 run osmo-stp_10.42.42.5(pid=20022): stderr: | 20221209034357141 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034357141 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034357141 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034357142 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034357142 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034357142 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034357142 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:43:58.998073 run patchelf(pid=20025): Terminating (SIGINT) 03:43:59.181483 run patchelf(pid=20025): Terminated: ok {rc=0} 03:43:59.313748 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=20022): Process ended prematurely: osmo-stp_10.42.42.5(pid=20022) [trial-2354↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20022)] [trial-2354↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 03:43:59.323471 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 03:43:59.352724 run osmo-hlr_10.42.42.2(pid=20019): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20019)] 03:43:59.404107 run osmo-hlr_10.42.42.2(pid=20019): stdout: | (launched: 2022-12-09_03:43:55.921159) 03:43:59.457275 run osmo-hlr_10.42.42.2(pid=20019): stderr: | 20221209034356120 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209034356120 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209034356120 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209034356120 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209034356120 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209034356120 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209034356132 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:sysmo+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209034356141 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209034356141 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209034356141 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:43:59.510671 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20018): Terminating (SIGTERM) 03:43:59.553876 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20021): Terminating (SIGTERM) 03:43:59.597329 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20024): Terminating (SIGTERM) 03:43:59.640612 --- ParallelTerminationStrategy: PID 20018 died... 03:43:59.660943 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20018): Terminated: ok {rc=0} 03:43:59.708536 --- ParallelTerminationStrategy: PID 20021 died... 03:43:59.728331 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20021): Terminated: ok {rc=0} 03:43:59.776242 --- ParallelTerminationStrategy: PID 20024 died... 03:43:59.796210 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20024): Terminated: ok {rc=0} 03:43:59.887468 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2354 gprs:sysmo+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 gprs:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 03:44:01.248337 tst gprs:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:44:01.255733 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 03:44:01.279982 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 03:44:01.321822 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 03:44:01.414671 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 03:44:01.444047 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 03:44:01.496489 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 03:44:02.106020 tst gprs:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2354 gprs:sysmo+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 03:44:02.200101 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:44:02.212295 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 03:44:02.274220 tst cs_paging_gprs_active.py: using LAC 18833 03:44:02.399867 tst cs_paging_gprs_active.py: using RAC 218 03:44:02.524109 tst cs_paging_gprs_active.py: using CellId 18833 03:44:02.647286 tst cs_paging_gprs_active.py: using BVCI 18834 03:44:02.761787 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:44:02.772512 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:44:02.783371 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:44:02.794865 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:44:02.806221 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:44:02.817550 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:44:02.828790 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:44:02.839819 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:44:02.851124 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 03:44:02.972810 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 03:44:03.092729 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 03:44:03.301255 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:44:03.612413 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20029): Launched 03:44:03.883947 run iperf3-srv_10.42.42.10(pid=20030): Launched 03:44:03.999728 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 03:44:04.205863 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:44:04.517234 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20031): Launched 03:44:04.787173 run iperf3-srv_10.42.42.10(pid=20032): Launched 03:44:04.902764 tst cs_paging_gprs_active.py:38: start network... 03:44:05.109155 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:44:05.590453 run create_hlr_db(pid=20033): Launched 03:44:05.716349 bus /gobi_6: Setting Powered False 03:44:06.782727 run create_hlr_db(pid=20033): Terminated: ok {rc=0} 03:44:07.245180 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20035): Launched 03:44:07.578565 run osmo-hlr_10.42.42.2(pid=20036): Launched 03:44:07.704786 run osmo-stp_10.42.42.5: Starting osmo-stp 03:44:08.280932 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20038): Launched 03:44:08.613968 run osmo-stp_10.42.42.5(pid=20039): Launched 03:44:08.739180 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:44:09.311746 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20041): Launched 03:44:09.438036 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:44:09.720466 run patchelf(pid=20042): Launched 03:44:09.907055 run osmo-stp_10.42.42.5(pid=20039): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20039)] 03:44:10.047386 run osmo-stp_10.42.42.5(pid=20039): stdout: | (launched: 2022-12-09_03:44:08.551270) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:44:10.189167 run osmo-stp_10.42.42.5(pid=20039): stderr: | 20221209034408750 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034408751 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034408751 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034408751 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034408752 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034408752 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034408752 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:44:10.330821 run osmo-stp_10.42.42.5(pid=20039): stdout: | (launched: 2022-12-09_03:44:08.551270) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:44:10.466739 run osmo-stp_10.42.42.5(pid=20039): stderr: | 20221209034408750 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034408751 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034408751 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034408751 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034408752 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034408752 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034408752 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:44:10.628583 run patchelf(pid=20042): Terminating (SIGINT) 03:44:10.815021 run patchelf(pid=20042): Terminated: ok {rc=0} 03:44:10.949443 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=20039): Process ended prematurely: osmo-stp_10.42.42.5(pid=20039) [trial-2354↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20039)] [trial-2354↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 03:44:10.959604 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 03:44:10.989193 run osmo-hlr_10.42.42.2(pid=20036): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20036)] 03:44:11.040428 run osmo-hlr_10.42.42.2(pid=20036): stdout: | (launched: 2022-12-09_03:44:07.515649) 03:44:11.093628 run osmo-hlr_10.42.42.2(pid=20036): stderr: | 20221209034407718 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209034407718 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209034407718 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209034407718 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209034407718 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209034407718 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209034407734 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:sysmo+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209034407742 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209034407742 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209034407742 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:44:11.147145 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20029): Terminating (SIGTERM) 03:44:11.190093 run iperf3-srv_10.42.42.10(pid=20030): Terminating (SIGTERM) 03:44:11.232850 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20031): Terminating (SIGTERM) 03:44:11.275814 run iperf3-srv_10.42.42.10(pid=20032): Terminating (SIGTERM) 03:44:11.318686 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20035): Terminating (SIGTERM) 03:44:11.361650 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20038): Terminating (SIGTERM) 03:44:11.404493 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20041): Terminating (SIGTERM) 03:44:11.447508 --- ParallelTerminationStrategy: PID 20029 died... 03:44:11.467407 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20029): Terminated: ok {rc=0} 03:44:11.514641 --- ParallelTerminationStrategy: PID 20030 died... 03:44:11.534368 run iperf3-srv_10.42.42.10(pid=20030): Terminated {rc=256} 03:44:11.581726 --- ParallelTerminationStrategy: PID 20031 died... 03:44:11.601529 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20031): Terminated: ok {rc=0} 03:44:11.648759 --- ParallelTerminationStrategy: PID 20032 died... 03:44:11.668567 run iperf3-srv_10.42.42.10(pid=20032): Terminated {rc=256} 03:44:11.715571 --- ParallelTerminationStrategy: PID 20035 died... 03:44:11.735300 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20035): Terminated: ok {rc=0} 03:44:11.782466 --- ParallelTerminationStrategy: PID 20038 died... 03:44:11.802236 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20038): Terminated: ok {rc=0} 03:44:11.849571 --- ParallelTerminationStrategy: PID 20041 died... 03:44:11.869535 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20041): Terminated: ok {rc=0} 03:44:11.959132 bus /gobi_0: Setting Powered False 03:44:13.059959 bus /gobi_0: Setting Powered False 03:44:14.178133 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:sysmo+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 03:44:15.330700 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:44:15.342735 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 03:44:15.405231 tst iperf3.py: using LAC 18834 03:44:15.526485 tst iperf3.py: using RAC 219 03:44:15.653113 tst iperf3.py: using CellId 18834 03:44:15.774625 tst iperf3.py: using BVCI 18835 03:44:15.906398 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:44:15.917905 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:44:15.929749 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:44:15.941849 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:44:15.953312 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:44:15.964651 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:44:15.976149 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:44:15.987600 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:44:15.999070 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 03:44:16.118121 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 03:44:16.391680 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:44:16.745593 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20043): Launched 03:44:17.052617 run iperf3-srv_10.42.42.10(pid=20044): Launched 03:44:17.194304 tst iperf3.py:8: start network... 03:44:17.420110 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:44:17.939133 run create_hlr_db(pid=20045): Launched 03:44:18.066747 bus /gobi_6: Setting Powered False 03:44:19.131931 run create_hlr_db(pid=20045): Terminated: ok {rc=0} 03:44:19.576460 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20047): Launched 03:44:19.889743 run osmo-hlr_10.42.42.2(pid=20048): Launched 03:44:20.008037 run osmo-stp_10.42.42.5: Starting osmo-stp 03:44:20.550050 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20050): Launched 03:44:20.862378 run osmo-stp_10.42.42.5(pid=20051): Launched 03:44:20.980393 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:44:21.516407 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20053): Launched 03:44:21.635529 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:44:21.899707 run patchelf(pid=20054): Launched 03:44:22.071942 run osmo-stp_10.42.42.5(pid=20051): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20051)] 03:44:22.202651 run osmo-stp_10.42.42.5(pid=20051): stdout: | (launched: 2022-12-09_03:44:20.803139) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:44:22.334770 run osmo-stp_10.42.42.5(pid=20051): stderr: | 20221209034420978 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034420978 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034420978 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034420979 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034420979 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034420979 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034420979 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:44:22.467083 run osmo-stp_10.42.42.5(pid=20051): stdout: | (launched: 2022-12-09_03:44:20.803139) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:44:22.593643 run osmo-stp_10.42.42.5(pid=20051): stderr: | 20221209034420978 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034420978 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034420978 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034420979 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034420979 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034420979 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034420979 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:44:22.743636 run patchelf(pid=20054): Terminating (SIGINT) 03:44:22.918468 run patchelf(pid=20054): Terminated: ok {rc=0} 03:44:23.044424 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20051): Process ended prematurely: osmo-stp_10.42.42.5(pid=20051) [trial-2354↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20051)] [trial-2354↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8] 03:44:23.053974 tst iperf3.py:8: Test FAILED (7.8 sec) 03:44:23.081288 run osmo-hlr_10.42.42.2(pid=20048): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20048)] 03:44:23.129583 run osmo-hlr_10.42.42.2(pid=20048): stdout: | (launched: 2022-12-09_03:44:19.830287) 03:44:23.179498 run osmo-hlr_10.42.42.2(pid=20048): stderr: | 20221209034420012 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209034420012 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209034420012 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209034420012 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209034420012 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209034420013 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209034420025 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:sysmo+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209034420034 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209034420034 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209034420034 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:44:23.229627 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20043): Terminating (SIGTERM) 03:44:23.269917 run iperf3-srv_10.42.42.10(pid=20044): Terminating (SIGTERM) 03:44:23.310182 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20047): Terminating (SIGTERM) 03:44:23.350436 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20050): Terminating (SIGTERM) 03:44:23.390694 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20053): Terminating (SIGTERM) 03:44:23.431262 --- ParallelTerminationStrategy: PID 20043 died... 03:44:23.450637 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20043): Terminated: ok {rc=0} 03:44:23.495352 --- ParallelTerminationStrategy: PID 20044 died... 03:44:23.514406 run iperf3-srv_10.42.42.10(pid=20044): Terminated {rc=256} 03:44:23.559103 --- ParallelTerminationStrategy: PID 20047 died... 03:44:23.578112 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20047): Terminated: ok {rc=0} 03:44:23.623081 --- ParallelTerminationStrategy: PID 20050 died... 03:44:23.642177 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20050): Terminated: ok {rc=0} 03:44:23.686777 --- ParallelTerminationStrategy: PID 20053 died... 03:44:23.705947 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20053): Terminated: ok {rc=0} 03:44:23.793123 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:sysmo+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 03:44:24.941382 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:44:24.953158 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 03:44:25.011688 tst iperf3m4.py: using LAC 18835 03:44:25.133471 tst iperf3m4.py: using RAC 220 03:44:25.265590 tst iperf3m4.py: using CellId 18835 03:44:25.387634 tst iperf3m4.py: using BVCI 18836 03:44:25.501353 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:44:25.512343 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:44:25.523188 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:44:25.534218 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:44:25.545197 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:44:25.555861 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:44:25.566745 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:44:25.577459 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:44:25.588378 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 03:44:25.709187 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 03:44:25.828207 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 03:44:25.945660 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 03:44:26.062865 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 03:44:26.269878 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:44:26.582174 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20056): Launched 03:44:26.852389 run iperf3-srv_10.42.42.10(pid=20057): Launched 03:44:26.968168 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 03:44:27.174486 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:44:27.485717 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20058): Launched 03:44:27.757467 run iperf3-srv_10.42.42.10(pid=20059): Launched 03:44:27.872924 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 03:44:28.079868 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:44:28.391330 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20060): Launched 03:44:28.662604 run iperf3-srv_10.42.42.10(pid=20061): Launched 03:44:28.778111 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 03:44:28.983866 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:44:29.295278 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20062): Launched 03:44:29.564907 run iperf3-srv_10.42.42.10(pid=20063): Launched 03:44:29.680237 tst iperf3m4.py:8: start network... 03:44:29.885559 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:44:30.366434 run create_hlr_db(pid=20064): Launched 03:44:30.492782 bus /gobi_6: Setting Powered False 03:44:31.562390 run create_hlr_db(pid=20064): Terminated: ok {rc=0} 03:44:32.020145 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20066): Launched 03:44:32.345959 run osmo-hlr_10.42.42.2(pid=20067): Launched 03:44:32.463709 run osmo-stp_10.42.42.5: Starting osmo-stp 03:44:33.001890 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20069): Launched 03:44:33.312375 run osmo-stp_10.42.42.5(pid=20070): Launched 03:44:33.430003 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:44:33.963878 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20072): Launched 03:44:34.082479 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:44:34.346662 run patchelf(pid=20073): Launched 03:44:34.517943 run osmo-stp_10.42.42.5(pid=20070): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20070)] 03:44:34.647991 run osmo-stp_10.42.42.5(pid=20070): stdout: | (launched: 2022-12-09_03:44:33.253375) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:44:34.779792 run osmo-stp_10.42.42.5(pid=20070): stderr: | 20221209034433426 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034433426 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034433426 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034433427 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034433427 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034433427 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034433427 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:44:34.911749 run osmo-stp_10.42.42.5(pid=20070): stdout: | (launched: 2022-12-09_03:44:33.253375) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:44:35.038136 run osmo-stp_10.42.42.5(pid=20070): stderr: | 20221209034433426 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034433426 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034433426 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034433427 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034433427 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034433427 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034433427 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:44:35.188043 run patchelf(pid=20073): Terminating (SIGINT) 03:44:35.362492 run patchelf(pid=20073): Terminated: ok {rc=0} 03:44:35.488245 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20070): Process ended prematurely: osmo-stp_10.42.42.5(pid=20070) [trial-2354↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20070)] [trial-2354↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8] 03:44:35.497897 tst iperf3m4.py:8: Test FAILED (10.6 sec) 03:44:35.525635 run osmo-hlr_10.42.42.2(pid=20067): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20067)] 03:44:35.573908 run osmo-hlr_10.42.42.2(pid=20067): stdout: | (launched: 2022-12-09_03:44:32.286718) 03:44:35.623569 run osmo-hlr_10.42.42.2(pid=20067): stderr: | 20221209034432468 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209034432468 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209034432468 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209034432468 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209034432468 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209034432468 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209034432480 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:sysmo+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209034432489 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209034432489 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209034432489 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:44:35.673804 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20056): Terminating (SIGTERM) 03:44:35.713686 run iperf3-srv_10.42.42.10(pid=20057): Terminating (SIGTERM) 03:44:35.753473 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20058): Terminating (SIGTERM) 03:44:35.793441 run iperf3-srv_10.42.42.10(pid=20059): Terminating (SIGTERM) 03:44:35.833352 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20060): Terminating (SIGTERM) 03:44:35.873666 run iperf3-srv_10.42.42.10(pid=20061): Terminating (SIGTERM) 03:44:35.914321 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20062): Terminating (SIGTERM) 03:44:35.954701 run iperf3-srv_10.42.42.10(pid=20063): Terminating (SIGTERM) 03:44:35.994487 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20066): Terminating (SIGTERM) 03:44:36.035115 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20069): Terminating (SIGTERM) 03:44:36.075110 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20072): Terminating (SIGTERM) 03:44:36.115543 --- ParallelTerminationStrategy: PID 20056 died... 03:44:36.134891 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20056): Terminated: ok {rc=0} 03:44:36.179375 --- ParallelTerminationStrategy: PID 20057 died... 03:44:36.198278 run iperf3-srv_10.42.42.10(pid=20057): Terminated {rc=256} 03:44:36.242572 --- ParallelTerminationStrategy: PID 20058 died... 03:44:36.261518 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20058): Terminated: ok {rc=0} 03:44:36.305892 --- ParallelTerminationStrategy: PID 20059 died... 03:44:36.324703 run iperf3-srv_10.42.42.10(pid=20059): Terminated {rc=256} 03:44:36.369613 --- ParallelTerminationStrategy: PID 20060 died... 03:44:36.388499 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20060): Terminated: ok {rc=0} 03:44:36.432819 --- ParallelTerminationStrategy: PID 20061 died... 03:44:36.452053 run iperf3-srv_10.42.42.10(pid=20061): Terminated {rc=256} 03:44:36.496380 --- ParallelTerminationStrategy: PID 20062 died... 03:44:36.515229 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20062): Terminated: ok {rc=0} 03:44:36.559375 --- ParallelTerminationStrategy: PID 20063 died... 03:44:36.578206 run iperf3-srv_10.42.42.10(pid=20063): Terminated {rc=256} 03:44:36.622854 --- ParallelTerminationStrategy: PID 20066 died... 03:44:36.641851 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20066): Terminated: ok {rc=0} 03:44:36.686060 --- ParallelTerminationStrategy: PID 20069 died... 03:44:36.704841 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20069): Terminated: ok {rc=0} 03:44:36.749080 --- ParallelTerminationStrategy: PID 20072 died... 03:44:36.768083 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20072): Terminated: ok {rc=0} 03:44:36.852773 bus /gobi_4: Setting Powered False 03:44:37.950339 bus /gobi_4: Setting Powered False 03:44:39.066114 bus /gobi_1: Setting Powered False 03:44:40.167018 bus /gobi_1: Setting Powered False 03:44:41.280578 bus /gobi_0: Setting Powered False 03:44:42.379655 bus /gobi_0: Setting Powered False 03:44:43.497864 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:sysmo+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 03:44:44.601447 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:44:44.613848 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 03:44:44.676619 tst ping.py: using LAC 18836 03:44:44.804170 tst ping.py: using RAC 221 03:44:44.930371 tst ping.py: using CellId 18836 03:44:45.056455 tst ping.py: using BVCI 18837 03:44:45.177132 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:44:45.188709 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:44:45.199990 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:44:45.211493 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:44:45.222870 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:44:45.234065 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:44:45.246019 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:44:45.257486 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 03:44:45.376162 tst ping.py:19: start network... 03:44:45.596419 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:44:46.111595 run create_hlr_db(pid=20074): Launched 03:44:46.272240 bus /gobi_6: Setting Powered False 03:44:47.333412 run create_hlr_db(pid=20074): Terminated: ok {rc=0} 03:44:47.760925 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20076): Launched 03:44:48.067573 run osmo-hlr_10.42.42.2(pid=20077): Launched 03:44:48.183700 run osmo-stp_10.42.42.5: Starting osmo-stp 03:44:48.728596 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20079): Launched 03:44:49.034286 run osmo-stp_10.42.42.5(pid=20080): Launched 03:44:49.150579 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:44:49.676504 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20082): Launched 03:44:49.792446 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:44:50.051340 run patchelf(pid=20083): Launched 03:44:50.220644 run osmo-stp_10.42.42.5(pid=20080): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20080)] 03:44:50.349568 run osmo-stp_10.42.42.5(pid=20080): stdout: | (launched: 2022-12-09_03:44:48.976141) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:44:50.480053 run osmo-stp_10.42.42.5(pid=20080): stderr: | 20221209034449148 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034449149 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034449149 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034449150 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034449150 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034449150 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034449150 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:44:50.610736 run osmo-stp_10.42.42.5(pid=20080): stdout: | (launched: 2022-12-09_03:44:48.976141) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:44:50.735617 run osmo-stp_10.42.42.5(pid=20080): stderr: | 20221209034449148 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034449149 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034449149 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034449150 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034449150 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034449150 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034449150 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:44:50.883082 run patchelf(pid=20083): Terminating (SIGINT) 03:44:51.054015 run patchelf(pid=20083): Terminated: ok {rc=0} 03:44:51.177308 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=20080): Process ended prematurely: osmo-stp_10.42.42.5(pid=20080) [trial-2354↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20080)] [trial-2354↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22] 03:44:51.186346 tst ping.py:22: Test FAILED (6.6 sec) 03:44:51.213387 run osmo-hlr_10.42.42.2(pid=20077): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20077)] 03:44:51.262364 run osmo-hlr_10.42.42.2(pid=20077): stdout: | (launched: 2022-12-09_03:44:48.009258) 03:44:51.312872 run osmo-hlr_10.42.42.2(pid=20077): stderr: | 20221209034448187 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209034448188 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209034448188 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209034448188 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209034448188 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209034448188 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209034448200 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:sysmo+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209034448211 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209034448211 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209034448211 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:44:51.363677 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20076): Terminating (SIGTERM) 03:44:51.404366 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20079): Terminating (SIGTERM) 03:44:51.444735 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20082): Terminating (SIGTERM) 03:44:51.485261 --- ParallelTerminationStrategy: PID 20076 died... 03:44:51.504666 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20076): Terminated: ok {rc=0} 03:44:51.549466 --- ParallelTerminationStrategy: PID 20079 died... 03:44:51.568240 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20079): Terminated: ok {rc=0} 03:44:51.612914 --- ParallelTerminationStrategy: PID 20082 died... 03:44:51.632355 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20082): Terminated: ok {rc=0} 03:44:51.717585 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:sysmo+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 03:44:52.806274 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:44:52.819171 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 03:44:52.880253 tst ping_idle_ping.py: using LAC 18837 03:44:53.010378 tst ping_idle_ping.py: using RAC 222 03:44:53.131823 tst ping_idle_ping.py: using CellId 18837 03:44:53.256163 tst ping_idle_ping.py: using BVCI 18838 03:44:53.368269 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:44:53.379303 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:44:53.390124 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:44:53.400808 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:44:53.411492 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:44:53.422216 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:44:53.433227 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:44:53.443896 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 03:44:53.562345 tst ping_idle_ping.py:24: start network... 03:44:53.765438 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:44:54.243942 run create_hlr_db(pid=20085): Launched 03:44:54.367402 bus /gobi_6: Setting Powered False 03:44:55.427909 run create_hlr_db(pid=20085): Terminated: ok {rc=0} 03:44:55.876065 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20087): Launched 03:44:56.206166 run osmo-hlr_10.42.42.2(pid=20088): Launched 03:44:56.331670 run osmo-stp_10.42.42.5: Starting osmo-stp 03:44:56.899993 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20090): Launched 03:44:57.229414 run osmo-stp_10.42.42.5(pid=20091): Launched 03:44:57.355127 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:44:57.924117 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20093): Launched 03:44:58.049419 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:44:58.328404 run patchelf(pid=20094): Launched 03:44:58.510201 run osmo-stp_10.42.42.5(pid=20091): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20091)] 03:44:58.649041 run osmo-stp_10.42.42.5(pid=20091): stdout: | (launched: 2022-12-09_03:44:57.167518) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:44:58.789135 run osmo-stp_10.42.42.5(pid=20091): stderr: | 20221209034457363 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034457363 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034457363 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034457364 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034457366 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034457366 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034457366 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:44:58.929669 run osmo-stp_10.42.42.5(pid=20091): stdout: | (launched: 2022-12-09_03:44:57.167518) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:44:59.064361 run osmo-stp_10.42.42.5(pid=20091): stderr: | 20221209034457363 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034457363 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034457363 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034457364 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034457366 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034457366 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034457366 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:44:59.223380 run patchelf(pid=20094): Terminating (SIGINT) 03:44:59.406953 run patchelf(pid=20094): Terminated: ok {rc=0} 03:44:59.539378 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=20091): Process ended prematurely: osmo-stp_10.42.42.5(pid=20091) [trial-2354↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20091)] [trial-2354↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 03:44:59.549114 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 03:44:59.578767 run osmo-hlr_10.42.42.2(pid=20088): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20088)] 03:44:59.630690 run osmo-hlr_10.42.42.2(pid=20088): stdout: | (launched: 2022-12-09_03:44:56.144146) 03:44:59.684528 run osmo-hlr_10.42.42.2(pid=20088): stderr: | 20221209034456343 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209034456343 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209034456343 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209034456343 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209034456343 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209034456343 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209034456356 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:sysmo+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209034456366 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209034456366 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209034456366 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:44:59.739155 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20087): Terminating (SIGTERM) 03:44:59.782609 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20090): Terminating (SIGTERM) 03:44:59.826224 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20093): Terminating (SIGTERM) 03:44:59.869842 --- ParallelTerminationStrategy: PID 20087 died... 03:44:59.890396 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20087): Terminated: ok {rc=0} 03:44:59.938577 --- ParallelTerminationStrategy: PID 20090 died... 03:44:59.958725 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20090): Terminated: ok {rc=0} 03:45:00.006603 --- ParallelTerminationStrategy: PID 20093 died... 03:45:00.026814 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20093): Terminated: ok {rc=0} 03:45:00.117067 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2354 gprs:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 03:45:01.460412 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:45:01.470688 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 03:45:01.508355 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 03:45:01.557699 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 03:45:01.628288 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 03:45:01.650986 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 03:45:01.689518 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 03:45:02.238028 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2354 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 03:45:02.243955 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:45:02.255790 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 03:45:02.314424 tst switch_tch_pdch.py: using LAC 18838 03:45:02.436119 tst switch_tch_pdch.py: using RAC 223 03:45:02.555781 tst switch_tch_pdch.py: using CellId 18838 03:45:02.684137 tst switch_tch_pdch.py: using BVCI 18839 03:45:02.804360 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:45:02.816276 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:45:02.828050 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:45:02.839971 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:45:02.851844 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:45:02.863530 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:45:02.875315 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:45:02.886974 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:45:03.008856 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:45:03.130262 tst switch_tch_pdch.py:51: start network... 03:45:03.349611 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:45:03.855968 run create_hlr_db(pid=20101): Launched 03:45:03.979868 bus /gobi_6: Setting Powered False 03:45:05.044541 run create_hlr_db(pid=20101): Terminated: ok {rc=0} 03:45:05.481453 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20103): Launched 03:45:05.786847 run osmo-hlr_10.42.42.2(pid=20104): Launched 03:45:05.902292 run osmo-stp_10.42.42.5: Starting osmo-stp 03:45:06.444847 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20106): Launched 03:45:06.750295 run osmo-stp_10.42.42.5(pid=20107): Launched 03:45:06.866052 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:45:07.394084 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20109): Launched 03:45:07.509733 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:45:07.767725 run patchelf(pid=20110): Launched 03:45:07.935755 run osmo-stp_10.42.42.5(pid=20107): ERR: Terminated: ERROR {rc=1} [trial-2354↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20107)] 03:45:08.064093 run osmo-stp_10.42.42.5(pid=20107): stdout: | (launched: 2022-12-09_03:45:06.692357) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:45:08.193965 run osmo-stp_10.42.42.5(pid=20107): stderr: | 20221209034506866 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034506866 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034506867 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034506867 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034506867 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034506867 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034506868 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:45:08.324451 run osmo-stp_10.42.42.5(pid=20107): stdout: | (launched: 2022-12-09_03:45:06.692357) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:45:08.448805 run osmo-stp_10.42.42.5(pid=20107): stderr: | 20221209034506866 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034506866 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034506867 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034506867 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034506867 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034506867 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034506868 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:45:08.595644 run patchelf(pid=20110): Terminating (SIGINT) 03:45:08.767078 run patchelf(pid=20110): Terminated: ok {rc=0} 03:45:08.890339 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=20107): Process ended prematurely: osmo-stp_10.42.42.5(pid=20107) [trial-2354↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20107)] [trial-2354↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 03:45:08.899150 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 03:45:08.926132 run osmo-hlr_10.42.42.2(pid=20104): ERR: Terminated: ERROR {rc=237} [trial-2354↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20104)] 03:45:08.974496 run osmo-hlr_10.42.42.2(pid=20104): stdout: | (launched: 2022-12-09_03:45:05.729173) 03:45:09.024508 run osmo-hlr_10.42.42.2(pid=20104): stderr: | 20221209034505908 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209034505908 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209034505908 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209034505908 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209034505908 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209034505908 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209034505920 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209034505929 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209034505929 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209034505929 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:45:09.074871 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20103): Terminating (SIGTERM) 03:45:09.115331 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20106): Terminating (SIGTERM) 03:45:09.155582 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20109): Terminating (SIGTERM) 03:45:09.196033 --- ParallelTerminationStrategy: PID 20103 died... 03:45:09.215483 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20103): Terminated: ok {rc=0} 03:45:09.259909 --- ParallelTerminationStrategy: PID 20106 died... 03:45:09.278702 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20106): Terminated: ok {rc=0} 03:45:09.322916 --- ParallelTerminationStrategy: PID 20109 died... 03:45:09.341701 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20109): Terminated: ok {rc=0} 03:45:09.428384 bus /gobi_0: Setting Powered False 03:45:10.529638 bus /gobi_0: Setting Powered False 03:45:11.646492 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2354 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 dynts:sysmo+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 03:45:12.891088 tst dynts:sysmo+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:45:12.896637 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 03:45:12.916887 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 03:45:12.950762 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 03:45:13.003542 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 03:45:13.024317 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 03:45:13.058507 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 03:45:13.611018 tst dynts:sysmo+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2354 dynts:sysmo+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 03:45:13.615871 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 03:45:13.626600 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 03:45:13.681386 tst switch_tch_pdch.py: using LAC 18839 03:45:13.797353 tst switch_tch_pdch.py: using RAC 224 03:45:13.913425 tst switch_tch_pdch.py: using CellId 18839 03:45:14.031339 tst switch_tch_pdch.py: using BVCI 18840 03:45:14.150014 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 03:45:14.161874 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 03:45:14.172881 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 03:45:14.184175 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 03:45:14.195718 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 03:45:14.207198 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 03:45:14.218952 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 03:45:14.230540 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 03:45:14.345220 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 03:45:14.465505 tst switch_tch_pdch.py:51: start network... 03:45:14.680780 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:45:15.149637 run create_hlr_db(pid=20114): Launched 03:45:15.270659 bus /gobi_6: Setting Powered False 03:45:16.350062 run create_hlr_db(pid=20114): Terminated: ok {rc=0} 03:45:16.852804 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20116): Launched 03:45:17.194952 run osmo-hlr_10.42.42.2(pid=20117): Launched 03:45:17.319284 run osmo-stp_10.42.42.5: Starting osmo-stp 03:45:17.848004 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20119): Launched 03:45:18.168355 run osmo-stp_10.42.42.5(pid=20120): Launched 03:45:18.290101 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:45:18.815765 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20122): Launched 03:45:18.938105 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:45:19.209628 run patchelf(pid=20123): Launched 03:45:19.386999 run osmo-stp_10.42.42.5(pid=20120): ERR: Terminated: ERROR {rc=1} [trial-2354↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20120)] 03:45:19.522771 run osmo-stp_10.42.42.5(pid=20120): stdout: | (launched: 2022-12-09_03:45:18.108379) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:45:19.660796 run osmo-stp_10.42.42.5(pid=20120): stderr: | 20221209034518299 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034518299 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034518299 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034518300 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034518300 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034518300 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034518300 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:45:19.798094 run osmo-stp_10.42.42.5(pid=20120): stdout: | (launched: 2022-12-09_03:45:18.108379) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:45:19.929580 run osmo-stp_10.42.42.5(pid=20120): stderr: | 20221209034518299 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034518299 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034518299 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034518300 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034518300 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034518300 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034518300 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:45:20.085695 run patchelf(pid=20123): Terminating (SIGINT) 03:45:20.265863 run patchelf(pid=20123): Terminated: ok {rc=0} 03:45:20.395844 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=20120): Process ended prematurely: osmo-stp_10.42.42.5(pid=20120) [trial-2354↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20120)] [trial-2354↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 03:45:20.406090 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 03:45:20.435185 run osmo-hlr_10.42.42.2(pid=20117): ERR: Terminated: ERROR {rc=237} [trial-2354↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20117)] 03:45:20.486277 run osmo-hlr_10.42.42.2(pid=20117): stdout: | (launched: 2022-12-09_03:45:17.132444) 03:45:20.538944 run osmo-hlr_10.42.42.2(pid=20117): stderr: | 20221209034517350 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209034517350 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209034517350 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209034517350 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209034517350 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209034517350 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209034517360 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/dynts:sysmo+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209034517368 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209034517368 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209034517368 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:45:20.592392 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20116): Terminating (SIGTERM) 03:45:20.635396 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20119): Terminating (SIGTERM) 03:45:20.678216 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20122): Terminating (SIGTERM) 03:45:20.721095 --- ParallelTerminationStrategy: PID 20116 died... 03:45:20.741353 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20116): Terminated: ok {rc=0} 03:45:20.788620 --- ParallelTerminationStrategy: PID 20119 died... 03:45:20.808493 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20119): Terminated: ok {rc=0} 03:45:20.855481 --- ParallelTerminationStrategy: PID 20122 died... 03:45:20.875281 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20122): Terminated: ok {rc=0} 03:45:20.963993 bus /gobi_0: Setting Powered False 03:45:22.063895 bus /gobi_0: Setting Powered False 03:45:23.186889 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2354 dynts:sysmo+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 nitb_sms:oc2g --------------------------------------------------------------------- 03:45:24.421602 tst nitb_sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:45:24.425223 tst nitb_sms:oc2g: Verifying 1 x bts (candidates: 11) 03:45:24.445477 tst nitb_sms:oc2g: Verifying 1 x ip_address (candidates: 9) 03:45:24.452766 tst nitb_sms:oc2g: Verifying 2 x modem (candidates: 12) 03:45:24.503789 tst nitb_sms:oc2g: Reserving 1 x bts (candidates: 11) 03:45:24.523888 tst nitb_sms:oc2g: Reserving 1 x ip_address (candidates: 9) 03:45:24.530448 tst nitb_sms:oc2g: Reserving 2 x modem (candidates: 12) 03:45:25.067178 tst nitb_sms:oc2g: RESERVED RESOURCES for nitb_sms: bts OC-2G ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 nitb_sms:oc2g mo_mt_sms.py ---------------------------------------------- 03:45:25.072009 tst nitb_sms:oc2g: Using 1 x ip_address (candidates: 1) 03:45:25.082491 tst nitb_sms:oc2g: Using 1 x bts (candidates: 1) 03:45:25.115913 tst mo_mt_sms.py: using LAC 18840 03:45:25.232075 tst mo_mt_sms.py: using RAC 225 03:45:25.349103 tst mo_mt_sms.py: using CellId 18840 03:45:25.471381 tst mo_mt_sms.py: using BVCI 18841 03:45:25.580472 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 03:45:25.698463 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 03:45:25.813853 tst mo_mt_sms.py:9: start nitb and bts... 03:45:26.011578 run osmo-nitb_10.42.42.2: Starting osmo-nitb 03:45:26.619460 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20128): Launched 03:45:26.918960 run osmo-nitb_10.42.42.2(pid=20129): Launched 03:45:27.084426 run osmo-nitb_10.42.42.2(pid=20129): ERR: Terminated: ERROR {rc=2} [trial-2354↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20129)] 03:45:27.217949 run osmo-nitb_10.42.42.2(pid=20129): stdout: | (launched: 2022-12-09_03:45:26.862625) 03:45:27.352643 run osmo-nitb_10.42.42.2(pid=20129): stderr: | (launched: 2022-12-09_03:45:26.906721) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:45:27.487425 run osmo-nitb_10.42.42.2(pid=20129): stdout: | (launched: 2022-12-09_03:45:26.862625) 03:45:27.616796 run osmo-nitb_10.42.42.2(pid=20129): stderr: | (launched: 2022-12-09_03:45:26.906721) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f4d467d3268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=20129): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20129) [trial-2354↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20129)] 03:45:28.031321 tst osmo-nitb_10.42.42.2(pid=20129): stdout: | (launched: 2022-12-09_03:45:26.862625) 03:45:28.150723 tst osmo-nitb_10.42.42.2(pid=20129): stderr: | (launched: 2022-12-09_03:45:26.906721) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:45:28.291631 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=20129): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20129) [trial-2354↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20129)] [trial-2354↪nitb_sms:oc2g↪mo_mt_sms.py:11] 03:45:28.300034 tst mo_mt_sms.py:11: Test FAILED (3.2 sec) 03:45:28.306474 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20128): Terminating (SIGTERM) 03:45:28.514801 --- ParallelTerminationStrategy: PID 20128 died... 03:45:28.535571 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20128): Terminated: ok {rc=0} 03:45:28.621017 bus /sierra_3: Setting Powered False 03:45:29.720910 bus /sierra_3: Setting Powered False 03:45:30.837350 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 nitb_sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 sms:oc2g --------------------------------------------------------------------- 03:45:32.059220 tst sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:45:32.066689 tst sms:oc2g: Verifying 1 x bts (candidates: 11) 03:45:32.096291 tst sms:oc2g: Verifying 6 x ip_address (candidates: 9) 03:45:32.133760 tst sms:oc2g: Verifying 2 x modem (candidates: 12) 03:45:32.191110 tst sms:oc2g: Reserving 1 x bts (candidates: 11) 03:45:32.213247 tst sms:oc2g: Reserving 6 x ip_address (candidates: 9) 03:45:32.240736 tst sms:oc2g: Reserving 2 x modem (candidates: 12) 03:45:32.784900 tst sms:oc2g: RESERVED RESOURCES for sms: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 sms:oc2g mo_mt_sms.py ---------------------------------------------- 03:45:32.790384 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 03:45:32.801541 tst sms:oc2g: Using 1 x bts (candidates: 1) 03:45:32.837070 tst mo_mt_sms.py: using LAC 18841 03:45:32.962058 tst mo_mt_sms.py: using RAC 226 03:45:33.087126 tst mo_mt_sms.py: using CellId 18841 03:45:33.213235 tst mo_mt_sms.py: using BVCI 18842 03:45:33.330519 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 03:45:33.341446 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 03:45:33.352186 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 03:45:33.363188 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 03:45:33.374232 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 03:45:33.385241 tst sms:oc2g: Using 1 x modem (candidates: 2) 03:45:33.504752 tst sms:oc2g: Using 1 x modem (candidates: 2) 03:45:33.619304 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:45:34.083712 run create_hlr_db(pid=20133): Launched 03:45:34.205569 bus /sierra_2: Setting Powered False 03:45:35.266118 run create_hlr_db(pid=20133): Terminated: ok {rc=0} 03:45:35.704281 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20135): Launched 03:45:36.026568 run osmo-hlr_10.42.42.2(pid=20136): Launched 03:45:36.148229 run osmo-stp_10.42.42.5: Starting osmo-stp 03:45:36.704608 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20138): Launched 03:45:37.025340 run osmo-stp_10.42.42.5(pid=20139): Launched 03:45:37.147902 run osmo-msc_10.42.42.6: Starting osmo-msc 03:45:37.728802 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20141): Launched 03:45:38.049699 run osmo-msc_10.42.42.6(pid=20142): Launched 03:45:38.227504 run osmo-stp_10.42.42.5(pid=20139): ERR: Terminated: ERROR {rc=1} [trial-2354↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20139)] 03:45:38.362540 run osmo-stp_10.42.42.5(pid=20139): stdout: | (launched: 2022-12-09_03:45:36.965126) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:45:38.498469 run osmo-stp_10.42.42.5(pid=20139): stderr: | 20221209034537161 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034537161 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034537162 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034537162 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034537162 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034537162 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034537162 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:45:38.634489 run osmo-stp_10.42.42.5(pid=20139): stdout: | (launched: 2022-12-09_03:45:36.965126) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:45:38.761821 run osmo-stp_10.42.42.5(pid=20139): stderr: | 20221209034537161 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034537161 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034537162 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034537162 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034537162 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034537162 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034537162 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:45:38.913867 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=20139): Process ended prematurely: osmo-stp_10.42.42.5(pid=20139) [trial-2354↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20139)] [trial-2354↪sms:oc2g↪mo_mt_sms.py:16] 03:45:38.922869 tst mo_mt_sms.py:16: Test FAILED (6.1 sec) 03:45:38.951024 run osmo-hlr_10.42.42.2(pid=20136): ERR: Terminated: ERROR {rc=237} [trial-2354↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20136)] 03:45:39.002240 run osmo-hlr_10.42.42.2(pid=20136): stdout: | (launched: 2022-12-09_03:45:35.966699) 03:45:39.054716 run osmo-hlr_10.42.42.2(pid=20136): stderr: | 20221209034536166 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209034536166 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209034536166 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209034536166 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209034536166 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209034536166 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209034536177 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/sms:oc2g/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209034536186 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209034536186 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209034536186 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:45:39.127878 run osmo-msc_10.42.42.6(pid=20142): ERR: Terminated: ERROR {rc=2} [trial-2354↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20142)] 03:45:39.178594 run osmo-msc_10.42.42.6(pid=20142): stdout: | (launched: 2022-12-09_03:45:37.989671) 03:45:39.230937 run osmo-msc_10.42.42.6(pid=20142): stderr: | 20221209034538314 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209034538314 DLGLOBAL DEBUG validating counter group 0x7f156c87fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209034538315 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209034538315 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209034538315 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209034538315 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209034538317 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209034538317 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209034538317 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209034538317 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:45:39.283625 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20135): Terminating (SIGTERM) 03:45:39.326164 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20138): Terminating (SIGTERM) 03:45:39.368736 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20141): Terminating (SIGTERM) 03:45:39.411636 --- ParallelTerminationStrategy: PID 20135 died... 03:45:39.431797 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20135): Terminated: ok {rc=0} 03:45:39.478970 --- ParallelTerminationStrategy: PID 20138 died... 03:45:39.498612 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20138): Terminated: ok {rc=0} 03:45:39.545675 --- ParallelTerminationStrategy: PID 20141 died... 03:45:39.565468 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20141): Terminated: ok {rc=0} 03:45:39.654366 bus /sierra_3: Setting Powered False 03:45:40.751222 bus /sierra_3: Setting Powered False 03:45:41.867475 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 nitb_ussd:oc2g --------------------------------------------------------------------- 03:45:43.080144 tst nitb_ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:45:43.084917 tst nitb_ussd:oc2g: Verifying 1 x bts (candidates: 11) 03:45:43.106264 tst nitb_ussd:oc2g: Verifying 1 x ip_address (candidates: 9) 03:45:43.114294 tst nitb_ussd:oc2g: Verifying 1 x modem (candidates: 12) 03:45:43.150480 tst nitb_ussd:oc2g: Reserving 1 x bts (candidates: 11) 03:45:43.171455 tst nitb_ussd:oc2g: Reserving 1 x ip_address (candidates: 9) 03:45:43.178642 tst nitb_ussd:oc2g: Reserving 1 x modem (candidates: 12) 03:45:43.697861 tst nitb_ussd:oc2g: RESERVED RESOURCES for nitb_ussd: bts OC-2G ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2354 nitb_ussd:oc2g assert_extension.py ---------------------------------------------- 03:45:43.703251 tst nitb_ussd:oc2g: Using 1 x ip_address (candidates: 1) 03:45:43.714458 tst nitb_ussd:oc2g: Using 1 x bts (candidates: 1) 03:45:43.749488 tst assert_extension.py: using LAC 18842 03:45:43.867466 tst assert_extension.py: using RAC 227 03:45:43.985740 tst assert_extension.py: using CellId 18842 03:45:44.101305 tst assert_extension.py: using BVCI 18843 03:45:44.208634 tst nitb_ussd:oc2g: Using 1 x modem (candidates: 1) 03:45:44.322195 tst assert_extension.py:10: start nitb and bts... 03:45:44.520409 run osmo-nitb_10.42.42.2: Starting osmo-nitb 03:45:45.128266 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20147): Launched 03:45:45.426422 run osmo-nitb_10.42.42.2(pid=20148): Launched 03:45:45.590994 run osmo-nitb_10.42.42.2(pid=20148): ERR: Terminated: ERROR {rc=2} [trial-2354↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20148)] 03:45:45.723821 run osmo-nitb_10.42.42.2(pid=20148): stdout: | (launched: 2022-12-09_03:45:45.370315) 03:45:45.871430 run osmo-nitb_10.42.42.2(pid=20148): stderr: | (launched: 2022-12-09_03:45:45.414143) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:45:46.016668 run osmo-nitb_10.42.42.2(pid=20148): stdout: | (launched: 2022-12-09_03:45:45.370315) 03:45:46.149279 run osmo-nitb_10.42.42.2(pid=20148): stderr: | (launched: 2022-12-09_03:45:45.414143) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f4d467d3268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=20148): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20148) [trial-2354↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20148)] 03:45:46.537688 tst osmo-nitb_10.42.42.2(pid=20148): stdout: | (launched: 2022-12-09_03:45:45.370315) 03:45:46.669369 tst osmo-nitb_10.42.42.2(pid=20148): stderr: | (launched: 2022-12-09_03:45:45.414143) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:45:46.825211 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=20148): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20148) [trial-2354↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20148)] [trial-2354↪nitb_ussd:oc2g↪assert_extension.py:12] 03:45:46.834549 tst assert_extension.py:12: Test FAILED (3.1 sec) 03:45:46.842058 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20147): Terminating (SIGTERM) 03:45:47.056527 --- ParallelTerminationStrategy: PID 20147 died... 03:45:47.079930 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20147): Terminated: ok {rc=0} 03:45:47.185381 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 nitb_ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 ussd:oc2g --------------------------------------------------------------------- 03:45:48.345307 tst ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:45:48.349556 tst ussd:oc2g: Verifying 1 x bts (candidates: 11) 03:45:48.370100 tst ussd:oc2g: Verifying 6 x ip_address (candidates: 9) 03:45:48.399591 tst ussd:oc2g: Verifying 1 x modem (candidates: 12) 03:45:48.440076 tst ussd:oc2g: Reserving 1 x bts (candidates: 11) 03:45:48.462225 tst ussd:oc2g: Reserving 6 x ip_address (candidates: 9) 03:45:48.490310 tst ussd:oc2g: Reserving 1 x modem (candidates: 12) 03:45:49.014860 tst ussd:oc2g: RESERVED RESOURCES for ussd: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2354 ussd:oc2g assert_extension.py ---------------------------------------------- 03:45:49.020334 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 03:45:49.031310 tst ussd:oc2g: Using 1 x bts (candidates: 1) 03:45:49.071649 tst assert_extension.py: using LAC 18843 03:45:49.210793 tst assert_extension.py: using RAC 228 03:45:49.336646 tst assert_extension.py: using CellId 18843 03:45:49.459263 tst assert_extension.py: using BVCI 18844 03:45:49.574706 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 03:45:49.585684 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 03:45:49.596687 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 03:45:49.607374 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 03:45:49.618682 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 03:45:49.629913 tst ussd:oc2g: Using 1 x modem (candidates: 1) 03:45:49.743585 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:45:50.206295 run create_hlr_db(pid=20152): Launched 03:45:50.328445 bus /sierra_2: Setting Powered False 03:45:51.388429 run create_hlr_db(pid=20152): Terminated: ok {rc=0} 03:45:51.825263 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20154): Launched 03:45:52.145945 run osmo-hlr_10.42.42.2(pid=20155): Launched 03:45:52.268510 run osmo-stp_10.42.42.5: Starting osmo-stp 03:45:52.828703 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20157): Launched 03:45:53.148709 run osmo-stp_10.42.42.5(pid=20158): Launched 03:45:53.270748 run osmo-msc_10.42.42.6: Starting osmo-msc 03:45:53.863718 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20160): Launched 03:45:54.179623 run osmo-msc_10.42.42.6(pid=20161): Launched 03:45:54.357740 run osmo-stp_10.42.42.5(pid=20158): ERR: Terminated: ERROR {rc=1} [trial-2354↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20158)] 03:45:54.491240 run osmo-stp_10.42.42.5(pid=20158): stdout: | (launched: 2022-12-09_03:45:53.089280) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:45:54.626590 run osmo-stp_10.42.42.5(pid=20158): stderr: | 20221209034553281 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034553282 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034553282 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034553282 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034553283 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034553283 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034553283 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:45:54.760490 run osmo-stp_10.42.42.5(pid=20158): stdout: | (launched: 2022-12-09_03:45:53.089280) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:45:54.886552 run osmo-stp_10.42.42.5(pid=20158): stderr: | 20221209034553281 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034553282 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034553282 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034553282 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034553283 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034553283 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034553283 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:45:55.037211 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=20158): Process ended prematurely: osmo-stp_10.42.42.5(pid=20158) [trial-2354↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20158)] [trial-2354↪ussd:oc2g↪assert_extension.py:17] 03:45:55.046063 tst assert_extension.py:17: Test FAILED (6.0 sec) 03:45:55.074126 run osmo-hlr_10.42.42.2(pid=20155): ERR: Terminated: ERROR {rc=237} [trial-2354↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20155)] 03:45:55.124750 run osmo-hlr_10.42.42.2(pid=20155): stdout: | (launched: 2022-12-09_03:45:52.086192) 03:45:55.177098 run osmo-hlr_10.42.42.2(pid=20155): stderr: | 20221209034552287 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209034552287 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209034552287 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209034552287 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209034552287 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209034552287 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209034552299 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/ussd:oc2g/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209034552308 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209034552308 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209034552308 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:45:55.249811 run osmo-msc_10.42.42.6(pid=20161): ERR: Terminated: ERROR {rc=2} [trial-2354↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20161)] 03:45:55.300295 run osmo-msc_10.42.42.6(pid=20161): stdout: | (launched: 2022-12-09_03:45:54.122180) 03:45:55.352588 run osmo-msc_10.42.42.6(pid=20161): stderr: | 20221209034554440 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209034554440 DLGLOBAL DEBUG validating counter group 0x7ff5d0faec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209034554441 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209034554441 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209034554441 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209034554441 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209034554443 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209034554443 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209034554443 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209034554443 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:45:55.405347 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20154): Terminating (SIGTERM) 03:45:55.447458 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20157): Terminating (SIGTERM) 03:45:55.489552 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20160): Terminating (SIGTERM) 03:45:55.531958 --- ParallelTerminationStrategy: PID 20154 died... 03:45:55.552105 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20154): Terminated: ok {rc=0} 03:45:55.599284 --- ParallelTerminationStrategy: PID 20157 died... 03:45:55.619051 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20157): Terminated: ok {rc=0} 03:45:55.665875 --- ParallelTerminationStrategy: PID 20160 died... 03:45:55.685524 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20160): Terminated: ok {rc=0} 03:45:55.773768 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 03:45:56.973056 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:45:56.980046 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 03:45:57.002244 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 03:45:57.029558 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 03:45:57.082872 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 03:45:57.103967 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 03:45:57.131124 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 03:45:57.681533 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 03:45:57.734094 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:45:57.745461 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 03:45:57.802853 tst mo_mt_call.py: using LAC 18844 03:45:57.930596 tst mo_mt_call.py: using RAC 229 03:45:58.061823 tst mo_mt_call.py: using CellId 18844 03:45:58.187172 tst mo_mt_call.py: using BVCI 18845 03:45:58.304927 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:45:58.316407 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:45:58.327542 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:45:58.339076 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:45:58.350640 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:45:58.362079 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 03:45:58.476650 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 03:45:58.595095 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:45:59.095193 run create_hlr_db(pid=20167): Launched 03:45:59.219086 bus /sierra_2: Setting Powered False 03:46:00.282994 run create_hlr_db(pid=20167): Terminated: ok {rc=0} 03:46:00.730937 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20169): Launched 03:46:01.054305 run osmo-hlr_10.42.42.2(pid=20170): Launched 03:46:01.363323 run osmo-stp_10.42.42.5: Starting osmo-stp 03:46:01.943581 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20172): Launched 03:46:02.263506 run osmo-stp_10.42.42.5(pid=20173): Launched 03:46:02.450216 run osmo-msc_10.42.42.6: Starting osmo-msc 03:46:03.032018 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20175): Launched 03:46:03.352664 run osmo-msc_10.42.42.6(pid=20176): Launched 03:46:03.531966 run osmo-stp_10.42.42.5(pid=20173): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20173)] 03:46:03.668232 run osmo-stp_10.42.42.5(pid=20173): stdout: | (launched: 2022-12-09_03:46:02.206720) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:46:03.804681 run osmo-stp_10.42.42.5(pid=20173): stderr: | 20221209034602412 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034602413 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034602413 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034602413 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034602414 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034602414 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034602414 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:46:03.940095 run osmo-stp_10.42.42.5(pid=20173): stdout: | (launched: 2022-12-09_03:46:02.206720) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:46:04.068752 run osmo-stp_10.42.42.5(pid=20173): stderr: | 20221209034602412 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034602413 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034602413 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034602413 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034602414 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034602414 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034602414 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:46:04.222646 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20173): Process ended prematurely: osmo-stp_10.42.42.5(pid=20173) [trial-2354↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20173)] [trial-2354↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 03:46:04.231913 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 03:46:04.260552 run osmo-hlr_10.42.42.2(pid=20170): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20170)] 03:46:04.311233 run osmo-hlr_10.42.42.2(pid=20170): stdout: | (launched: 2022-12-09_03:46:00.995621) 03:46:04.363825 run osmo-hlr_10.42.42.2(pid=20170): stderr: | 20221209034601196 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209034601196 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209034601197 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209034601197 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209034601197 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209034601197 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209034601210 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209034601228 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209034601228 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209034601228 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:46:04.436571 run osmo-msc_10.42.42.6(pid=20176): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20176)] 03:46:04.487422 run osmo-msc_10.42.42.6(pid=20176): stdout: | (launched: 2022-12-09_03:46:03.294586) 03:46:04.539698 run osmo-msc_10.42.42.6(pid=20176): stderr: | 20221209034603615 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209034603615 DLGLOBAL DEBUG validating counter group 0x7f8ad49c8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209034603615 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209034603615 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209034603615 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209034603616 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209034603617 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209034603618 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209034603618 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209034603618 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:46:04.592590 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20169): Terminating (SIGTERM) 03:46:04.635134 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20172): Terminating (SIGTERM) 03:46:04.677417 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20175): Terminating (SIGTERM) 03:46:04.719965 --- ParallelTerminationStrategy: PID 20169 died... 03:46:04.740306 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20169): Terminated: ok {rc=0} 03:46:04.787126 --- ParallelTerminationStrategy: PID 20172 died... 03:46:04.806791 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20172): Terminated: ok {rc=0} 03:46:04.853686 --- ParallelTerminationStrategy: PID 20175 died... 03:46:04.873445 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20175): Terminated: ok {rc=0} 03:46:04.963213 bus /sierra_3: Setting Powered False 03:46:06.059446 bus /sierra_3: Setting Powered False 03:46:07.175410 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2354 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 03:46:08.322024 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:46:08.333674 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 03:46:08.389851 tst mo_mt_call_osmux.py: using LAC 18845 03:46:08.509168 tst mo_mt_call_osmux.py: using RAC 230 03:46:08.628670 tst mo_mt_call_osmux.py: using CellId 18845 03:46:08.746896 tst mo_mt_call_osmux.py: using BVCI 18846 03:46:08.857242 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:46:08.868039 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:46:08.878853 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:46:08.889708 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:46:08.900323 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:46:08.911080 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 03:46:09.029657 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 03:46:09.146206 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:46:09.611600 run create_hlr_db(pid=20178): Launched 03:46:09.734826 bus /sierra_2: Setting Powered False 03:46:10.795777 run create_hlr_db(pid=20178): Terminated: ok {rc=0} 03:46:11.214024 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20180): Launched 03:46:11.512366 run osmo-hlr_10.42.42.2(pid=20181): Launched 03:46:11.626653 run osmo-stp_10.42.42.5: Starting osmo-stp 03:46:12.155841 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20183): Launched 03:46:12.454598 run osmo-stp_10.42.42.5(pid=20184): Launched 03:46:12.568578 run osmo-msc_10.42.42.6: Starting osmo-msc 03:46:13.109700 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20186): Launched 03:46:13.408489 run osmo-msc_10.42.42.6(pid=20187): Launched 03:46:13.576767 run osmo-stp_10.42.42.5(pid=20184): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20184)] 03:46:13.703799 run osmo-stp_10.42.42.5(pid=20184): stdout: | (launched: 2022-12-09_03:46:12.399936) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:46:13.830348 run osmo-stp_10.42.42.5(pid=20184): stderr: | 20221209034612569 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034612569 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034612570 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034612570 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034612570 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034612571 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034612571 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:46:13.954590 run osmo-stp_10.42.42.5(pid=20184): stdout: | (launched: 2022-12-09_03:46:12.399936) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:46:14.073491 run osmo-stp_10.42.42.5(pid=20184): stderr: | 20221209034612569 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034612569 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034612570 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034612570 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034612570 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034612571 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034612571 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:46:14.216285 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20184): Process ended prematurely: osmo-stp_10.42.42.5(pid=20184) [trial-2354↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20184)] [trial-2354↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 03:46:14.225042 tst mo_mt_call_osmux.py:8: Test FAILED (5.9 sec) 03:46:14.251657 run osmo-hlr_10.42.42.2(pid=20181): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20181)] 03:46:14.299479 run osmo-hlr_10.42.42.2(pid=20181): stdout: | (launched: 2022-12-09_03:46:11.457880) 03:46:14.349166 run osmo-hlr_10.42.42.2(pid=20181): stderr: | 20221209034611633 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209034611633 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209034611633 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209034611633 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209034611634 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209034611634 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209034611646 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209034611655 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209034611655 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209034611655 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:46:14.418179 run osmo-msc_10.42.42.6(pid=20187): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20187)] 03:46:14.465975 run osmo-msc_10.42.42.6(pid=20187): stdout: | (launched: 2022-12-09_03:46:13.354143) 03:46:14.515310 run osmo-msc_10.42.42.6(pid=20187): stderr: | 20221209034613625 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209034613625 DLGLOBAL DEBUG validating counter group 0x7f51518ebc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209034613625 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209034613625 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209034613626 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209034613626 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209034613627 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209034613628 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209034613628 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209034613628 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:46:14.565236 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20180): Terminating (SIGTERM) 03:46:14.604798 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20183): Terminating (SIGTERM) 03:46:14.644250 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20186): Terminating (SIGTERM) 03:46:14.684071 --- ParallelTerminationStrategy: PID 20180 died... 03:46:14.702946 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20180): Terminated: ok {rc=0} 03:46:14.746812 --- ParallelTerminationStrategy: PID 20183 died... 03:46:14.765380 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20183): Terminated: ok {rc=0} 03:46:14.810308 --- ParallelTerminationStrategy: PID 20186 died... 03:46:14.829152 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20186): Terminated: ok {rc=0} 03:46:14.913089 bus /sierra_3: Setting Powered False 03:46:16.008734 bus /sierra_3: Setting Powered False 03:46:17.126742 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 03:46:18.365094 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:46:18.371851 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 03:46:18.393451 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 03:46:18.421624 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 03:46:18.474926 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 03:46:18.496908 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 03:46:18.524325 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 03:46:19.072544 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 03:46:19.124506 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:46:19.136256 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 03:46:19.193449 tst mo_mt_call.py: using LAC 18846 03:46:19.320667 tst mo_mt_call.py: using RAC 231 03:46:19.446501 tst mo_mt_call.py: using CellId 18846 03:46:19.573894 tst mo_mt_call.py: using BVCI 18847 03:46:19.693771 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:46:19.705230 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:46:19.716369 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:46:19.727786 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:46:19.739216 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:46:19.750720 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 03:46:19.867102 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 03:46:19.986177 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:46:20.486336 run create_hlr_db(pid=20192): Launched 03:46:20.610497 bus /sierra_2: Setting Powered False 03:46:21.670732 run create_hlr_db(pid=20192): Terminated: ok {rc=0} 03:46:22.098858 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20194): Launched 03:46:22.397538 run osmo-hlr_10.42.42.2(pid=20195): Launched 03:46:22.511567 run osmo-stp_10.42.42.5: Starting osmo-stp 03:46:23.043845 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20197): Launched 03:46:23.342816 run osmo-stp_10.42.42.5(pid=20198): Launched 03:46:23.458138 run osmo-msc_10.42.42.6: Starting osmo-msc 03:46:23.999374 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20200): Launched 03:46:24.298335 run osmo-msc_10.42.42.6(pid=20201): Launched 03:46:24.467666 run osmo-stp_10.42.42.5(pid=20198): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20198)] 03:46:24.594564 run osmo-stp_10.42.42.5(pid=20198): stdout: | (launched: 2022-12-09_03:46:23.288100) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:46:24.721483 run osmo-stp_10.42.42.5(pid=20198): stderr: | 20221209034623457 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034623458 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034623458 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034623458 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034623459 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034623459 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034623459 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:46:24.846325 run osmo-stp_10.42.42.5(pid=20198): stdout: | (launched: 2022-12-09_03:46:23.288100) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:46:24.966690 run osmo-stp_10.42.42.5(pid=20198): stderr: | 20221209034623457 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034623458 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034623458 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034623458 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034623459 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034623459 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034623459 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:46:25.110053 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20198): Process ended prematurely: osmo-stp_10.42.42.5(pid=20198) [trial-2354↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20198)] [trial-2354↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 03:46:25.118885 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 03:46:25.145440 run osmo-hlr_10.42.42.2(pid=20195): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20195)] 03:46:25.193909 run osmo-hlr_10.42.42.2(pid=20195): stdout: | (launched: 2022-12-09_03:46:22.342902) 03:46:25.243444 run osmo-hlr_10.42.42.2(pid=20195): stderr: | 20221209034622519 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209034622519 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209034622519 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209034622519 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209034622519 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209034622519 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209034622531 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209034622542 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209034622542 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209034622542 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:46:25.312518 run osmo-msc_10.42.42.6(pid=20201): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20201)] 03:46:25.360125 run osmo-msc_10.42.42.6(pid=20201): stdout: | (launched: 2022-12-09_03:46:24.243614) 03:46:25.409357 run osmo-msc_10.42.42.6(pid=20201): stderr: | 20221209034624515 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209034624515 DLGLOBAL DEBUG validating counter group 0x7f70d16d5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209034624515 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209034624515 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209034624516 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209034624516 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209034624519 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209034624519 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209034624519 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209034624519 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:46:25.459046 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20194): Terminating (SIGTERM) 03:46:25.498673 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20197): Terminating (SIGTERM) 03:46:25.538397 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20200): Terminating (SIGTERM) 03:46:25.578325 --- ParallelTerminationStrategy: PID 20194 died... 03:46:25.597388 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20194): Terminated: ok {rc=0} 03:46:25.641411 --- ParallelTerminationStrategy: PID 20197 died... 03:46:25.659916 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20197): Terminated: ok {rc=0} 03:46:25.703903 --- ParallelTerminationStrategy: PID 20200 died... 03:46:25.722581 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20200): Terminated: ok {rc=0} 03:46:25.808255 bus /sierra_3: Setting Powered False 03:46:26.907822 bus /sierra_3: Setting Powered False 03:46:28.023674 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2354 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 03:46:29.174567 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:46:29.186589 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 03:46:29.244619 tst mo_mt_call_osmux.py: using LAC 18847 03:46:29.372725 tst mo_mt_call_osmux.py: using RAC 232 03:46:29.498689 tst mo_mt_call_osmux.py: using CellId 18847 03:46:29.626703 tst mo_mt_call_osmux.py: using BVCI 18848 03:46:29.745828 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:46:29.757220 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:46:29.768496 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:46:29.779976 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:46:29.791468 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:46:29.802923 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 03:46:29.917560 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 03:46:30.035807 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:46:30.509633 run create_hlr_db(pid=20203): Launched 03:46:30.633762 bus /sierra_2: Setting Powered False 03:46:31.718394 run create_hlr_db(pid=20203): Terminated: ok {rc=0} 03:46:32.233715 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20205): Launched 03:46:32.556783 run osmo-hlr_10.42.42.2(pid=20206): Launched 03:46:32.681485 run osmo-stp_10.42.42.5: Starting osmo-stp 03:46:33.236057 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20208): Launched 03:46:33.557309 run osmo-stp_10.42.42.5(pid=20209): Launched 03:46:33.682773 run osmo-msc_10.42.42.6: Starting osmo-msc 03:46:34.264846 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20211): Launched 03:46:34.586378 run osmo-msc_10.42.42.6(pid=20212): Launched 03:46:34.766185 run osmo-stp_10.42.42.5(pid=20209): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20209)] 03:46:34.901867 run osmo-stp_10.42.42.5(pid=20209): stdout: | (launched: 2022-12-09_03:46:33.499062) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:46:35.038200 run osmo-stp_10.42.42.5(pid=20209): stderr: | 20221209034633689 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034633689 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034633689 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034633689 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034633690 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034633690 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034633690 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:46:35.173904 run osmo-stp_10.42.42.5(pid=20209): stdout: | (launched: 2022-12-09_03:46:33.499062) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:46:35.302219 run osmo-stp_10.42.42.5(pid=20209): stderr: | 20221209034633689 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034633689 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034633689 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034633689 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034633690 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034633690 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034633690 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:46:35.455815 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20209): Process ended prematurely: osmo-stp_10.42.42.5(pid=20209) [trial-2354↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20209)] [trial-2354↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 03:46:35.465429 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 03:46:35.493949 run osmo-hlr_10.42.42.2(pid=20206): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20206)] 03:46:35.544442 run osmo-hlr_10.42.42.2(pid=20206): stdout: | (launched: 2022-12-09_03:46:32.498372) 03:46:35.596699 run osmo-hlr_10.42.42.2(pid=20206): stderr: | 20221209034632695 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209034632695 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209034632695 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209034632695 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209034632695 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209034632695 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209034632711 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209034632721 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209034632721 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209034632721 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:46:35.670084 run osmo-msc_10.42.42.6(pid=20212): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20212)] 03:46:35.720712 run osmo-msc_10.42.42.6(pid=20212): stdout: | (launched: 2022-12-09_03:46:34.528119) 03:46:35.773110 run osmo-msc_10.42.42.6(pid=20212): stderr: | 20221209034634848 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209034634848 DLGLOBAL DEBUG validating counter group 0x7fe21ed3dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209034634849 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209034634849 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209034634849 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209034634849 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209034634851 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209034634851 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209034634851 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209034634852 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:46:35.825413 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20205): Terminating (SIGTERM) 03:46:35.867391 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20208): Terminating (SIGTERM) 03:46:35.909457 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20211): Terminating (SIGTERM) 03:46:35.951707 --- ParallelTerminationStrategy: PID 20205 died... 03:46:35.971830 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20205): Terminated: ok {rc=0} 03:46:36.018560 --- ParallelTerminationStrategy: PID 20208 died... 03:46:36.038125 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20208): Terminated: ok {rc=0} 03:46:36.084820 --- ParallelTerminationStrategy: PID 20211 died... 03:46:36.104639 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20211): Terminated: ok {rc=0} 03:46:36.193260 bus /sierra_3: Setting Powered False 03:46:37.292248 bus /sierra_3: Setting Powered False 03:46:38.409208 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 03:46:39.644223 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:46:39.651007 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 03:46:39.672330 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 03:46:39.700595 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 03:46:39.753623 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 03:46:39.775161 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 03:46:39.802565 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 03:46:40.355038 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 03:46:40.407467 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:46:40.418795 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 03:46:40.474553 tst mo_mt_call.py: using LAC 18848 03:46:40.601388 tst mo_mt_call.py: using RAC 233 03:46:40.728528 tst mo_mt_call.py: using CellId 18848 03:46:40.853432 tst mo_mt_call.py: using BVCI 18849 03:46:40.963989 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:46:40.975098 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:46:40.985971 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:46:40.996805 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:46:41.007716 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:46:41.018680 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 03:46:41.135179 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 03:46:41.254113 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:46:41.753908 run create_hlr_db(pid=20218): Launched 03:46:41.877460 bus /sierra_2: Setting Powered False 03:46:42.942028 run create_hlr_db(pid=20218): Terminated: ok {rc=0} 03:46:43.370470 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20220): Launched 03:46:43.669554 run osmo-hlr_10.42.42.2(pid=20221): Launched 03:46:43.783943 run osmo-stp_10.42.42.5: Starting osmo-stp 03:46:44.297700 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20223): Launched 03:46:44.596306 run osmo-stp_10.42.42.5(pid=20224): Launched 03:46:44.710823 run osmo-msc_10.42.42.6: Starting osmo-msc 03:46:45.251259 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20226): Launched 03:46:45.549817 run osmo-msc_10.42.42.6(pid=20227): Launched 03:46:45.718487 run osmo-stp_10.42.42.5(pid=20224): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20224)] 03:46:45.880475 run osmo-stp_10.42.42.5(pid=20224): stdout: | (launched: 2022-12-09_03:46:44.541762) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:46:46.035271 run osmo-stp_10.42.42.5(pid=20224): stderr: | 20221209034644711 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034644711 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034644711 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034644712 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034644712 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034644712 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034644712 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:46:46.164090 run osmo-stp_10.42.42.5(pid=20224): stdout: | (launched: 2022-12-09_03:46:44.541762) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:46:46.287157 run osmo-stp_10.42.42.5(pid=20224): stderr: | 20221209034644711 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034644711 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034644711 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034644712 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034644712 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034644712 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034644712 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:46:46.434607 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20224): Process ended prematurely: osmo-stp_10.42.42.5(pid=20224) [trial-2354↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20224)] [trial-2354↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 03:46:46.443983 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 03:46:46.471791 run osmo-hlr_10.42.42.2(pid=20221): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20221)] 03:46:46.521175 run osmo-hlr_10.42.42.2(pid=20221): stdout: | (launched: 2022-12-09_03:46:43.615020) 03:46:46.571922 run osmo-hlr_10.42.42.2(pid=20221): stderr: | 20221209034643790 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209034643791 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209034643791 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209034643791 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209034643791 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209034643791 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209034643805 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209034643816 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209034643816 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209034643816 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:46:46.643127 run osmo-msc_10.42.42.6(pid=20227): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20227)] 03:46:46.693165 run osmo-msc_10.42.42.6(pid=20227): stdout: | (launched: 2022-12-09_03:46:45.495294) 03:46:46.744112 run osmo-msc_10.42.42.6(pid=20227): stderr: | 20221209034645767 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209034645767 DLGLOBAL DEBUG validating counter group 0x7f44dfb98c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209034645767 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209034645767 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209034645767 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209034645768 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209034645770 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209034645771 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209034645771 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209034645771 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:46:46.795640 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20220): Terminating (SIGTERM) 03:46:46.837064 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20223): Terminating (SIGTERM) 03:46:46.877953 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20226): Terminating (SIGTERM) 03:46:46.919538 --- ParallelTerminationStrategy: PID 20220 died... 03:46:46.938946 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20220): Terminated: ok {rc=0} 03:46:46.984662 --- ParallelTerminationStrategy: PID 20223 died... 03:46:47.004530 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20223): Terminated: ok {rc=0} 03:46:47.049906 --- ParallelTerminationStrategy: PID 20226 died... 03:46:47.069721 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20226): Terminated: ok {rc=0} 03:46:47.155772 bus /sierra_3: Setting Powered False 03:46:48.250370 bus /sierra_3: Setting Powered False 03:46:49.365150 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2354 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 03:46:50.511028 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:46:50.522537 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 03:46:50.579124 tst mo_mt_call_osmux.py: using LAC 18849 03:46:50.707465 tst mo_mt_call_osmux.py: using RAC 234 03:46:50.833420 tst mo_mt_call_osmux.py: using CellId 18849 03:46:50.951756 tst mo_mt_call_osmux.py: using BVCI 18850 03:46:51.062200 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:46:51.073108 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:46:51.084243 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:46:51.095165 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:46:51.106189 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:46:51.116936 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 03:46:51.234986 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 03:46:51.350718 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:46:51.815506 run create_hlr_db(pid=20229): Launched 03:46:51.939176 bus /sierra_2: Setting Powered False 03:46:52.999515 run create_hlr_db(pid=20229): Terminated: ok {rc=0} 03:46:53.439694 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20231): Launched 03:46:53.763327 run osmo-hlr_10.42.42.2(pid=20232): Launched 03:46:53.886914 run osmo-stp_10.42.42.5: Starting osmo-stp 03:46:54.442183 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20234): Launched 03:46:54.764759 run osmo-stp_10.42.42.5(pid=20235): Launched 03:46:54.887862 run osmo-msc_10.42.42.6: Starting osmo-msc 03:46:55.470997 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20237): Launched 03:46:55.795226 run osmo-msc_10.42.42.6(pid=20238): Launched 03:46:55.976070 run osmo-stp_10.42.42.5(pid=20235): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20235)] 03:46:56.112573 run osmo-stp_10.42.42.5(pid=20235): stdout: | (launched: 2022-12-09_03:46:54.706432) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:46:56.249648 run osmo-stp_10.42.42.5(pid=20235): stderr: | 20221209034654898 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034654898 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034654898 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034654899 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034654899 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034654899 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034654899 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:46:56.386233 run osmo-stp_10.42.42.5(pid=20235): stdout: | (launched: 2022-12-09_03:46:54.706432) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:46:56.515615 run osmo-stp_10.42.42.5(pid=20235): stderr: | 20221209034654898 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034654898 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034654898 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034654899 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034654899 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034654899 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034654899 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:46:56.670643 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20235): Process ended prematurely: osmo-stp_10.42.42.5(pid=20235) [trial-2354↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20235)] [trial-2354↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 03:46:56.680202 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 03:46:56.709129 run osmo-hlr_10.42.42.2(pid=20232): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20232)] 03:46:56.760300 run osmo-hlr_10.42.42.2(pid=20232): stdout: | (launched: 2022-12-09_03:46:53.704805) 03:46:56.813169 run osmo-hlr_10.42.42.2(pid=20232): stderr: | 20221209034653902 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209034653902 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209034653902 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209034653902 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209034653902 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209034653902 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209034653915 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209034653924 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209034653924 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209034653924 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:46:56.886624 run osmo-msc_10.42.42.6(pid=20238): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20238)] 03:46:56.937677 run osmo-msc_10.42.42.6(pid=20238): stdout: | (launched: 2022-12-09_03:46:55.736749) 03:46:56.990367 run osmo-msc_10.42.42.6(pid=20238): stderr: | 20221209034656057 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209034656057 DLGLOBAL DEBUG validating counter group 0x7f075de1ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209034656057 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209034656057 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209034656057 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209034656057 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209034656059 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209034656059 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209034656059 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209034656060 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:46:57.043494 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20231): Terminating (SIGTERM) 03:46:57.085898 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20234): Terminating (SIGTERM) 03:46:57.128425 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20237): Terminating (SIGTERM) 03:46:57.171443 --- ParallelTerminationStrategy: PID 20231 died... 03:46:57.191625 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20231): Terminated: ok {rc=0} 03:46:57.239113 --- ParallelTerminationStrategy: PID 20234 died... 03:46:57.258894 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20234): Terminated: ok {rc=0} 03:46:57.305845 --- ParallelTerminationStrategy: PID 20237 died... 03:46:57.325728 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20237): Terminated: ok {rc=0} 03:46:57.413580 bus /sierra_3: Setting Powered False 03:46:58.512680 bus /sierra_3: Setting Powered False 03:46:59.629829 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 03:47:00.873995 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:47:00.885037 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 03:47:00.917417 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 03:47:00.947029 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 03:47:01.010784 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 03:47:01.032350 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 03:47:01.061862 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 03:47:01.615052 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 03:47:01.669623 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:47:01.681620 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 03:47:01.738027 tst mo_mt_call.py: using LAC 18850 03:47:01.887297 tst mo_mt_call.py: using RAC 235 03:47:02.015392 tst mo_mt_call.py: using CellId 18850 03:47:02.177566 tst mo_mt_call.py: using BVCI 18851 03:47:02.289775 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:47:02.301853 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:47:02.313604 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:47:02.327177 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:47:02.339338 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:47:02.350313 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 03:47:02.469769 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 03:47:02.592269 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:47:03.092597 run create_hlr_db(pid=20243): Launched 03:47:03.216049 bus /sierra_2: Setting Powered False 03:47:04.280376 run create_hlr_db(pid=20243): Terminated: ok {rc=0} 03:47:04.731261 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20245): Launched 03:47:05.054093 run osmo-hlr_10.42.42.2(pid=20246): Launched 03:47:05.178277 run osmo-stp_10.42.42.5: Starting osmo-stp 03:47:05.695558 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20248): Launched 03:47:05.994264 run osmo-stp_10.42.42.5(pid=20249): Launched 03:47:06.108186 run osmo-msc_10.42.42.6: Starting osmo-msc 03:47:06.647725 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20251): Launched 03:47:06.947270 run osmo-msc_10.42.42.6(pid=20252): Launched 03:47:07.114986 run osmo-stp_10.42.42.5(pid=20249): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20249)] 03:47:07.242205 run osmo-stp_10.42.42.5(pid=20249): stdout: | (launched: 2022-12-09_03:47:05.939763) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:47:07.369344 run osmo-stp_10.42.42.5(pid=20249): stderr: | 20221209034706108 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034706108 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034706108 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034706108 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034706109 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034706109 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034706109 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:47:07.493762 run osmo-stp_10.42.42.5(pid=20249): stdout: | (launched: 2022-12-09_03:47:05.939763) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:47:07.612669 run osmo-stp_10.42.42.5(pid=20249): stderr: | 20221209034706108 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034706108 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034706108 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034706108 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034706109 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034706109 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034706109 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:47:07.755423 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20249): Process ended prematurely: osmo-stp_10.42.42.5(pid=20249) [trial-2354↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20249)] [trial-2354↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 03:47:07.764373 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 03:47:07.791089 run osmo-hlr_10.42.42.2(pid=20246): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20246)] 03:47:07.838787 run osmo-hlr_10.42.42.2(pid=20246): stdout: | (launched: 2022-12-09_03:47:04.995741) 03:47:07.887910 run osmo-hlr_10.42.42.2(pid=20246): stderr: | 20221209034705192 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209034705192 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209034705192 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209034705192 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209034705192 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209034705192 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209034705208 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209034705216 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209034705216 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209034705216 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:47:07.956738 run osmo-msc_10.42.42.6(pid=20252): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20252)] 03:47:08.004391 run osmo-msc_10.42.42.6(pid=20252): stdout: | (launched: 2022-12-09_03:47:06.892847) 03:47:08.053641 run osmo-msc_10.42.42.6(pid=20252): stderr: | 20221209034707163 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209034707163 DLGLOBAL DEBUG validating counter group 0x7f8db0f18c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209034707163 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209034707163 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209034707164 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209034707164 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209034707165 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209034707167 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209034707167 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209034707167 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:47:08.103272 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20245): Terminating (SIGTERM) 03:47:08.142797 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20248): Terminating (SIGTERM) 03:47:08.182202 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20251): Terminating (SIGTERM) 03:47:08.221836 --- ParallelTerminationStrategy: PID 20245 died... 03:47:08.240817 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20245): Terminated: ok {rc=0} 03:47:08.284918 --- ParallelTerminationStrategy: PID 20248 died... 03:47:08.303607 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20248): Terminated: ok {rc=0} 03:47:08.347528 --- ParallelTerminationStrategy: PID 20251 died... 03:47:08.366294 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20251): Terminated: ok {rc=0} 03:47:08.450541 bus /sierra_3: Setting Powered False 03:47:09.548905 bus /sierra_3: Setting Powered False 03:47:10.667805 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2354 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 03:47:11.818014 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:47:11.830064 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 03:47:11.890835 tst mo_mt_call_osmux.py: using LAC 18851 03:47:12.016157 tst mo_mt_call_osmux.py: using RAC 236 03:47:12.140854 tst mo_mt_call_osmux.py: using CellId 18851 03:47:12.265654 tst mo_mt_call_osmux.py: using BVCI 18852 03:47:12.382840 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:47:12.394248 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:47:12.405439 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:47:12.416849 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:47:12.428325 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:47:12.439854 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 03:47:12.555149 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 03:47:12.669250 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:47:13.134608 run create_hlr_db(pid=20254): Launched 03:47:13.257282 bus /sierra_2: Setting Powered False 03:47:14.317920 run create_hlr_db(pid=20254): Terminated: ok {rc=0} 03:47:14.759495 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20256): Launched 03:47:15.083605 run osmo-hlr_10.42.42.2(pid=20257): Launched 03:47:15.207547 run osmo-stp_10.42.42.5: Starting osmo-stp 03:47:15.765747 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20259): Launched 03:47:16.090774 run osmo-stp_10.42.42.5(pid=20260): Launched 03:47:16.346096 run osmo-msc_10.42.42.6: Starting osmo-msc 03:47:17.078911 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20262): Launched 03:47:17.398237 run osmo-msc_10.42.42.6(pid=20263): Launched 03:47:17.620779 run osmo-stp_10.42.42.5(pid=20260): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20260)] 03:47:17.758648 run osmo-stp_10.42.42.5(pid=20260): stdout: | (launched: 2022-12-09_03:47:16.024489) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:47:17.896703 run osmo-stp_10.42.42.5(pid=20260): stderr: | 20221209034716298 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034716298 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034716299 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034716299 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034716299 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034716299 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034716300 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:47:18.032342 run osmo-stp_10.42.42.5(pid=20260): stdout: | (launched: 2022-12-09_03:47:16.024489) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:47:18.161568 run osmo-stp_10.42.42.5(pid=20260): stderr: | 20221209034716298 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034716298 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034716299 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034716299 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034716299 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034716299 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034716300 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:47:18.316141 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20260): Process ended prematurely: osmo-stp_10.42.42.5(pid=20260) [trial-2354↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20260)] [trial-2354↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 03:47:18.326078 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 03:47:18.354996 run osmo-hlr_10.42.42.2(pid=20257): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20257)] 03:47:18.406665 run osmo-hlr_10.42.42.2(pid=20257): stdout: | (launched: 2022-12-09_03:47:15.025076) 03:47:18.459669 run osmo-hlr_10.42.42.2(pid=20257): stderr: | 20221209034715223 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209034715224 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209034715224 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209034715224 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209034715224 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209034715224 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209034715235 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209034715244 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209034715244 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209034715244 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:47:18.533469 run osmo-msc_10.42.42.6(pid=20263): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20263)] 03:47:18.584680 run osmo-msc_10.42.42.6(pid=20263): stdout: | (launched: 2022-12-09_03:47:17.334500) 03:47:18.637579 run osmo-msc_10.42.42.6(pid=20263): stderr: | 20221209034717675 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209034717675 DLGLOBAL DEBUG validating counter group 0x7fc025932c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209034717675 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209034717675 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209034717675 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209034717676 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209034717677 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209034717678 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209034717678 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209034717678 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:47:18.691385 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20256): Terminating (SIGTERM) 03:47:18.734211 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20259): Terminating (SIGTERM) 03:47:18.777089 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20262): Terminating (SIGTERM) 03:47:18.820463 --- ParallelTerminationStrategy: PID 20256 died... 03:47:18.840876 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20256): Terminated: ok {rc=0} 03:47:18.888478 --- ParallelTerminationStrategy: PID 20259 died... 03:47:18.908463 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20259): Terminated: ok {rc=0} 03:47:18.955900 --- ParallelTerminationStrategy: PID 20262 died... 03:47:18.975910 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20262): Terminated: ok {rc=0} 03:47:19.064642 bus /sierra_3: Setting Powered False 03:47:20.164029 bus /sierra_3: Setting Powered False 03:47:21.283279 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 03:47:22.515258 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:47:22.521512 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 03:47:22.542250 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 03:47:22.568593 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 03:47:22.621758 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 03:47:22.642664 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 03:47:22.669257 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 03:47:23.216589 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 03:47:23.265083 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:47:23.276016 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 03:47:23.331438 tst mo_mt_call.py: using LAC 18852 03:47:23.449818 tst mo_mt_call.py: using RAC 237 03:47:23.567461 tst mo_mt_call.py: using CellId 18852 03:47:23.685045 tst mo_mt_call.py: using BVCI 18853 03:47:23.793765 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:47:23.804829 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:47:23.815694 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:47:23.826905 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:47:23.837929 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:47:23.848925 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 03:47:23.967629 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 03:47:24.083234 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:47:24.549440 run create_hlr_db(pid=20268): Launched 03:47:24.673147 bus /sierra_2: Setting Powered False 03:47:25.733975 run create_hlr_db(pid=20268): Terminated: ok {rc=0} 03:47:26.174701 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20270): Launched 03:47:26.479754 run osmo-hlr_10.42.42.2(pid=20271): Launched 03:47:26.594368 run osmo-stp_10.42.42.5: Starting osmo-stp 03:47:27.121558 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20273): Launched 03:47:27.423452 run osmo-stp_10.42.42.5(pid=20274): Launched 03:47:27.537751 run osmo-msc_10.42.42.6: Starting osmo-msc 03:47:28.079824 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20276): Launched 03:47:28.381204 run osmo-msc_10.42.42.6(pid=20277): Launched 03:47:28.549974 run osmo-stp_10.42.42.5(pid=20274): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20274)] 03:47:28.677528 run osmo-stp_10.42.42.5(pid=20274): stdout: | (launched: 2022-12-09_03:47:27.367569) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:47:28.804420 run osmo-stp_10.42.42.5(pid=20274): stderr: | 20221209034727537 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034727537 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034727538 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034727538 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034727538 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034727538 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034727539 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:47:28.930230 run osmo-stp_10.42.42.5(pid=20274): stdout: | (launched: 2022-12-09_03:47:27.367569) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:47:29.050565 run osmo-stp_10.42.42.5(pid=20274): stderr: | 20221209034727537 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034727537 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034727538 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034727538 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034727538 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034727538 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034727539 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:47:29.194548 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20274): Process ended prematurely: osmo-stp_10.42.42.5(pid=20274) [trial-2354↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20274)] [trial-2354↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 03:47:29.203570 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 03:47:29.230444 run osmo-hlr_10.42.42.2(pid=20271): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20271)] 03:47:29.278743 run osmo-hlr_10.42.42.2(pid=20271): stdout: | (launched: 2022-12-09_03:47:26.424739) 03:47:29.328620 run osmo-hlr_10.42.42.2(pid=20271): stderr: | 20221209034726601 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209034726601 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209034726601 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209034726601 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209034726601 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209034726602 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209034726614 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209034726623 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209034726623 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209034726623 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:47:29.398446 run osmo-msc_10.42.42.6(pid=20277): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20277)] 03:47:29.446672 run osmo-msc_10.42.42.6(pid=20277): stdout: | (launched: 2022-12-09_03:47:28.326142) 03:47:29.496221 run osmo-msc_10.42.42.6(pid=20277): stderr: | 20221209034728598 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209034728599 DLGLOBAL DEBUG validating counter group 0x7fbfc4431c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209034728599 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209034728599 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209034728599 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209034728599 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209034728602 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209034728602 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209034728603 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209034728603 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:47:29.546127 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20270): Terminating (SIGTERM) 03:47:29.586435 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20273): Terminating (SIGTERM) 03:47:29.626297 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20276): Terminating (SIGTERM) 03:47:29.666412 --- ParallelTerminationStrategy: PID 20270 died... 03:47:29.685682 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20270): Terminated: ok {rc=0} 03:47:29.730483 --- ParallelTerminationStrategy: PID 20273 died... 03:47:29.749489 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20273): Terminated: ok {rc=0} 03:47:29.793901 --- ParallelTerminationStrategy: PID 20276 died... 03:47:29.812800 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20276): Terminated: ok {rc=0} 03:47:29.896937 bus /sierra_3: Setting Powered False 03:47:30.993192 bus /sierra_3: Setting Powered False 03:47:32.110533 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2354 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 03:47:33.260790 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:47:33.272886 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 03:47:33.330870 tst mo_mt_call_osmux.py: using LAC 18853 03:47:33.458772 tst mo_mt_call_osmux.py: using RAC 238 03:47:33.587664 tst mo_mt_call_osmux.py: using CellId 18853 03:47:33.714014 tst mo_mt_call_osmux.py: using BVCI 18854 03:47:33.831431 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:47:33.842899 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:47:33.854061 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:47:33.865492 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:47:33.876671 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:47:33.888217 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 03:47:34.007843 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 03:47:34.127729 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:47:34.627193 run create_hlr_db(pid=20279): Launched 03:47:34.751555 bus /sierra_2: Setting Powered False 03:47:35.818576 run create_hlr_db(pid=20279): Terminated: ok {rc=0} 03:47:36.247829 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20284): Launched 03:47:36.548527 run osmo-hlr_10.42.42.2(pid=20285): Launched 03:47:36.664109 run osmo-stp_10.42.42.5: Starting osmo-stp 03:47:37.195499 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20287): Launched 03:47:37.496636 run osmo-stp_10.42.42.5(pid=20288): Launched 03:47:37.612070 run osmo-msc_10.42.42.6: Starting osmo-msc 03:47:38.154155 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20290): Launched 03:47:38.453892 run osmo-msc_10.42.42.6(pid=20291): Launched 03:47:38.622386 run osmo-stp_10.42.42.5(pid=20288): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20288)] 03:47:38.749839 run osmo-stp_10.42.42.5(pid=20288): stdout: | (launched: 2022-12-09_03:47:37.440726) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:47:38.877570 run osmo-stp_10.42.42.5(pid=20288): stderr: | 20221209034737612 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034737612 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034737612 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034737613 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034737613 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034737613 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034737613 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:47:39.002475 run osmo-stp_10.42.42.5(pid=20288): stdout: | (launched: 2022-12-09_03:47:37.440726) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:47:39.122081 run osmo-stp_10.42.42.5(pid=20288): stderr: | 20221209034737612 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034737612 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034737612 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034737613 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034737613 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034737613 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034737613 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:47:39.265088 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20288): Process ended prematurely: osmo-stp_10.42.42.5(pid=20288) [trial-2354↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20288)] [trial-2354↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 03:47:39.273988 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 03:47:39.300802 run osmo-hlr_10.42.42.2(pid=20285): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20285)] 03:47:39.348737 run osmo-hlr_10.42.42.2(pid=20285): stdout: | (launched: 2022-12-09_03:47:36.493649) 03:47:39.398431 run osmo-hlr_10.42.42.2(pid=20285): stderr: | 20221209034736670 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209034736670 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209034736670 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209034736670 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209034736670 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209034736670 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209034736682 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209034736691 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209034736691 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209034736691 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:47:39.468366 run osmo-msc_10.42.42.6(pid=20291): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20291)] 03:47:39.516482 run osmo-msc_10.42.42.6(pid=20291): stdout: | (launched: 2022-12-09_03:47:38.399048) 03:47:39.566164 run osmo-msc_10.42.42.6(pid=20291): stderr: | 20221209034738670 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209034738670 DLGLOBAL DEBUG validating counter group 0x7fbdeb723c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209034738670 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209034738670 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209034738670 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209034738671 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209034738673 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209034738674 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209034738674 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209034738674 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:47:39.616076 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20284): Terminating (SIGTERM) 03:47:39.655892 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20287): Terminating (SIGTERM) 03:47:39.695838 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20290): Terminating (SIGTERM) 03:47:39.736174 --- ParallelTerminationStrategy: PID 20284 died... 03:47:39.755388 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20284): Terminated: ok {rc=0} 03:47:39.799467 --- ParallelTerminationStrategy: PID 20287 died... 03:47:39.818329 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20287): Terminated: ok {rc=0} 03:47:39.862506 --- ParallelTerminationStrategy: PID 20290 died... 03:47:39.881288 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20290): Terminated: ok {rc=0} 03:47:39.964939 bus /sierra_3: Setting Powered False 03:47:41.061693 bus /sierra_3: Setting Powered False 03:47:42.179048 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 03:47:43.411440 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:47:43.417702 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 03:47:43.437864 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 03:47:43.464753 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 03:47:43.515325 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 03:47:43.535758 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 03:47:43.561773 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 03:47:44.112095 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 03:47:44.160085 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:47:44.171018 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 03:47:44.230406 tst mo_mt_call.py: using LAC 18854 03:47:44.357963 tst mo_mt_call.py: using RAC 239 03:47:44.485328 tst mo_mt_call.py: using CellId 18854 03:47:44.611944 tst mo_mt_call.py: using BVCI 18855 03:47:44.730350 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:47:44.741955 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:47:44.753164 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:47:44.764666 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:47:44.776179 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:47:44.787693 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:47:44.906077 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:47:45.024877 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:47:45.524165 run create_hlr_db(pid=20296): Launched 03:47:45.647404 bus /sierra_2: Setting Powered False 03:47:46.707379 run create_hlr_db(pid=20296): Terminated: ok {rc=0} 03:47:47.163990 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20298): Launched 03:47:47.472541 run osmo-hlr_10.42.42.2(pid=20299): Launched 03:47:47.589853 run osmo-stp_10.42.42.5: Starting osmo-stp 03:47:48.105254 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20301): Launched 03:47:48.404552 run osmo-stp_10.42.42.5(pid=20302): Launched 03:47:48.519208 run osmo-msc_10.42.42.6: Starting osmo-msc 03:47:49.078499 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20304): Launched 03:47:49.378401 run osmo-msc_10.42.42.6(pid=20305): Launched 03:47:49.547027 run osmo-stp_10.42.42.5(pid=20302): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20302)] 03:47:49.675097 run osmo-stp_10.42.42.5(pid=20302): stdout: | (launched: 2022-12-09_03:47:48.349931) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:47:49.802469 run osmo-stp_10.42.42.5(pid=20302): stderr: | 20221209034748520 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034748520 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034748520 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034748520 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034748521 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034748521 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034748521 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:47:49.927444 run osmo-stp_10.42.42.5(pid=20302): stdout: | (launched: 2022-12-09_03:47:48.349931) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:47:50.046879 run osmo-stp_10.42.42.5(pid=20302): stderr: | 20221209034748520 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034748520 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034748520 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034748520 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034748521 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034748521 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034748521 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:47:50.189805 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20302): Process ended prematurely: osmo-stp_10.42.42.5(pid=20302) [trial-2354↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20302)] [trial-2354↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 03:47:50.198671 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 03:47:50.225495 run osmo-hlr_10.42.42.2(pid=20299): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20299)] 03:47:50.273788 run osmo-hlr_10.42.42.2(pid=20299): stdout: | (launched: 2022-12-09_03:47:47.417788) 03:47:50.323889 run osmo-hlr_10.42.42.2(pid=20299): stderr: | 20221209034747596 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209034747596 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209034747596 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209034747596 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209034747596 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209034747596 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209034747608 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209034747617 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209034747617 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209034747617 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:47:50.393481 run osmo-msc_10.42.42.6(pid=20305): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20305)] 03:47:50.441483 run osmo-msc_10.42.42.6(pid=20305): stdout: | (launched: 2022-12-09_03:47:49.323450) 03:47:50.491420 run osmo-msc_10.42.42.6(pid=20305): stderr: | 20221209034749593 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209034749593 DLGLOBAL DEBUG validating counter group 0x7fd396156c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209034749593 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209034749593 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209034749593 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209034749594 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209034749595 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209034749596 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209034749596 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209034749596 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:47:50.541612 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20298): Terminating (SIGTERM) 03:47:50.581218 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20301): Terminating (SIGTERM) 03:47:50.620756 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20304): Terminating (SIGTERM) 03:47:50.660695 --- ParallelTerminationStrategy: PID 20298 died... 03:47:50.679983 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20298): Terminated: ok {rc=0} 03:47:50.724446 --- ParallelTerminationStrategy: PID 20301 died... 03:47:50.743368 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20301): Terminated: ok {rc=0} 03:47:50.787847 --- ParallelTerminationStrategy: PID 20304 died... 03:47:50.806727 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20304): Terminated: ok {rc=0} 03:47:50.892540 bus /sierra_3: Setting Powered False 03:47:51.993064 bus /sierra_3: Setting Powered False 03:47:53.108701 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2354 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 03:47:54.255282 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:47:54.266849 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 03:47:54.323766 tst mo_mt_call_osmux.py: using LAC 18855 03:47:54.443378 tst mo_mt_call_osmux.py: using RAC 240 03:47:54.562694 tst mo_mt_call_osmux.py: using CellId 18855 03:47:54.680417 tst mo_mt_call_osmux.py: using BVCI 18856 03:47:54.790559 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:47:54.801583 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:47:54.812298 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:47:54.823106 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:47:54.833895 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:47:54.844670 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:47:54.959376 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:47:55.079541 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:47:55.582650 run create_hlr_db(pid=20307): Launched 03:47:55.707479 bus /sierra_2: Setting Powered False 03:47:56.771906 run create_hlr_db(pid=20307): Terminated: ok {rc=0} 03:47:57.202736 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20309): Launched 03:47:57.503378 run osmo-hlr_10.42.42.2(pid=20310): Launched 03:47:57.619326 run osmo-stp_10.42.42.5: Starting osmo-stp 03:47:58.156788 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20312): Launched 03:47:58.457125 run osmo-stp_10.42.42.5(pid=20313): Launched 03:47:58.573075 run osmo-msc_10.42.42.6: Starting osmo-msc 03:47:59.117064 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20315): Launched 03:47:59.418210 run osmo-msc_10.42.42.6(pid=20316): Launched 03:47:59.586642 run osmo-stp_10.42.42.5(pid=20313): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20313)] 03:47:59.714536 run osmo-stp_10.42.42.5(pid=20313): stdout: | (launched: 2022-12-09_03:47:58.402161) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:47:59.841344 run osmo-stp_10.42.42.5(pid=20313): stderr: | 20221209034758571 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034758571 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034758571 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034758572 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034758572 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034758572 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034758572 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:47:59.966745 run osmo-stp_10.42.42.5(pid=20313): stdout: | (launched: 2022-12-09_03:47:58.402161) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:48:00.086820 run osmo-stp_10.42.42.5(pid=20313): stderr: | 20221209034758571 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034758571 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034758571 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034758572 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034758572 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034758572 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034758572 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:48:00.230613 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20313): Process ended prematurely: osmo-stp_10.42.42.5(pid=20313) [trial-2354↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20313)] [trial-2354↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 03:48:00.239584 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 03:48:00.266349 run osmo-hlr_10.42.42.2(pid=20310): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20310)] 03:48:00.314539 run osmo-hlr_10.42.42.2(pid=20310): stdout: | (launched: 2022-12-09_03:47:57.448439) 03:48:00.364609 run osmo-hlr_10.42.42.2(pid=20310): stderr: | 20221209034757625 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209034757626 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209034757626 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209034757626 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209034757626 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209034757626 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209034757638 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209034757647 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209034757647 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209034757647 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:48:00.434526 run osmo-msc_10.42.42.6(pid=20316): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20316)] 03:48:00.482484 run osmo-msc_10.42.42.6(pid=20316): stdout: | (launched: 2022-12-09_03:47:59.362957) 03:48:00.532436 run osmo-msc_10.42.42.6(pid=20316): stderr: | 20221209034759633 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209034759633 DLGLOBAL DEBUG validating counter group 0x7fae41f98c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209034759633 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209034759633 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209034759633 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209034759634 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209034759635 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209034759636 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209034759636 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209034759636 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:48:00.582517 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20309): Terminating (SIGTERM) 03:48:00.622380 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20312): Terminating (SIGTERM) 03:48:00.662192 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20315): Terminating (SIGTERM) 03:48:00.702904 --- ParallelTerminationStrategy: PID 20309 died... 03:48:00.722350 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20309): Terminated: ok {rc=0} 03:48:00.766768 --- ParallelTerminationStrategy: PID 20312 died... 03:48:00.785765 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20312): Terminated: ok {rc=0} 03:48:00.830043 --- ParallelTerminationStrategy: PID 20315 died... 03:48:00.849162 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20315): Terminated: ok {rc=0} 03:48:00.939346 bus /sierra_3: Setting Powered False 03:48:02.040811 bus /sierra_3: Setting Powered False 03:48:03.161678 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 voice:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 03:48:04.394942 tst voice:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:48:04.400425 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 03:48:04.420694 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 03:48:04.447547 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 03:48:04.498826 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 03:48:04.519079 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 03:48:04.545231 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 03:48:05.093626 tst voice:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 03:48:05.141759 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:48:05.152534 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 03:48:05.209640 tst mo_mt_call.py: using LAC 18856 03:48:05.330420 tst mo_mt_call.py: using RAC 241 03:48:05.447579 tst mo_mt_call.py: using CellId 18856 03:48:05.564027 tst mo_mt_call.py: using BVCI 18857 03:48:05.683398 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:48:05.694956 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:48:05.705921 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:48:05.717456 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:48:05.729256 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:48:05.740591 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 03:48:05.857422 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 03:48:05.972132 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:48:06.437732 run create_hlr_db(pid=20321): Launched 03:48:06.562012 bus /sierra_2: Setting Powered False 03:48:07.622401 run create_hlr_db(pid=20321): Terminated: ok {rc=0} 03:48:08.042478 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20323): Launched 03:48:08.342456 run osmo-hlr_10.42.42.2(pid=20324): Launched 03:48:08.456056 run osmo-stp_10.42.42.5: Starting osmo-stp 03:48:08.971842 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20326): Launched 03:48:09.273524 run osmo-stp_10.42.42.5(pid=20327): Launched 03:48:09.388329 run osmo-msc_10.42.42.6: Starting osmo-msc 03:48:09.931842 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20329): Launched 03:48:10.232619 run osmo-msc_10.42.42.6(pid=20330): Launched 03:48:10.401611 run osmo-stp_10.42.42.5(pid=20327): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20327)] 03:48:10.528619 run osmo-stp_10.42.42.5(pid=20327): stdout: | (launched: 2022-12-09_03:48:09.218416) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:48:10.656054 run osmo-stp_10.42.42.5(pid=20327): stderr: | 20221209034809387 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034809387 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034809388 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034809388 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034809389 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034809389 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034809389 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:48:10.781441 run osmo-stp_10.42.42.5(pid=20327): stdout: | (launched: 2022-12-09_03:48:09.218416) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:48:10.901327 run osmo-stp_10.42.42.5(pid=20327): stderr: | 20221209034809387 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034809387 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034809388 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034809388 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034809389 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034809389 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034809389 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:48:11.044883 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20327): Process ended prematurely: osmo-stp_10.42.42.5(pid=20327) [trial-2354↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20327)] [trial-2354↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 03:48:11.053960 tst mo_mt_call.py:8: Test FAILED (5.9 sec) 03:48:11.080501 run osmo-hlr_10.42.42.2(pid=20324): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20324)] 03:48:11.128648 run osmo-hlr_10.42.42.2(pid=20324): stdout: | (launched: 2022-12-09_03:48:08.287769) 03:48:11.178714 run osmo-hlr_10.42.42.2(pid=20324): stderr: | 20221209034808463 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209034808463 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209034808463 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209034808463 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209034808463 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209034808463 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209034808475 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209034808485 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209034808485 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209034808485 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:48:11.248632 run osmo-msc_10.42.42.6(pid=20330): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20330)] 03:48:11.296880 run osmo-msc_10.42.42.6(pid=20330): stdout: | (launched: 2022-12-09_03:48:10.177489) 03:48:11.346836 run osmo-msc_10.42.42.6(pid=20330): stderr: | 20221209034810450 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209034810450 DLGLOBAL DEBUG validating counter group 0x7fa574e13c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209034810450 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209034810450 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209034810450 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209034810451 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209034810453 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209034810454 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209034810454 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209034810454 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:48:11.396823 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20323): Terminating (SIGTERM) 03:48:11.437199 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20326): Terminating (SIGTERM) 03:48:11.477359 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20329): Terminating (SIGTERM) 03:48:11.517838 --- ParallelTerminationStrategy: PID 20323 died... 03:48:11.537391 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20323): Terminated: ok {rc=0} 03:48:11.582455 --- ParallelTerminationStrategy: PID 20326 died... 03:48:11.601464 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20326): Terminated: ok {rc=0} 03:48:11.645793 --- ParallelTerminationStrategy: PID 20329 died... 03:48:11.664584 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20329): Terminated: ok {rc=0} 03:48:11.752375 bus /sierra_3: Setting Powered False 03:48:12.853917 bus /sierra_3: Setting Powered False 03:48:13.973842 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2354 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 03:48:15.119740 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:48:15.131012 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 03:48:15.188220 tst mo_mt_call_osmux.py: using LAC 18857 03:48:15.312627 tst mo_mt_call_osmux.py: using RAC 242 03:48:15.430527 tst mo_mt_call_osmux.py: using CellId 18857 03:48:15.548101 tst mo_mt_call_osmux.py: using BVCI 18858 03:48:15.656442 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:48:15.667344 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:48:15.677876 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:48:15.688316 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:48:15.698814 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:48:15.709373 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 03:48:15.827179 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 03:48:15.977605 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:48:16.591056 run create_hlr_db(pid=20332): Launched 03:48:16.757243 bus /sierra_2: Setting Powered False 03:48:17.818536 run create_hlr_db(pid=20332): Terminated: ok {rc=0} 03:48:18.259269 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20334): Launched 03:48:18.583869 run osmo-hlr_10.42.42.2(pid=20335): Launched 03:48:18.708531 run osmo-stp_10.42.42.5: Starting osmo-stp 03:48:19.265137 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20337): Launched 03:48:19.588848 run osmo-stp_10.42.42.5(pid=20338): Launched 03:48:19.713051 run osmo-msc_10.42.42.6: Starting osmo-msc 03:48:20.304330 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20340): Launched 03:48:20.629474 run osmo-msc_10.42.42.6(pid=20341): Launched 03:48:20.811837 run osmo-stp_10.42.42.5(pid=20338): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20338)] 03:48:20.948938 run osmo-stp_10.42.42.5(pid=20338): stdout: | (launched: 2022-12-09_03:48:19.530169) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:48:21.086264 run osmo-stp_10.42.42.5(pid=20338): stderr: | 20221209034819723 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034819723 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034819723 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034819724 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034819724 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034819724 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034819724 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:48:21.222374 run osmo-stp_10.42.42.5(pid=20338): stdout: | (launched: 2022-12-09_03:48:19.530169) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:48:21.352602 run osmo-stp_10.42.42.5(pid=20338): stderr: | 20221209034819723 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034819723 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034819723 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034819724 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034819724 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034819724 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034819724 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:48:21.507669 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20338): Process ended prematurely: osmo-stp_10.42.42.5(pid=20338) [trial-2354↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20338)] [trial-2354↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 03:48:21.517455 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 03:48:21.546478 run osmo-hlr_10.42.42.2(pid=20335): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20335)] 03:48:21.597627 run osmo-hlr_10.42.42.2(pid=20335): stdout: | (launched: 2022-12-09_03:48:18.525069) 03:48:21.650389 run osmo-hlr_10.42.42.2(pid=20335): stderr: | 20221209034818723 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209034818723 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209034818723 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209034818723 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209034818723 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209034818723 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209034818736 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209034818746 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209034818746 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209034818746 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:48:21.724307 run osmo-msc_10.42.42.6(pid=20341): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20341)] 03:48:21.775093 run osmo-msc_10.42.42.6(pid=20341): stdout: | (launched: 2022-12-09_03:48:20.570687) 03:48:21.827897 run osmo-msc_10.42.42.6(pid=20341): stderr: | 20221209034820891 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209034820891 DLGLOBAL DEBUG validating counter group 0x7feaf2bc3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209034820891 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209034820891 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209034820891 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209034820892 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209034820893 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209034820894 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209034820894 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209034820894 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:48:21.880836 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20334): Terminating (SIGTERM) 03:48:21.923159 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20337): Terminating (SIGTERM) 03:48:21.965848 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20340): Terminating (SIGTERM) 03:48:22.008600 --- ParallelTerminationStrategy: PID 20334 died... 03:48:22.028599 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20334): Terminated: ok {rc=0} 03:48:22.076037 --- ParallelTerminationStrategy: PID 20337 died... 03:48:22.095932 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20337): Terminated: ok {rc=0} 03:48:22.142993 --- ParallelTerminationStrategy: PID 20340 died... 03:48:22.162851 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20340): Terminated: ok {rc=0} 03:48:22.251682 bus /sierra_3: Setting Powered False 03:48:23.351284 bus /sierra_3: Setting Powered False 03:48:24.467814 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 voice:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 emergency:oc2g --------------------------------------------------------------------- 03:48:25.700510 tst emergency:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:48:25.705282 tst emergency:oc2g: Verifying 1 x bts (candidates: 11) 03:48:25.726949 tst emergency:oc2g: Verifying 6 x ip_address (candidates: 9) 03:48:25.754527 tst emergency:oc2g: Verifying 4 x modem (candidates: 12) 03:48:25.841635 tst emergency:oc2g: Reserving 1 x bts (candidates: 11) 03:48:25.862191 tst emergency:oc2g: Reserving 6 x ip_address (candidates: 9) 03:48:25.888254 tst emergency:oc2g: Reserving 4 x modem (candidates: 12) 03:48:26.472549 tst emergency:oc2g: RESERVED RESOURCES for emergency: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2354 emergency:oc2g emergency_mo_mt_call.py ---------------------------------------------- 03:48:26.478041 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 03:48:26.488834 tst emergency:oc2g: Using 1 x bts (candidates: 1) 03:48:26.526208 tst emergency_mo_mt_call.py: using LAC 18858 03:48:26.652413 tst emergency_mo_mt_call.py: using RAC 243 03:48:26.777191 tst emergency_mo_mt_call.py: using CellId 18858 03:48:26.901895 tst emergency_mo_mt_call.py: using BVCI 18859 03:48:27.017260 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 03:48:27.028132 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 03:48:27.039000 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 03:48:27.050185 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 03:48:27.061299 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 03:48:27.072294 tst emergency:oc2g: Using 1 x modem (candidates: 4) 03:48:27.185209 tst emergency:oc2g: Using 1 x modem (candidates: 4) 03:48:27.302945 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:48:27.797089 run create_hlr_db(pid=20346): Launched 03:48:27.918469 bus /sierra_2: Setting Powered False 03:48:28.981250 run create_hlr_db(pid=20346): Terminated: ok {rc=0} 03:48:29.404745 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20348): Launched 03:48:29.700271 run osmo-hlr_10.42.42.2(pid=20349): Launched 03:48:29.814211 run osmo-stp_10.42.42.5: Starting osmo-stp 03:48:30.326223 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20351): Launched 03:48:30.619725 run osmo-stp_10.42.42.5(pid=20352): Launched 03:48:30.742793 tst emergency_mo_mt_call.py: using MSISDN 7014 03:48:30.914672 run osmo-msc_10.42.42.6: Starting osmo-msc 03:48:31.507472 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20354): Launched 03:48:31.829802 run osmo-msc_10.42.42.6(pid=20355): Launched 03:48:32.065019 run osmo-stp_10.42.42.5(pid=20352): ERR: Terminated: ERROR {rc=1} [trial-2354↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20352)] 03:48:32.230144 run osmo-stp_10.42.42.5(pid=20352): stdout: | (launched: 2022-12-09_03:48:30.566004) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:48:32.376705 run osmo-stp_10.42.42.5(pid=20352): stderr: | 20221209034830734 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034830734 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034830734 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034830735 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034830735 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034830735 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034830736 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:48:32.502871 run osmo-stp_10.42.42.5(pid=20352): stdout: | (launched: 2022-12-09_03:48:30.566004) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:48:32.619905 run osmo-stp_10.42.42.5(pid=20352): stderr: | 20221209034830734 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034830734 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034830734 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034830735 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034830735 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034830735 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034830736 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:48:32.760016 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=20352): Process ended prematurely: osmo-stp_10.42.42.5(pid=20352) [trial-2354↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20352)] [trial-2354↪emergency:oc2g↪emergency_mo_mt_call.py:19] 03:48:32.768221 tst emergency_mo_mt_call.py:19: Test FAILED (6.3 sec) 03:48:32.794409 run osmo-hlr_10.42.42.2(pid=20349): ERR: Terminated: ERROR {rc=237} [trial-2354↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20349)] 03:48:32.842468 run osmo-hlr_10.42.42.2(pid=20349): stdout: | (launched: 2022-12-09_03:48:29.646199) 03:48:32.892112 run osmo-hlr_10.42.42.2(pid=20349): stderr: | 20221209034829821 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209034829821 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209034829821 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209034829821 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209034829821 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209034829821 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209034829833 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/emergency:oc2g/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209034829842 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209034829842 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209034829842 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:48:32.961558 run osmo-msc_10.42.42.6(pid=20355): ERR: Terminated: ERROR {rc=2} [trial-2354↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20355)] 03:48:33.009783 run osmo-msc_10.42.42.6(pid=20355): stdout: | (launched: 2022-12-09_03:48:31.767563) 03:48:33.059611 run osmo-msc_10.42.42.6(pid=20355): stderr: | 20221209034832320 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209034832321 DLGLOBAL DEBUG validating counter group 0x7f4882762c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209034832321 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209034832321 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209034832321 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209034832321 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209034832323 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209034832323 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209034832324 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209034832324 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:48:33.109857 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20348): Terminating (SIGTERM) 03:48:33.149619 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20351): Terminating (SIGTERM) 03:48:33.189399 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20354): Terminating (SIGTERM) 03:48:33.229586 --- ParallelTerminationStrategy: PID 20348 died... 03:48:33.248891 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20348): Terminated: ok {rc=0} 03:48:33.293117 --- ParallelTerminationStrategy: PID 20351 died... 03:48:33.311973 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20351): Terminated: ok {rc=0} 03:48:33.356099 --- ParallelTerminationStrategy: PID 20354 died... 03:48:33.374855 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20354): Terminated: ok {rc=0} 03:48:33.460814 bus /sierra_3: Setting Powered False 03:48:34.560725 bus /sierra_3: Setting Powered False 03:48:35.675728 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2354 emergency:oc2g emergency_preemptive_call.py ---------------------------------------------- 03:48:36.764281 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 03:48:36.775372 tst emergency:oc2g: Using 1 x bts (candidates: 1) 03:48:36.813238 tst emergency_preemptive_call.py: using LAC 18859 03:48:36.929188 tst emergency_preemptive_call.py: using RAC 244 03:48:37.045152 tst emergency_preemptive_call.py: using CellId 18859 03:48:37.160726 tst emergency_preemptive_call.py: using BVCI 18860 03:48:37.267196 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 03:48:37.277714 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 03:48:37.288040 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 03:48:37.298404 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 03:48:37.308636 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 03:48:37.318866 tst emergency:oc2g: Using 1 x modem (candidates: 4) 03:48:37.435139 tst emergency:oc2g: Using 1 x modem (candidates: 4) 03:48:37.555527 tst emergency:oc2g: Using 1 x modem (candidates: 4) 03:48:37.669339 tst emergency:oc2g: Using 1 x modem (candidates: 4) 03:48:37.788247 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:48:38.285669 run create_hlr_db(pid=20357): Launched 03:48:38.409054 bus /sierra_2: Setting Powered False 03:48:39.472579 run create_hlr_db(pid=20357): Terminated: ok {rc=0} 03:48:39.897679 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20359): Launched 03:48:40.194169 run osmo-hlr_10.42.42.2(pid=20360): Launched 03:48:40.306528 run osmo-stp_10.42.42.5: Starting osmo-stp 03:48:40.812840 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20362): Launched 03:48:41.107137 run osmo-stp_10.42.42.5(pid=20363): Launched 03:48:41.229758 tst emergency_preemptive_call.py: using MSISDN 7015 03:48:41.379590 run osmo-msc_10.42.42.6: Starting osmo-msc 03:48:41.908864 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20365): Launched 03:48:42.204726 run osmo-msc_10.42.42.6(pid=20366): Launched 03:48:42.370695 run osmo-stp_10.42.42.5(pid=20363): ERR: Terminated: ERROR {rc=1} [trial-2354↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20363)] 03:48:42.503791 run osmo-stp_10.42.42.5(pid=20363): stdout: | (launched: 2022-12-09_03:48:41.053380) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:48:42.642201 run osmo-stp_10.42.42.5(pid=20363): stderr: | 20221209034841222 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034841223 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034841223 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034841223 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034841224 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034841224 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034841224 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:48:42.776607 run osmo-stp_10.42.42.5(pid=20363): stdout: | (launched: 2022-12-09_03:48:41.053380) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:48:42.903535 run osmo-stp_10.42.42.5(pid=20363): stderr: | 20221209034841222 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034841223 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034841223 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034841223 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034841224 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034841224 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034841224 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:48:43.055177 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=20363): Process ended prematurely: osmo-stp_10.42.42.5(pid=20363) [trial-2354↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20363)] [trial-2354↪emergency:oc2g↪emergency_preemptive_call.py:32] 03:48:43.064177 tst emergency_preemptive_call.py:32: Test FAILED (6.3 sec) 03:48:43.093399 run osmo-hlr_10.42.42.2(pid=20360): ERR: Terminated: ERROR {rc=237} [trial-2354↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20360)] 03:48:43.144580 run osmo-hlr_10.42.42.2(pid=20360): stdout: | (launched: 2022-12-09_03:48:40.139654) 03:48:43.197727 run osmo-hlr_10.42.42.2(pid=20360): stderr: | 20221209034840314 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209034840314 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209034840315 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209034840315 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209034840315 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209034840315 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209034840326 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/emergency:oc2g/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209034840335 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209034840335 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209034840335 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:48:43.271126 run osmo-msc_10.42.42.6(pid=20366): ERR: Terminated: ERROR {rc=2} [trial-2354↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20366)] 03:48:43.322549 run osmo-msc_10.42.42.6(pid=20366): stdout: | (launched: 2022-12-09_03:48:42.150140) 03:48:43.375564 run osmo-msc_10.42.42.6(pid=20366): stderr: | 20221209034842422 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209034842422 DLGLOBAL DEBUG validating counter group 0x7f092307bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209034842422 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209034842423 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209034842423 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209034842423 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209034842425 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209034842425 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209034842425 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209034842425 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:48:43.428897 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20359): Terminating (SIGTERM) 03:48:43.472070 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20362): Terminating (SIGTERM) 03:48:43.514783 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20365): Terminating (SIGTERM) 03:48:43.558055 --- ParallelTerminationStrategy: PID 20359 died... 03:48:43.578065 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20359): Terminated: ok {rc=0} 03:48:43.625450 --- ParallelTerminationStrategy: PID 20362 died... 03:48:43.645253 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20362): Terminated: ok {rc=0} 03:48:43.693141 --- ParallelTerminationStrategy: PID 20365 died... 03:48:43.713520 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20365): Terminated: ok {rc=0} 03:48:43.804089 bus /sierra_9: Setting Powered False 03:48:44.903179 bus /sierra_9: Setting Powered False 03:48:46.023635 bus /sierra_8: Setting Powered False 03:48:47.130234 bus /sierra_8: Setting Powered False 03:48:48.243612 bus /sierra_3: Setting Powered False 03:48:49.343340 bus /sierra_3: Setting Powered False 03:48:50.463813 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 emergency:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 gprs:oc2g --------------------------------------------------------------------- 03:48:51.732306 tst gprs:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:48:51.736877 tst gprs:oc2g: Verifying 1 x bts (candidates: 11) 03:48:51.758464 tst gprs:oc2g: Verifying 9 x ip_address (candidates: 9) 03:48:51.798468 tst gprs:oc2g: Verifying 4 x modem (candidates: 12) 03:48:51.888421 tst gprs:oc2g: Reserving 1 x bts (candidates: 11) 03:48:51.910369 tst gprs:oc2g: Reserving 9 x ip_address (candidates: 9) 03:48:51.950025 tst gprs:oc2g: Reserving 4 x modem (candidates: 12) 03:48:52.537207 tst gprs:oc2g: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2354 gprs:oc2g cs_paging_gprs_active.py ---------------------------------------------- 03:48:52.588926 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:48:52.599468 tst gprs:oc2g: Using 1 x bts (candidates: 1) 03:48:52.633353 tst cs_paging_gprs_active.py: using LAC 18860 03:48:52.754055 tst cs_paging_gprs_active.py: using RAC 245 03:48:52.871236 tst cs_paging_gprs_active.py: using CellId 18860 03:48:52.988849 tst cs_paging_gprs_active.py: using BVCI 18861 03:48:53.098864 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:48:53.109788 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:48:53.120054 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:48:53.131026 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:48:53.141787 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:48:53.152529 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:48:53.163444 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:48:53.174183 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:48:53.185102 tst gprs:oc2g: Using 1 x modem (candidates: 4) 03:48:53.299545 tst gprs:oc2g: Using 1 x modem (candidates: 4) 03:48:53.418089 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 03:48:53.637855 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:48:53.964018 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20371): Launched 03:48:54.247278 run iperf3-srv_10.42.42.10(pid=20372): Launched 03:48:54.369741 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 03:48:54.588279 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:48:54.913938 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20373): Launched 03:48:55.196868 run iperf3-srv_10.42.42.10(pid=20374): Launched 03:48:55.319305 tst cs_paging_gprs_active.py:38: start network... 03:48:55.538658 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:48:56.040751 run create_hlr_db(pid=20375): Launched 03:48:56.165487 bus /sierra_2: Setting Powered False 03:48:57.225738 run create_hlr_db(pid=20375): Terminated: ok {rc=0} 03:48:57.675152 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20377): Launched 03:48:57.999584 run osmo-hlr_10.42.42.2(pid=20378): Launched 03:48:58.124293 run osmo-stp_10.42.42.5: Starting osmo-stp 03:48:58.681589 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20380): Launched 03:48:59.006192 run osmo-stp_10.42.42.5(pid=20381): Launched 03:48:59.130324 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:48:59.689400 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20383): Launched 03:48:59.813897 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:49:00.087718 run patchelf(pid=20384): Launched 03:49:00.268459 run osmo-stp_10.42.42.5(pid=20381): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20381)] 03:49:00.405241 run osmo-stp_10.42.42.5(pid=20381): stdout: | (launched: 2022-12-09_03:48:58.947735) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:49:00.543723 run osmo-stp_10.42.42.5(pid=20381): stderr: | 20221209034859139 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034859139 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034859139 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034859140 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034859140 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034859140 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034859140 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:49:00.682729 run osmo-stp_10.42.42.5(pid=20381): stdout: | (launched: 2022-12-09_03:48:58.947735) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:49:00.816179 run osmo-stp_10.42.42.5(pid=20381): stderr: | 20221209034859139 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034859139 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034859139 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034859140 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034859140 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034859140 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034859140 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:49:00.994220 run patchelf(pid=20384): Terminating (SIGINT) 03:49:01.172161 run patchelf(pid=20384): Terminated: ok {rc=0} 03:49:01.300342 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=20381): Process ended prematurely: osmo-stp_10.42.42.5(pid=20381) [trial-2354↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20381)] [trial-2354↪gprs:oc2g↪cs_paging_gprs_active.py:38] 03:49:01.310576 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 03:49:01.339916 run osmo-hlr_10.42.42.2(pid=20378): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:oc2g↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20378)] 03:49:01.391878 run osmo-hlr_10.42.42.2(pid=20378): stdout: | (launched: 2022-12-09_03:48:57.940625) 03:49:01.444263 run osmo-hlr_10.42.42.2(pid=20378): stderr: | 20221209034858138 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209034858138 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209034858138 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209034858138 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209034858139 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209034858139 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209034858151 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:oc2g/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209034858159 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209034858160 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209034858160 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:49:01.497187 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20371): Terminating (SIGTERM) 03:49:01.540309 run iperf3-srv_10.42.42.10(pid=20372): Terminating (SIGTERM) 03:49:01.587348 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20373): Terminating (SIGTERM) 03:49:01.630343 run iperf3-srv_10.42.42.10(pid=20374): Terminating (SIGTERM) 03:49:01.675443 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20377): Terminating (SIGTERM) 03:49:01.718978 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20380): Terminating (SIGTERM) 03:49:01.763156 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20383): Terminating (SIGTERM) 03:49:01.808688 --- ParallelTerminationStrategy: PID 20371 died... 03:49:01.828708 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20371): Terminated: ok {rc=0} 03:49:01.876301 --- ParallelTerminationStrategy: PID 20372 died... 03:49:01.896681 run iperf3-srv_10.42.42.10(pid=20372): Terminated {rc=256} 03:49:01.942905 --- ParallelTerminationStrategy: PID 20373 died... 03:49:01.962408 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20373): Terminated: ok {rc=0} 03:49:02.009488 --- ParallelTerminationStrategy: PID 20374 died... 03:49:02.030524 run iperf3-srv_10.42.42.10(pid=20374): Terminated {rc=256} 03:49:02.076415 --- ParallelTerminationStrategy: PID 20377 died... 03:49:02.096234 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20377): Terminated: ok {rc=0} 03:49:02.143406 --- ParallelTerminationStrategy: PID 20380 died... 03:49:02.163219 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20380): Terminated: ok {rc=0} 03:49:02.209959 --- ParallelTerminationStrategy: PID 20383 died... 03:49:02.229386 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20383): Terminated: ok {rc=0} 03:49:02.315929 bus /gobi_0: Setting Powered False 03:49:03.416584 bus /gobi_0: Setting Powered False 03:49:04.533497 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:oc2g iperf3.py ---------------------------------------------- 03:49:05.675129 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:49:05.686188 tst gprs:oc2g: Using 1 x bts (candidates: 1) 03:49:05.720652 tst iperf3.py: using LAC 18861 03:49:05.839800 tst iperf3.py: using RAC 246 03:49:05.959641 tst iperf3.py: using CellId 18861 03:49:06.078509 tst iperf3.py: using BVCI 18862 03:49:06.190333 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:49:06.200782 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:49:06.211091 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:49:06.221793 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:49:06.232408 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:49:06.243127 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:49:06.253972 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:49:06.264633 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:49:06.275491 tst gprs:oc2g: Using 1 x modem (candidates: 4) 03:49:06.399966 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 03:49:06.622363 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:49:06.948848 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20385): Launched 03:49:07.232096 run iperf3-srv_10.42.42.10(pid=20386): Launched 03:49:07.355730 tst iperf3.py:8: start network... 03:49:07.575110 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:49:08.079182 run create_hlr_db(pid=20387): Launched 03:49:08.204044 bus /gobi_6: Setting Powered False 03:49:09.268015 run create_hlr_db(pid=20387): Terminated: ok {rc=0} 03:49:09.721195 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20389): Launched 03:49:10.047026 run osmo-hlr_10.42.42.2(pid=20390): Launched 03:49:10.172097 run osmo-stp_10.42.42.5: Starting osmo-stp 03:49:10.730760 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20392): Launched 03:49:11.055479 run osmo-stp_10.42.42.5(pid=20393): Launched 03:49:11.180268 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:49:11.740929 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20395): Launched 03:49:11.866704 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:49:12.146001 run patchelf(pid=20396): Launched 03:49:12.327257 run osmo-stp_10.42.42.5(pid=20393): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20393)] 03:49:12.465115 run osmo-stp_10.42.42.5(pid=20393): stdout: | (launched: 2022-12-09_03:49:10.996576) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:49:12.603846 run osmo-stp_10.42.42.5(pid=20393): stderr: | 20221209034911187 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034911187 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034911187 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034911188 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034911188 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034911188 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034911188 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:49:12.743630 run osmo-stp_10.42.42.5(pid=20393): stdout: | (launched: 2022-12-09_03:49:10.996576) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:49:12.877113 run osmo-stp_10.42.42.5(pid=20393): stderr: | 20221209034911187 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034911187 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034911187 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034911188 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034911188 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034911188 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034911188 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:49:13.034413 run patchelf(pid=20396): Terminating (SIGINT) 03:49:13.216570 run patchelf(pid=20396): Terminated: ok {rc=0} 03:49:13.348135 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20393): Process ended prematurely: osmo-stp_10.42.42.5(pid=20393) [trial-2354↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20393)] [trial-2354↪gprs:oc2g↪iperf3.py:8] 03:49:13.358370 tst iperf3.py:8: Test FAILED (7.7 sec) 03:49:13.387972 run osmo-hlr_10.42.42.2(pid=20390): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:oc2g↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20390)] 03:49:13.438824 run osmo-hlr_10.42.42.2(pid=20390): stdout: | (launched: 2022-12-09_03:49:09.986886) 03:49:13.491545 run osmo-hlr_10.42.42.2(pid=20390): stderr: | 20221209034910187 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209034910187 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209034910187 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209034910187 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209034910187 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209034910187 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209034910199 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:oc2g/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209034910207 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209034910208 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209034910208 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:49:13.545091 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20385): Terminating (SIGTERM) 03:49:13.587790 run iperf3-srv_10.42.42.10(pid=20386): Terminating (SIGTERM) 03:49:13.630354 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20389): Terminating (SIGTERM) 03:49:13.673156 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20392): Terminating (SIGTERM) 03:49:13.716034 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20395): Terminating (SIGTERM) 03:49:13.759261 --- ParallelTerminationStrategy: PID 20385 died... 03:49:13.779532 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20385): Terminated: ok {rc=0} 03:49:13.827144 --- ParallelTerminationStrategy: PID 20386 died... 03:49:13.846989 run iperf3-srv_10.42.42.10(pid=20386): Terminated {rc=256} 03:49:13.894028 --- ParallelTerminationStrategy: PID 20389 died... 03:49:13.913983 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20389): Terminated: ok {rc=0} 03:49:13.961291 --- ParallelTerminationStrategy: PID 20392 died... 03:49:13.981212 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20392): Terminated: ok {rc=0} 03:49:14.028483 --- ParallelTerminationStrategy: PID 20395 died... 03:49:14.048689 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20395): Terminated: ok {rc=0} 03:49:14.137932 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:oc2g iperf3m4.py ---------------------------------------------- 03:49:15.288222 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:49:15.299681 tst gprs:oc2g: Using 1 x bts (candidates: 1) 03:49:15.335861 tst iperf3m4.py: using LAC 18862 03:49:15.464058 tst iperf3m4.py: using RAC 247 03:49:15.590773 tst iperf3m4.py: using CellId 18862 03:49:15.719838 tst iperf3m4.py: using BVCI 18863 03:49:15.830112 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:49:15.841087 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:49:15.852516 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:49:15.864134 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:49:15.875130 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:49:15.887928 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:49:15.901424 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:49:15.916688 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:49:15.927923 tst gprs:oc2g: Using 1 x modem (candidates: 4) 03:49:16.052320 tst gprs:oc2g: Using 1 x modem (candidates: 4) 03:49:16.174492 tst gprs:oc2g: Using 1 x modem (candidates: 4) 03:49:16.308519 tst gprs:oc2g: Using 1 x modem (candidates: 4) 03:49:16.423351 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 03:49:16.629897 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:49:16.947426 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20397): Launched 03:49:17.233521 run iperf3-srv_10.42.42.10(pid=20399): Launched 03:49:17.352664 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 03:49:17.554825 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:49:17.856526 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20400): Launched 03:49:18.118500 run iperf3-srv_10.42.42.10(pid=20401): Launched 03:49:18.231527 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 03:49:18.431772 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:49:18.732746 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20402): Launched 03:49:18.994457 run iperf3-srv_10.42.42.10(pid=20403): Launched 03:49:19.107371 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 03:49:19.306645 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:49:19.606648 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20404): Launched 03:49:19.867949 run iperf3-srv_10.42.42.10(pid=20405): Launched 03:49:19.980425 tst iperf3m4.py:8: start network... 03:49:20.179809 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:49:20.644558 run create_hlr_db(pid=20406): Launched 03:49:20.767812 bus /gobi_6: Setting Powered False 03:49:21.828896 run create_hlr_db(pid=20406): Terminated: ok {rc=0} 03:49:22.248519 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20408): Launched 03:49:22.549860 run osmo-hlr_10.42.42.2(pid=20409): Launched 03:49:22.664660 run osmo-stp_10.42.42.5: Starting osmo-stp 03:49:23.194978 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20411): Launched 03:49:23.494872 run osmo-stp_10.42.42.5(pid=20412): Launched 03:49:23.609218 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:49:24.126857 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20414): Launched 03:49:24.241962 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:49:24.496078 run patchelf(pid=20415): Launched 03:49:24.663214 run osmo-stp_10.42.42.5(pid=20412): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20412)] 03:49:24.789983 run osmo-stp_10.42.42.5(pid=20412): stdout: | (launched: 2022-12-09_03:49:23.439762) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:49:24.918209 run osmo-stp_10.42.42.5(pid=20412): stderr: | 20221209034923607 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034923608 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034923608 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034923608 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034923609 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034923609 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034923609 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:49:25.046830 run osmo-stp_10.42.42.5(pid=20412): stdout: | (launched: 2022-12-09_03:49:23.439762) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:49:25.169656 run osmo-stp_10.42.42.5(pid=20412): stderr: | 20221209034923607 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034923608 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034923608 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034923608 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034923609 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034923609 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034923609 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:49:25.315142 run patchelf(pid=20415): Terminating (SIGINT) 03:49:25.484277 run patchelf(pid=20415): Terminated: ok {rc=0} 03:49:25.605911 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20412): Process ended prematurely: osmo-stp_10.42.42.5(pid=20412) [trial-2354↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20412)] [trial-2354↪gprs:oc2g↪iperf3m4.py:8] 03:49:25.615230 tst iperf3m4.py:8: Test FAILED (10.4 sec) 03:49:25.642733 run osmo-hlr_10.42.42.2(pid=20409): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:oc2g↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20409)] 03:49:25.690297 run osmo-hlr_10.42.42.2(pid=20409): stdout: | (launched: 2022-12-09_03:49:22.494512) 03:49:25.739414 run osmo-hlr_10.42.42.2(pid=20409): stderr: | 20221209034922669 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209034922669 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209034922670 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209034922670 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209034922670 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209034922670 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209034922681 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:oc2g/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209034922691 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209034922691 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209034922691 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:49:25.788842 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20397): Terminating (SIGTERM) 03:49:25.828315 run iperf3-srv_10.42.42.10(pid=20399): Terminating (SIGTERM) 03:49:25.867533 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20400): Terminating (SIGTERM) 03:49:25.906873 run iperf3-srv_10.42.42.10(pid=20401): Terminating (SIGTERM) 03:49:25.946150 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20402): Terminating (SIGTERM) 03:49:25.985566 run iperf3-srv_10.42.42.10(pid=20403): Terminating (SIGTERM) 03:49:26.024783 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20404): Terminating (SIGTERM) 03:49:26.064128 run iperf3-srv_10.42.42.10(pid=20405): Terminating (SIGTERM) 03:49:26.103496 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20408): Terminating (SIGTERM) 03:49:26.142778 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20411): Terminating (SIGTERM) 03:49:26.182105 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20414): Terminating (SIGTERM) 03:49:26.221818 --- ParallelTerminationStrategy: PID 20397 died... 03:49:26.240678 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20397): Terminated: ok {rc=0} 03:49:26.285020 --- ParallelTerminationStrategy: PID 20399 died... 03:49:26.303640 run iperf3-srv_10.42.42.10(pid=20399): Terminated {rc=256} 03:49:26.347984 --- ParallelTerminationStrategy: PID 20400 died... 03:49:26.366706 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20400): Terminated: ok {rc=0} 03:49:26.410993 --- ParallelTerminationStrategy: PID 20401 died... 03:49:26.429588 run iperf3-srv_10.42.42.10(pid=20401): Terminated {rc=256} 03:49:26.473334 --- ParallelTerminationStrategy: PID 20402 died... 03:49:26.491976 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20402): Terminated: ok {rc=0} 03:49:26.536348 --- ParallelTerminationStrategy: PID 20403 died... 03:49:26.555033 run iperf3-srv_10.42.42.10(pid=20403): Terminated {rc=256} 03:49:26.599032 --- ParallelTerminationStrategy: PID 20404 died... 03:49:26.617763 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20404): Terminated: ok {rc=0} 03:49:26.661609 --- ParallelTerminationStrategy: PID 20405 died... 03:49:26.680364 run iperf3-srv_10.42.42.10(pid=20405): Terminated {rc=256} 03:49:26.724303 --- ParallelTerminationStrategy: PID 20408 died... 03:49:26.743054 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20408): Terminated: ok {rc=0} 03:49:26.786861 --- ParallelTerminationStrategy: PID 20411 died... 03:49:26.805675 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20411): Terminated: ok {rc=0} 03:49:26.849763 --- ParallelTerminationStrategy: PID 20414 died... 03:49:26.868351 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20414): Terminated: ok {rc=0} 03:49:26.951874 bus /gobi_4: Setting Powered False 03:49:28.050785 bus /gobi_4: Setting Powered False 03:49:29.167372 bus /gobi_1: Setting Powered False 03:49:30.265250 bus /gobi_1: Setting Powered False 03:49:31.389742 bus /gobi_0: Setting Powered False 03:49:32.495936 bus /gobi_0: Setting Powered False 03:49:33.612272 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:oc2g ping.py ---------------------------------------------- 03:49:34.715594 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:49:34.726699 tst gprs:oc2g: Using 1 x bts (candidates: 1) 03:49:34.762257 tst ping.py: using LAC 18863 03:49:34.888194 tst ping.py: using RAC 248 03:49:35.013066 tst ping.py: using CellId 18863 03:49:35.137828 tst ping.py: using BVCI 18864 03:49:35.254511 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:49:35.265699 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:49:35.276552 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:49:35.287635 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:49:35.298627 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:49:35.309643 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:49:35.320574 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:49:35.331513 tst gprs:oc2g: Using 1 x modem (candidates: 4) 03:49:35.449197 tst ping.py:19: start network... 03:49:35.663468 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:49:36.155236 run create_hlr_db(pid=20417): Launched 03:49:36.275829 bus /gobi_6: Setting Powered False 03:49:37.339749 run create_hlr_db(pid=20417): Terminated: ok {rc=0} 03:49:37.764861 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20419): Launched 03:49:38.060782 run osmo-hlr_10.42.42.2(pid=20420): Launched 03:49:38.174139 run osmo-stp_10.42.42.5: Starting osmo-stp 03:49:38.689674 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20422): Launched 03:49:38.985704 run osmo-stp_10.42.42.5(pid=20423): Launched 03:49:39.098989 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:49:39.609280 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20425): Launched 03:49:39.723200 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:49:39.972749 run patchelf(pid=20426): Launched 03:49:40.137685 run osmo-stp_10.42.42.5(pid=20423): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20423)] 03:49:40.262646 run osmo-stp_10.42.42.5(pid=20423): stdout: | (launched: 2022-12-09_03:49:38.931270) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:49:40.389293 run osmo-stp_10.42.42.5(pid=20423): stderr: | 20221209034939098 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034939098 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034939098 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034939099 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034939099 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034939099 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034939099 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:49:40.516720 run osmo-stp_10.42.42.5(pid=20423): stdout: | (launched: 2022-12-09_03:49:38.931270) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:49:40.638453 run osmo-stp_10.42.42.5(pid=20423): stderr: | 20221209034939098 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034939098 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034939098 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034939099 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034939099 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034939099 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034939099 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:49:40.782054 run patchelf(pid=20426): Terminating (SIGINT) 03:49:40.949426 run patchelf(pid=20426): Terminated: ok {rc=0} 03:49:41.069525 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=20423): Process ended prematurely: osmo-stp_10.42.42.5(pid=20423) [trial-2354↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20423)] [trial-2354↪gprs:oc2g↪ping.py:22] 03:49:41.078233 tst ping.py:22: Test FAILED (6.4 sec) 03:49:41.105575 run osmo-hlr_10.42.42.2(pid=20420): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:oc2g↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20420)] 03:49:41.153799 run osmo-hlr_10.42.42.2(pid=20420): stdout: | (launched: 2022-12-09_03:49:38.006302) 03:49:41.203669 run osmo-hlr_10.42.42.2(pid=20420): stderr: | 20221209034938182 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209034938182 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209034938182 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209034938182 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209034938183 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209034938183 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209034938194 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:oc2g/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209034938203 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209034938204 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209034938204 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:49:41.253901 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20419): Terminating (SIGTERM) 03:49:41.294387 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20422): Terminating (SIGTERM) 03:49:41.334624 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20425): Terminating (SIGTERM) 03:49:41.375051 --- ParallelTerminationStrategy: PID 20419 died... 03:49:41.394450 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20419): Terminated: ok {rc=0} 03:49:41.438894 --- ParallelTerminationStrategy: PID 20422 died... 03:49:41.457956 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20422): Terminated: ok {rc=0} 03:49:41.502358 --- ParallelTerminationStrategy: PID 20425 died... 03:49:41.521319 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20425): Terminated: ok {rc=0} 03:49:41.605214 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:oc2g ping_idle_ping.py ---------------------------------------------- 03:49:42.692669 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:49:42.704674 tst gprs:oc2g: Using 1 x bts (candidates: 1) 03:49:42.747541 tst ping_idle_ping.py: using LAC 18864 03:49:42.886680 tst ping_idle_ping.py: using RAC 249 03:49:43.018271 tst ping_idle_ping.py: using CellId 18864 03:49:43.145495 tst ping_idle_ping.py: using BVCI 18865 03:49:43.255666 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:49:43.266165 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:49:43.276402 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:49:43.286665 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:49:43.296748 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:49:43.306969 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:49:43.317215 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:49:43.327391 tst gprs:oc2g: Using 1 x modem (candidates: 4) 03:49:43.442923 tst ping_idle_ping.py:24: start network... 03:49:43.640653 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:49:44.101953 run create_hlr_db(pid=20427): Launched 03:49:44.224405 bus /gobi_6: Setting Powered False 03:49:45.284123 run create_hlr_db(pid=20427): Terminated: ok {rc=0} 03:49:45.719276 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20430): Launched 03:49:46.081690 run osmo-hlr_10.42.42.2(pid=20431): Launched 03:49:46.218478 run osmo-stp_10.42.42.5: Starting osmo-stp 03:49:47.014719 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20433): Launched 03:49:47.351265 run osmo-stp_10.42.42.5(pid=20434): Launched 03:49:47.491449 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:49:48.046604 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20436): Launched 03:49:48.169171 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:49:48.438259 run patchelf(pid=20437): Launched 03:49:48.616122 run osmo-stp_10.42.42.5(pid=20434): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20434)] 03:49:48.751230 run osmo-stp_10.42.42.5(pid=20434): stdout: | (launched: 2022-12-09_03:49:47.285627) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:49:48.887922 run osmo-stp_10.42.42.5(pid=20434): stderr: | 20221209034947528 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034947528 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034947528 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034947528 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034947529 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034947529 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034947529 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:49:49.024359 run osmo-stp_10.42.42.5(pid=20434): stdout: | (launched: 2022-12-09_03:49:47.285627) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:49:49.155199 run osmo-stp_10.42.42.5(pid=20434): stderr: | 20221209034947528 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034947528 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034947528 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034947528 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034947529 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034947529 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034947529 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:49:49.310499 run patchelf(pid=20437): Terminating (SIGINT) 03:49:49.489851 run patchelf(pid=20437): Terminated: ok {rc=0} 03:49:49.618862 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=20434): Process ended prematurely: osmo-stp_10.42.42.5(pid=20434) [trial-2354↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20434)] [trial-2354↪gprs:oc2g↪ping_idle_ping.py:27] 03:49:49.628402 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 03:49:49.657214 run osmo-hlr_10.42.42.2(pid=20431): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:oc2g↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20431)] 03:49:49.708051 run osmo-hlr_10.42.42.2(pid=20431): stdout: | (launched: 2022-12-09_03:49:46.003528) 03:49:49.760584 run osmo-hlr_10.42.42.2(pid=20431): stderr: | 20221209034946431 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209034946431 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209034946431 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209034946431 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209034946431 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209034946432 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209034946453 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:oc2g/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209034946475 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209034946475 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209034946475 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:49:49.813460 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20430): Terminating (SIGTERM) 03:49:49.855554 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20433): Terminating (SIGTERM) 03:49:49.897834 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20436): Terminating (SIGTERM) 03:49:49.940212 --- ParallelTerminationStrategy: PID 20430 died... 03:49:49.960308 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20430): Terminated: ok {rc=0} 03:49:50.007288 --- ParallelTerminationStrategy: PID 20433 died... 03:49:50.026984 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20433): Terminated: ok {rc=0} 03:49:50.073839 --- ParallelTerminationStrategy: PID 20436 died... 03:49:50.093636 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20436): Terminated: ok {rc=0} 03:49:50.182577 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2354 gprs:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 gprs:oc2g+mod-bts0-egprs --------------------------------------------------------------------- 03:49:51.470202 tst gprs:oc2g+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:49:51.475193 tst gprs:oc2g+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 03:49:51.495055 tst gprs:oc2g+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 03:49:51.532650 tst gprs:oc2g+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 03:49:51.618340 tst gprs:oc2g+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 03:49:51.638154 tst gprs:oc2g+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 03:49:51.675366 tst gprs:oc2g+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 03:49:52.266234 tst gprs:oc2g+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2354 gprs:oc2g+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 03:49:52.313762 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:49:52.324143 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:49:52.360850 tst cs_paging_gprs_active.py: using LAC 18865 03:49:52.476830 tst cs_paging_gprs_active.py: using RAC 250 03:49:52.593135 tst cs_paging_gprs_active.py: using CellId 18865 03:49:52.712026 tst cs_paging_gprs_active.py: using BVCI 18866 03:49:52.820699 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:49:52.831295 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:49:52.841713 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:49:52.852006 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:49:52.862260 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:49:52.872408 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:49:52.882940 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:49:52.893234 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:49:52.903643 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:49:53.021224 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:49:53.139078 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 03:49:53.354212 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:49:53.673365 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20441): Launched 03:49:53.950624 run iperf3-srv_10.42.42.10(pid=20442): Launched 03:49:54.070371 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 03:49:54.284110 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:49:54.602407 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20443): Launched 03:49:54.879296 run iperf3-srv_10.42.42.10(pid=20444): Launched 03:49:54.999098 tst cs_paging_gprs_active.py:38: start network... 03:49:55.212342 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:49:55.705824 run create_hlr_db(pid=20445): Launched 03:49:55.829319 bus /gobi_6: Setting Powered False 03:49:56.892842 run create_hlr_db(pid=20445): Terminated: ok {rc=0} 03:49:57.317283 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20447): Launched 03:49:57.614807 run osmo-hlr_10.42.42.2(pid=20448): Launched 03:49:57.728687 run osmo-stp_10.42.42.5: Starting osmo-stp 03:49:58.237462 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20450): Launched 03:49:58.534507 run osmo-stp_10.42.42.5(pid=20451): Launched 03:49:58.649152 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:49:59.159490 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20453): Launched 03:49:59.272806 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:49:59.522510 run patchelf(pid=20454): Launched 03:49:59.687485 run osmo-stp_10.42.42.5(pid=20451): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20451)] 03:49:59.813408 run osmo-stp_10.42.42.5(pid=20451): stdout: | (launched: 2022-12-09_03:49:58.480655) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:49:59.940408 run osmo-stp_10.42.42.5(pid=20451): stderr: | 20221209034958651 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034958651 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034958651 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034958651 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034958652 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034958652 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034958652 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:50:00.067623 run osmo-stp_10.42.42.5(pid=20451): stdout: | (launched: 2022-12-09_03:49:58.480655) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:50:00.189658 run osmo-stp_10.42.42.5(pid=20451): stderr: | 20221209034958651 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209034958651 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209034958651 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209034958651 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209034958652 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209034958652 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209034958652 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:50:00.334285 run patchelf(pid=20454): Terminating (SIGINT) 03:50:00.501940 run patchelf(pid=20454): Terminated: ok {rc=0} 03:50:00.623604 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=20451): Process ended prematurely: osmo-stp_10.42.42.5(pid=20451) [trial-2354↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20451)] [trial-2354↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 03:50:00.633155 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 03:50:00.660065 run osmo-hlr_10.42.42.2(pid=20448): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20448)] 03:50:00.707429 run osmo-hlr_10.42.42.2(pid=20448): stdout: | (launched: 2022-12-09_03:49:57.560802) 03:50:00.756532 run osmo-hlr_10.42.42.2(pid=20448): stderr: | 20221209034957735 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209034957735 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209034957735 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209034957735 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209034957735 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209034957735 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209034957758 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:oc2g+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209034957766 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209034957767 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209034957767 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:50:00.806306 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20441): Terminating (SIGTERM) 03:50:00.851427 run iperf3-srv_10.42.42.10(pid=20442): Terminating (SIGTERM) 03:50:00.895411 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20443): Terminating (SIGTERM) 03:50:00.956372 run iperf3-srv_10.42.42.10(pid=20444): Terminating (SIGTERM) 03:50:01.002112 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20447): Terminating (SIGTERM) 03:50:01.047030 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20450): Terminating (SIGTERM) 03:50:01.094881 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20453): Terminating (SIGTERM) 03:50:01.142063 --- ParallelTerminationStrategy: PID 20441 died... 03:50:01.163024 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20441): Terminated: ok {rc=0} 03:50:01.216012 --- ParallelTerminationStrategy: PID 20442 died... 03:50:01.236701 run iperf3-srv_10.42.42.10(pid=20442): Terminated {rc=256} 03:50:01.287013 --- ParallelTerminationStrategy: PID 20443 died... 03:50:01.307560 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20443): Terminated: ok {rc=0} 03:50:01.358116 --- ParallelTerminationStrategy: PID 20444 died... 03:50:01.378904 run iperf3-srv_10.42.42.10(pid=20444): Terminated {rc=256} 03:50:01.433973 --- ParallelTerminationStrategy: PID 20447 died... 03:50:01.457675 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20447): Terminated: ok {rc=0} 03:50:01.514080 --- ParallelTerminationStrategy: PID 20450 died... 03:50:01.537091 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20450): Terminated: ok {rc=0} 03:50:01.590166 --- ParallelTerminationStrategy: PID 20453 died... 03:50:01.613404 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20453): Terminated: ok {rc=0} 03:50:01.715767 bus /gobi_0: Setting Powered False 03:50:02.819899 bus /gobi_0: Setting Powered False 03:50:03.937358 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:oc2g+mod-bts0-egprs iperf3.py ---------------------------------------------- 03:50:05.078322 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:50:05.089549 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:50:05.126042 tst iperf3.py: using LAC 18866 03:50:05.252760 tst iperf3.py: using RAC 251 03:50:05.378895 tst iperf3.py: using CellId 18866 03:50:05.503754 tst iperf3.py: using BVCI 18867 03:50:05.620873 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:50:05.631938 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:50:05.643112 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:50:05.654309 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:50:05.665391 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:50:05.676329 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:50:05.687561 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:50:05.698694 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:50:05.710123 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:50:05.826691 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 03:50:06.024624 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:50:06.321969 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20458): Launched 03:50:06.582046 run iperf3-srv_10.42.42.10(pid=20459): Launched 03:50:06.694337 tst iperf3.py:8: start network... 03:50:06.892050 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:50:07.351155 run create_hlr_db(pid=20460): Launched 03:50:07.474709 bus /gobi_6: Setting Powered False 03:50:08.533580 run create_hlr_db(pid=20460): Terminated: ok {rc=0} 03:50:08.947278 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20462): Launched 03:50:09.243073 run osmo-hlr_10.42.42.2(pid=20463): Launched 03:50:09.355702 run osmo-stp_10.42.42.5: Starting osmo-stp 03:50:09.863166 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20465): Launched 03:50:10.159536 run osmo-stp_10.42.42.5(pid=20466): Launched 03:50:10.273414 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:50:10.784426 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20468): Launched 03:50:10.897883 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:50:11.147813 run patchelf(pid=20469): Launched 03:50:11.312669 run osmo-stp_10.42.42.5(pid=20466): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20466)] 03:50:11.438176 run osmo-stp_10.42.42.5(pid=20466): stdout: | (launched: 2022-12-09_03:50:10.105373) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:50:11.565198 run osmo-stp_10.42.42.5(pid=20466): stderr: | 20221209035010276 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035010276 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035010276 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035010277 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035010277 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035010277 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035010277 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:50:11.692267 run osmo-stp_10.42.42.5(pid=20466): stdout: | (launched: 2022-12-09_03:50:10.105373) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:50:11.814126 run osmo-stp_10.42.42.5(pid=20466): stderr: | 20221209035010276 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035010276 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035010276 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035010277 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035010277 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035010277 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035010277 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:50:11.958660 run patchelf(pid=20469): Terminating (SIGINT) 03:50:12.126498 run patchelf(pid=20469): Terminated: ok {rc=0} 03:50:12.246957 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20466): Process ended prematurely: osmo-stp_10.42.42.5(pid=20466) [trial-2354↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20466)] [trial-2354↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8] 03:50:12.256365 tst iperf3.py:8: Test FAILED (7.2 sec) 03:50:12.283331 run osmo-hlr_10.42.42.2(pid=20463): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:oc2g+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20463)] 03:50:12.330843 run osmo-hlr_10.42.42.2(pid=20463): stdout: | (launched: 2022-12-09_03:50:09.188848) 03:50:12.380153 run osmo-hlr_10.42.42.2(pid=20463): stderr: | 20221209035009365 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209035009365 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209035009365 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209035009365 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209035009365 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209035009365 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209035009376 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:oc2g+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209035009386 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209035009386 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209035009387 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:50:12.429844 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20458): Terminating (SIGTERM) 03:50:12.469670 run iperf3-srv_10.42.42.10(pid=20459): Terminating (SIGTERM) 03:50:12.509321 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20462): Terminating (SIGTERM) 03:50:12.549334 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20465): Terminating (SIGTERM) 03:50:12.589108 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20468): Terminating (SIGTERM) 03:50:12.628825 --- ParallelTerminationStrategy: PID 20458 died... 03:50:12.647614 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20458): Terminated: ok {rc=0} 03:50:12.691997 --- ParallelTerminationStrategy: PID 20459 died... 03:50:12.710826 run iperf3-srv_10.42.42.10(pid=20459): Terminated {rc=256} 03:50:12.754801 --- ParallelTerminationStrategy: PID 20462 died... 03:50:12.773597 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20462): Terminated: ok {rc=0} 03:50:12.817687 --- ParallelTerminationStrategy: PID 20465 died... 03:50:12.836422 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20465): Terminated: ok {rc=0} 03:50:12.880805 --- ParallelTerminationStrategy: PID 20468 died... 03:50:12.899823 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20468): Terminated: ok {rc=0} 03:50:12.986276 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:oc2g+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 03:50:14.134904 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:50:14.146445 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:50:14.188693 tst iperf3m4.py: using LAC 18867 03:50:14.304465 tst iperf3m4.py: using RAC 252 03:50:14.419771 tst iperf3m4.py: using CellId 18867 03:50:14.534519 tst iperf3m4.py: using BVCI 18868 03:50:14.643153 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:50:14.653964 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:50:14.664592 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:50:14.675074 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:50:14.685403 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:50:14.695663 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:50:14.706630 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:50:14.717023 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:50:14.727590 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:50:14.848534 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:50:14.967793 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:50:15.089882 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:50:15.208631 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 03:50:15.423355 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:50:15.743818 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20470): Launched 03:50:16.055761 run iperf3-srv_10.42.42.10(pid=20471): Launched 03:50:16.174276 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 03:50:16.381826 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:50:16.697716 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20472): Launched 03:50:16.974139 run iperf3-srv_10.42.42.10(pid=20473): Launched 03:50:17.100041 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 03:50:17.301694 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:50:17.600301 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20474): Launched 03:50:17.858545 run iperf3-srv_10.42.42.10(pid=20475): Launched 03:50:17.969991 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 03:50:18.167703 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:50:18.464852 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20476): Launched 03:50:18.722892 run iperf3-srv_10.42.42.10(pid=20477): Launched 03:50:18.835209 tst iperf3m4.py:8: start network... 03:50:19.033107 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:50:19.491769 run create_hlr_db(pid=20478): Launched 03:50:19.613800 bus /gobi_6: Setting Powered False 03:50:20.673499 run create_hlr_db(pid=20478): Terminated: ok {rc=0} 03:50:21.089255 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20480): Launched 03:50:21.408280 run osmo-hlr_10.42.42.2(pid=20481): Launched 03:50:21.530884 run osmo-stp_10.42.42.5: Starting osmo-stp 03:50:22.082291 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20483): Launched 03:50:22.400451 run osmo-stp_10.42.42.5(pid=20484): Launched 03:50:22.522817 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:50:23.072180 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20486): Launched 03:50:23.196031 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:50:23.465674 run patchelf(pid=20487): Launched 03:50:23.644463 run osmo-stp_10.42.42.5(pid=20484): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20484)] 03:50:23.780242 run osmo-stp_10.42.42.5(pid=20484): stdout: | (launched: 2022-12-09_03:50:22.342629) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:50:23.917853 run osmo-stp_10.42.42.5(pid=20484): stderr: | 20221209035022529 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035022529 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035022530 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035022530 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035022530 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035022531 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035022531 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:50:24.054949 run osmo-stp_10.42.42.5(pid=20484): stdout: | (launched: 2022-12-09_03:50:22.342629) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:50:24.186108 run osmo-stp_10.42.42.5(pid=20484): stderr: | 20221209035022529 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035022529 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035022530 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035022530 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035022530 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035022531 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035022531 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:50:24.341556 run patchelf(pid=20487): Terminating (SIGINT) 03:50:24.521807 run patchelf(pid=20487): Terminated: ok {rc=0} 03:50:24.651566 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20484): Process ended prematurely: osmo-stp_10.42.42.5(pid=20484) [trial-2354↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20484)] [trial-2354↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8] 03:50:24.661767 tst iperf3m4.py:8: Test FAILED (10.6 sec) 03:50:24.690993 run osmo-hlr_10.42.42.2(pid=20481): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20481)] 03:50:24.742502 run osmo-hlr_10.42.42.2(pid=20481): stdout: | (launched: 2022-12-09_03:50:21.350514) 03:50:24.795307 run osmo-hlr_10.42.42.2(pid=20481): stderr: | 20221209035021546 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209035021546 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209035021546 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209035021546 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209035021546 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209035021546 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209035021558 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:oc2g+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209035021566 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209035021566 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209035021566 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:50:24.848411 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20470): Terminating (SIGTERM) 03:50:24.890896 run iperf3-srv_10.42.42.10(pid=20471): Terminating (SIGTERM) 03:50:24.933311 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20472): Terminating (SIGTERM) 03:50:24.976069 run iperf3-srv_10.42.42.10(pid=20473): Terminating (SIGTERM) 03:50:25.018418 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20474): Terminating (SIGTERM) 03:50:25.061005 run iperf3-srv_10.42.42.10(pid=20475): Terminating (SIGTERM) 03:50:25.103478 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20476): Terminating (SIGTERM) 03:50:25.146100 run iperf3-srv_10.42.42.10(pid=20477): Terminating (SIGTERM) 03:50:25.188772 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20480): Terminating (SIGTERM) 03:50:25.231328 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20483): Terminating (SIGTERM) 03:50:25.274076 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20486): Terminating (SIGTERM) 03:50:25.316741 --- ParallelTerminationStrategy: PID 20470 died... 03:50:25.336922 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20470): Terminated: ok {rc=0} 03:50:25.384645 --- ParallelTerminationStrategy: PID 20471 died... 03:50:25.404334 run iperf3-srv_10.42.42.10(pid=20471): Terminated {rc=256} 03:50:25.451721 --- ParallelTerminationStrategy: PID 20472 died... 03:50:25.471633 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20472): Terminated: ok {rc=0} 03:50:25.518873 --- ParallelTerminationStrategy: PID 20473 died... 03:50:25.538558 run iperf3-srv_10.42.42.10(pid=20473): Terminated {rc=256} 03:50:25.585779 --- ParallelTerminationStrategy: PID 20474 died... 03:50:25.605679 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20474): Terminated: ok {rc=0} 03:50:25.653062 --- ParallelTerminationStrategy: PID 20475 died... 03:50:25.672767 run iperf3-srv_10.42.42.10(pid=20475): Terminated {rc=256} 03:50:25.719926 --- ParallelTerminationStrategy: PID 20476 died... 03:50:25.739939 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20476): Terminated: ok {rc=0} 03:50:25.787270 --- ParallelTerminationStrategy: PID 20477 died... 03:50:25.807215 run iperf3-srv_10.42.42.10(pid=20477): Terminated {rc=256} 03:50:25.854419 --- ParallelTerminationStrategy: PID 20480 died... 03:50:25.874210 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20480): Terminated: ok {rc=0} 03:50:25.921638 --- ParallelTerminationStrategy: PID 20483 died... 03:50:25.941411 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20483): Terminated: ok {rc=0} 03:50:25.988758 --- ParallelTerminationStrategy: PID 20486 died... 03:50:26.008601 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20486): Terminated: ok {rc=0} 03:50:26.098255 bus /gobi_4: Setting Powered False 03:50:27.198104 bus /gobi_4: Setting Powered False 03:50:28.315844 bus /gobi_1: Setting Powered False 03:50:29.415069 bus /gobi_1: Setting Powered False 03:50:30.532277 bus /gobi_0: Setting Powered False 03:50:31.630113 bus /gobi_0: Setting Powered False 03:50:32.745440 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:oc2g+mod-bts0-egprs ping.py ---------------------------------------------- 03:50:33.847566 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:50:33.859282 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:50:33.897620 tst ping.py: using LAC 18868 03:50:34.022073 tst ping.py: using RAC 253 03:50:34.144318 tst ping.py: using CellId 18868 03:50:34.268250 tst ping.py: using BVCI 18869 03:50:34.383427 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:50:34.394616 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:50:34.405668 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:50:34.416702 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:50:34.427794 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:50:34.438828 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:50:34.450258 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:50:34.461674 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:50:34.577019 tst ping.py:19: start network... 03:50:34.772668 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:50:35.226169 run create_hlr_db(pid=20488): Launched 03:50:35.346114 bus /gobi_6: Setting Powered False 03:50:36.405498 run create_hlr_db(pid=20488): Terminated: ok {rc=0} 03:50:36.834345 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20490): Launched 03:50:37.147432 run osmo-hlr_10.42.42.2(pid=20491): Launched 03:50:37.267003 run osmo-stp_10.42.42.5: Starting osmo-stp 03:50:37.810398 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20493): Launched 03:50:38.123397 run osmo-stp_10.42.42.5(pid=20494): Launched 03:50:38.243195 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:50:38.783644 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20496): Launched 03:50:38.904465 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:50:39.168660 run patchelf(pid=20497): Launched 03:50:39.343265 run osmo-stp_10.42.42.5(pid=20494): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20494)] 03:50:39.476547 run osmo-stp_10.42.42.5(pid=20494): stdout: | (launched: 2022-12-09_03:50:38.066413) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:50:39.611459 run osmo-stp_10.42.42.5(pid=20494): stderr: | 20221209035038256 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035038256 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035038257 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035038257 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035038258 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035038258 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035038258 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:50:39.746738 run osmo-stp_10.42.42.5(pid=20494): stdout: | (launched: 2022-12-09_03:50:38.066413) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:50:39.876152 run osmo-stp_10.42.42.5(pid=20494): stderr: | 20221209035038256 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035038256 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035038257 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035038257 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035038258 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035038258 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035038258 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:50:40.029165 run patchelf(pid=20497): Terminating (SIGINT) 03:50:40.205754 run patchelf(pid=20497): Terminated: ok {rc=0} 03:50:40.333091 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=20494): Process ended prematurely: osmo-stp_10.42.42.5(pid=20494) [trial-2354↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20494)] [trial-2354↪gprs:oc2g+mod-bts0-egprs↪ping.py:22] 03:50:40.342599 tst ping.py:22: Test FAILED (6.5 sec) 03:50:40.371325 run osmo-hlr_10.42.42.2(pid=20491): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:oc2g+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20491)] 03:50:40.422654 run osmo-hlr_10.42.42.2(pid=20491): stdout: | (launched: 2022-12-09_03:50:37.090597) 03:50:40.475722 run osmo-hlr_10.42.42.2(pid=20491): stderr: | 20221209035037286 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209035037286 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209035037286 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209035037286 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209035037286 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209035037286 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209035037299 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:oc2g+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209035037309 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209035037309 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209035037309 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:50:40.529319 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20490): Terminating (SIGTERM) 03:50:40.572173 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20493): Terminating (SIGTERM) 03:50:40.614991 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20496): Terminating (SIGTERM) 03:50:40.658142 --- ParallelTerminationStrategy: PID 20490 died... 03:50:40.678506 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20490): Terminated: ok {rc=0} 03:50:40.725985 --- ParallelTerminationStrategy: PID 20493 died... 03:50:40.746307 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20493): Terminated: ok {rc=0} 03:50:40.793994 --- ParallelTerminationStrategy: PID 20496 died... 03:50:40.813963 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20496): Terminated: ok {rc=0} 03:50:40.903784 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:oc2g+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 03:50:41.992035 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:50:42.003773 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:50:42.042816 tst ping_idle_ping.py: using LAC 18869 03:50:42.167603 tst ping_idle_ping.py: using RAC 254 03:50:42.290216 tst ping_idle_ping.py: using CellId 18869 03:50:42.413064 tst ping_idle_ping.py: using BVCI 18870 03:50:42.526837 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:50:42.537867 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:50:42.548736 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:50:42.559961 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:50:42.571031 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:50:42.582178 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:50:42.593071 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:50:42.604202 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:50:42.721536 tst ping_idle_ping.py:24: start network... 03:50:42.932041 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:50:43.419874 run create_hlr_db(pid=20498): Launched 03:50:43.539098 bus /gobi_6: Setting Powered False 03:50:44.601362 run create_hlr_db(pid=20498): Terminated: ok {rc=0} 03:50:45.039976 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20500): Launched 03:50:45.354339 run osmo-hlr_10.42.42.2(pid=20501): Launched 03:50:45.474716 run osmo-stp_10.42.42.5: Starting osmo-stp 03:50:46.053810 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20503): Launched 03:50:46.390146 run osmo-stp_10.42.42.5(pid=20504): Launched 03:50:46.660708 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:50:47.220879 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20506): Launched 03:50:47.344528 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:50:47.611310 run patchelf(pid=20507): Launched 03:50:47.787799 run osmo-stp_10.42.42.5(pid=20504): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20504)] 03:50:47.921951 run osmo-stp_10.42.42.5(pid=20504): stdout: | (launched: 2022-12-09_03:50:46.325327) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:50:48.057517 run osmo-stp_10.42.42.5(pid=20504): stderr: | 20221209035046516 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035046516 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035046516 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035046517 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035046517 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035046517 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035046517 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:50:48.193326 run osmo-stp_10.42.42.5(pid=20504): stdout: | (launched: 2022-12-09_03:50:46.325327) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:50:48.322852 run osmo-stp_10.42.42.5(pid=20504): stderr: | 20221209035046516 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035046516 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035046516 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035046517 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035046517 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035046517 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035046517 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:50:48.476544 run patchelf(pid=20507): Terminating (SIGINT) 03:50:48.654495 run patchelf(pid=20507): Terminated: ok {rc=0} 03:50:48.783236 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=20504): Process ended prematurely: osmo-stp_10.42.42.5(pid=20504) [trial-2354↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20504)] [trial-2354↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27] 03:50:48.792888 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 03:50:48.822024 run osmo-hlr_10.42.42.2(pid=20501): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20501)] 03:50:48.873258 run osmo-hlr_10.42.42.2(pid=20501): stdout: | (launched: 2022-12-09_03:50:45.297477) 03:50:48.926139 run osmo-hlr_10.42.42.2(pid=20501): stderr: | 20221209035045493 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209035045493 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209035045493 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209035045493 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209035045493 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209035045493 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209035045504 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:oc2g+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209035045512 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209035045512 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209035045512 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:50:48.979424 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20500): Terminating (SIGTERM) 03:50:49.022413 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20503): Terminating (SIGTERM) 03:50:49.064920 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20506): Terminating (SIGTERM) 03:50:49.107937 --- ParallelTerminationStrategy: PID 20500 died... 03:50:49.128095 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20500): Terminated: ok {rc=0} 03:50:49.175865 --- ParallelTerminationStrategy: PID 20503 died... 03:50:49.195844 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20503): Terminated: ok {rc=0} 03:50:49.242933 --- ParallelTerminationStrategy: PID 20506 died... 03:50:49.262816 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20506): Terminated: ok {rc=0} 03:50:49.351971 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2354 gprs:oc2g+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 gprs:oc2g+mod-bts0-dynts-ipa --------------------------------------------------------------------- 03:50:50.646785 tst gprs:oc2g+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:50:50.652581 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 03:50:50.673162 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 03:50:50.710688 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 03:50:50.796685 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 03:50:50.817831 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 03:50:50.857451 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 03:50:51.446809 tst gprs:oc2g+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2354 gprs:oc2g+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 03:50:51.495018 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:50:51.505972 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 03:50:51.560402 tst cs_paging_gprs_active.py: using LAC 18870 03:50:51.686042 tst cs_paging_gprs_active.py: using RAC 255 03:50:51.811322 tst cs_paging_gprs_active.py: using CellId 18870 03:50:51.934654 tst cs_paging_gprs_active.py: using BVCI 18871 03:50:52.050922 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:50:52.062650 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:50:52.073805 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:50:52.084897 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:50:52.095883 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:50:52.107080 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:50:52.118386 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:50:52.129448 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:50:52.141409 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:50:52.257449 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:50:52.378430 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 03:50:52.595158 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:50:52.916644 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20511): Launched 03:50:53.195633 run iperf3-srv_10.42.42.10(pid=20512): Launched 03:50:53.316487 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 03:50:53.532727 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:50:53.854193 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20513): Launched 03:50:54.133614 run iperf3-srv_10.42.42.10(pid=20514): Launched 03:50:54.254232 tst cs_paging_gprs_active.py:38: start network... 03:50:54.469987 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:50:54.965689 run create_hlr_db(pid=20515): Launched 03:50:55.088019 bus /gobi_6: Setting Powered False 03:50:56.152103 run create_hlr_db(pid=20515): Terminated: ok {rc=0} 03:50:56.578453 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20517): Launched 03:50:56.878542 run osmo-hlr_10.42.42.2(pid=20518): Launched 03:50:56.992735 run osmo-stp_10.42.42.5: Starting osmo-stp 03:50:57.519442 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20520): Launched 03:50:57.817902 run osmo-stp_10.42.42.5(pid=20521): Launched 03:50:57.931317 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:50:58.445033 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20523): Launched 03:50:58.559191 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:50:58.810733 run patchelf(pid=20524): Launched 03:50:58.976476 run osmo-stp_10.42.42.5(pid=20521): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20521)] 03:50:59.103496 run osmo-stp_10.42.42.5(pid=20521): stdout: | (launched: 2022-12-09_03:50:57.763408) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:50:59.231996 run osmo-stp_10.42.42.5(pid=20521): stderr: | 20221209035057931 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035057931 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035057932 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035057932 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035057932 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035057932 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035057933 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:50:59.359916 run osmo-stp_10.42.42.5(pid=20521): stdout: | (launched: 2022-12-09_03:50:57.763408) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:50:59.482353 run osmo-stp_10.42.42.5(pid=20521): stderr: | 20221209035057931 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035057931 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035057932 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035057932 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035057932 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035057932 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035057933 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:50:59.627081 run patchelf(pid=20524): Terminating (SIGINT) 03:50:59.795910 run patchelf(pid=20524): Terminated: ok {rc=0} 03:50:59.918072 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=20521): Process ended prematurely: osmo-stp_10.42.42.5(pid=20521) [trial-2354↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20521)] [trial-2354↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 03:50:59.927268 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 03:50:59.954422 run osmo-hlr_10.42.42.2(pid=20518): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20518)] 03:51:00.001837 run osmo-hlr_10.42.42.2(pid=20518): stdout: | (launched: 2022-12-09_03:50:56.823826) 03:51:00.051114 run osmo-hlr_10.42.42.2(pid=20518): stderr: | 20221209035056997 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209035056997 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209035056997 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209035056997 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209035056997 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209035056997 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209035057009 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:oc2g+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209035057018 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209035057018 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209035057019 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:51:00.100826 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20511): Terminating (SIGTERM) 03:51:00.140809 run iperf3-srv_10.42.42.10(pid=20512): Terminating (SIGTERM) 03:51:00.180458 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20513): Terminating (SIGTERM) 03:51:00.220038 run iperf3-srv_10.42.42.10(pid=20514): Terminating (SIGTERM) 03:51:00.259501 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20517): Terminating (SIGTERM) 03:51:00.299380 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20520): Terminating (SIGTERM) 03:51:00.338979 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20523): Terminating (SIGTERM) 03:51:00.378691 --- ParallelTerminationStrategy: PID 20511 died... 03:51:00.397778 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20511): Terminated: ok {rc=0} 03:51:00.441697 --- ParallelTerminationStrategy: PID 20512 died... 03:51:00.460235 run iperf3-srv_10.42.42.10(pid=20512): Terminated {rc=256} 03:51:00.503743 --- ParallelTerminationStrategy: PID 20513 died... 03:51:00.522331 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20513): Terminated: ok {rc=0} 03:51:00.565747 --- ParallelTerminationStrategy: PID 20514 died... 03:51:00.584176 run iperf3-srv_10.42.42.10(pid=20514): Terminated {rc=256} 03:51:00.627599 --- ParallelTerminationStrategy: PID 20517 died... 03:51:00.646281 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20517): Terminated: ok {rc=0} 03:51:00.689940 --- ParallelTerminationStrategy: PID 20520 died... 03:51:00.708477 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20520): Terminated: ok {rc=0} 03:51:00.752115 --- ParallelTerminationStrategy: PID 20523 died... 03:51:00.770739 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20523): Terminated: ok {rc=0} 03:51:00.865841 bus /gobi_0: Setting Powered False 03:51:01.970007 bus /gobi_0: Setting Powered False 03:51:03.091218 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:oc2g+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 03:51:04.238513 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:51:04.250033 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 03:51:04.308340 tst iperf3.py: using LAC 18871 03:51:04.427663 tst iperf3.py: using RAC 1 03:51:04.551577 tst iperf3.py: using CellId 18871 03:51:04.667970 tst iperf3.py: using BVCI 18872 03:51:04.776229 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:51:04.786996 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:51:04.797503 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:51:04.807947 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:51:04.818426 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:51:04.828862 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:51:04.839494 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:51:04.849895 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:51:04.860438 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:51:04.977349 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 03:51:05.193918 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:51:05.514324 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20525): Launched 03:51:05.793433 run iperf3-srv_10.42.42.10(pid=20526): Launched 03:51:05.914330 tst iperf3.py:8: start network... 03:51:06.130237 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:51:06.624531 run create_hlr_db(pid=20527): Launched 03:51:06.747623 bus /gobi_6: Setting Powered False 03:51:07.811178 run create_hlr_db(pid=20527): Terminated: ok {rc=0} 03:51:08.236715 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20529): Launched 03:51:08.535122 run osmo-hlr_10.42.42.2(pid=20530): Launched 03:51:08.649739 run osmo-stp_10.42.42.5: Starting osmo-stp 03:51:09.161821 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20532): Launched 03:51:09.459726 run osmo-stp_10.42.42.5(pid=20533): Launched 03:51:09.574482 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:51:10.090226 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20535): Launched 03:51:10.204359 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:51:10.454904 run patchelf(pid=20536): Launched 03:51:10.620334 run osmo-stp_10.42.42.5(pid=20533): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20533)] 03:51:10.746000 run osmo-stp_10.42.42.5(pid=20533): stdout: | (launched: 2022-12-09_03:51:09.405373) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:51:10.873714 run osmo-stp_10.42.42.5(pid=20533): stderr: | 20221209035109572 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035109572 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035109572 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035109573 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035109573 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035109573 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035109573 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:51:11.001182 run osmo-stp_10.42.42.5(pid=20533): stdout: | (launched: 2022-12-09_03:51:09.405373) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:51:11.123074 run osmo-stp_10.42.42.5(pid=20533): stderr: | 20221209035109572 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035109572 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035109572 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035109573 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035109573 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035109573 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035109573 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:51:11.268455 run patchelf(pid=20536): Terminating (SIGINT) 03:51:11.436323 run patchelf(pid=20536): Terminated: ok {rc=0} 03:51:11.557064 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20533): Process ended prematurely: osmo-stp_10.42.42.5(pid=20533) [trial-2354↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20533)] [trial-2354↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8] 03:51:11.566507 tst iperf3.py:8: Test FAILED (7.4 sec) 03:51:11.593702 run osmo-hlr_10.42.42.2(pid=20530): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20530)] 03:51:11.641279 run osmo-hlr_10.42.42.2(pid=20530): stdout: | (launched: 2022-12-09_03:51:08.480489) 03:51:11.690700 run osmo-hlr_10.42.42.2(pid=20530): stderr: | 20221209035108655 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209035108655 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209035108655 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209035108656 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209035108656 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209035108656 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209035108667 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:oc2g+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209035108676 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209035108676 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209035108676 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:51:11.740311 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20525): Terminating (SIGTERM) 03:51:11.780291 run iperf3-srv_10.42.42.10(pid=20526): Terminating (SIGTERM) 03:51:11.820149 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20529): Terminating (SIGTERM) 03:51:11.860004 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20532): Terminating (SIGTERM) 03:51:11.899810 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20535): Terminating (SIGTERM) 03:51:11.939815 --- ParallelTerminationStrategy: PID 20525 died... 03:51:11.958889 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20525): Terminated: ok {rc=0} 03:51:12.003202 --- ParallelTerminationStrategy: PID 20526 died... 03:51:12.021940 run iperf3-srv_10.42.42.10(pid=20526): Terminated {rc=256} 03:51:12.065735 --- ParallelTerminationStrategy: PID 20529 died... 03:51:12.084419 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20529): Terminated: ok {rc=0} 03:51:12.128559 --- ParallelTerminationStrategy: PID 20532 died... 03:51:12.147297 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20532): Terminated: ok {rc=0} 03:51:12.191266 --- ParallelTerminationStrategy: PID 20535 died... 03:51:12.209916 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20535): Terminated: ok {rc=0} 03:51:12.295718 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:oc2g+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 03:51:13.442992 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:51:13.454390 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 03:51:13.510799 tst iperf3m4.py: using LAC 18872 03:51:13.629057 tst iperf3m4.py: using RAC 2 03:51:13.744837 tst iperf3m4.py: using CellId 18872 03:51:13.861151 tst iperf3m4.py: using BVCI 18873 03:51:13.968443 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:51:13.979249 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:51:13.989849 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:51:14.000292 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:51:14.010679 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:51:14.021132 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:51:14.031792 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:51:14.042245 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:51:14.052820 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:51:14.171100 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:51:14.288847 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:51:14.409139 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:51:14.526876 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 03:51:14.743012 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:51:15.064164 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20537): Launched 03:51:15.343866 run iperf3-srv_10.42.42.10(pid=20538): Launched 03:51:15.464893 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 03:51:15.680033 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:51:16.018043 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20539): Launched 03:51:16.351901 run iperf3-srv_10.42.42.10(pid=20540): Launched 03:51:16.484151 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 03:51:16.704168 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:51:17.041718 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20541): Launched 03:51:17.329782 run iperf3-srv_10.42.42.10(pid=20542): Launched 03:51:17.451295 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 03:51:17.667008 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:51:17.989373 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20543): Launched 03:51:18.268459 run iperf3-srv_10.42.42.10(pid=20544): Launched 03:51:18.389299 tst iperf3m4.py:8: start network... 03:51:18.604454 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:51:19.100416 run create_hlr_db(pid=20545): Launched 03:51:19.223223 bus /gobi_6: Setting Powered False 03:51:20.286599 run create_hlr_db(pid=20545): Terminated: ok {rc=0} 03:51:20.714707 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20547): Launched 03:51:21.013424 run osmo-hlr_10.42.42.2(pid=20548): Launched 03:51:21.127915 run osmo-stp_10.42.42.5: Starting osmo-stp 03:51:21.643185 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20550): Launched 03:51:21.945734 run osmo-stp_10.42.42.5(pid=20551): Launched 03:51:22.070619 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:51:22.620917 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20553): Launched 03:51:22.744881 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:51:23.016041 run patchelf(pid=20554): Launched 03:51:23.195056 run osmo-stp_10.42.42.5(pid=20551): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20551)] 03:51:23.331178 run osmo-stp_10.42.42.5(pid=20551): stdout: | (launched: 2022-12-09_03:51:21.886739) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:51:23.468723 run osmo-stp_10.42.42.5(pid=20551): stderr: | 20221209035122074 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035122074 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035122074 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035122074 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035122075 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035122075 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035122075 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:51:23.606428 run osmo-stp_10.42.42.5(pid=20551): stdout: | (launched: 2022-12-09_03:51:21.886739) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:51:23.738351 run osmo-stp_10.42.42.5(pid=20551): stderr: | 20221209035122074 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035122074 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035122074 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035122074 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035122075 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035122075 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035122075 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:51:23.895250 run patchelf(pid=20554): Terminating (SIGINT) 03:51:24.075930 run patchelf(pid=20554): Terminated: ok {rc=0} 03:51:24.206797 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20551): Process ended prematurely: osmo-stp_10.42.42.5(pid=20551) [trial-2354↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20551)] [trial-2354↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8] 03:51:24.216870 tst iperf3m4.py:8: Test FAILED (10.8 sec) 03:51:24.247691 run osmo-hlr_10.42.42.2(pid=20548): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20548)] 03:51:24.299391 run osmo-hlr_10.42.42.2(pid=20548): stdout: | (launched: 2022-12-09_03:51:20.958916) 03:51:24.352640 run osmo-hlr_10.42.42.2(pid=20548): stderr: | 20221209035121132 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209035121132 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209035121132 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209035121132 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209035121132 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209035121132 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209035121147 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:oc2g+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209035121156 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209035121156 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209035121156 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:51:24.406246 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20537): Terminating (SIGTERM) 03:51:24.449176 run iperf3-srv_10.42.42.10(pid=20538): Terminating (SIGTERM) 03:51:24.492043 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20539): Terminating (SIGTERM) 03:51:24.535249 run iperf3-srv_10.42.42.10(pid=20540): Terminating (SIGTERM) 03:51:24.578266 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20541): Terminating (SIGTERM) 03:51:24.621569 run iperf3-srv_10.42.42.10(pid=20542): Terminating (SIGTERM) 03:51:24.664518 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20543): Terminating (SIGTERM) 03:51:24.707656 run iperf3-srv_10.42.42.10(pid=20544): Terminating (SIGTERM) 03:51:24.750545 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20547): Terminating (SIGTERM) 03:51:24.793880 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20550): Terminating (SIGTERM) 03:51:24.837060 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20553): Terminating (SIGTERM) 03:51:24.880209 --- ParallelTerminationStrategy: PID 20537 died... 03:51:24.900342 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20537): Terminated: ok {rc=0} 03:51:24.948544 --- ParallelTerminationStrategy: PID 20538 died... 03:51:24.968179 run iperf3-srv_10.42.42.10(pid=20538): Terminated {rc=256} 03:51:25.015997 --- ParallelTerminationStrategy: PID 20539 died... 03:51:25.035707 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20539): Terminated: ok {rc=0} 03:51:25.083785 --- ParallelTerminationStrategy: PID 20540 died... 03:51:25.103488 run iperf3-srv_10.42.42.10(pid=20540): Terminated {rc=256} 03:51:25.151288 --- ParallelTerminationStrategy: PID 20541 died... 03:51:25.170870 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20541): Terminated: ok {rc=0} 03:51:25.218912 --- ParallelTerminationStrategy: PID 20542 died... 03:51:25.238476 run iperf3-srv_10.42.42.10(pid=20542): Terminated {rc=256} 03:51:25.286544 --- ParallelTerminationStrategy: PID 20543 died... 03:51:25.306231 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20543): Terminated: ok {rc=0} 03:51:25.354192 --- ParallelTerminationStrategy: PID 20544 died... 03:51:25.373793 run iperf3-srv_10.42.42.10(pid=20544): Terminated {rc=256} 03:51:25.421604 --- ParallelTerminationStrategy: PID 20547 died... 03:51:25.441256 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20547): Terminated: ok {rc=0} 03:51:25.489299 --- ParallelTerminationStrategy: PID 20550 died... 03:51:25.508881 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20550): Terminated: ok {rc=0} 03:51:25.557086 --- ParallelTerminationStrategy: PID 20553 died... 03:51:25.576725 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20553): Terminated: ok {rc=0} 03:51:25.666404 bus /gobi_4: Setting Powered False 03:51:26.767059 bus /gobi_4: Setting Powered False 03:51:27.885435 bus /gobi_1: Setting Powered False 03:51:28.983942 bus /gobi_1: Setting Powered False 03:51:30.101572 bus /gobi_0: Setting Powered False 03:51:31.199477 bus /gobi_0: Setting Powered False 03:51:32.320269 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:oc2g+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 03:51:33.424163 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:51:33.435592 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 03:51:33.491872 tst ping.py: using LAC 18873 03:51:33.608903 tst ping.py: using RAC 3 03:51:33.729068 tst ping.py: using CellId 18873 03:51:33.844765 tst ping.py: using BVCI 18874 03:51:33.951120 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:51:33.961942 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:51:33.972309 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:51:33.983075 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:51:33.993824 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:51:34.004415 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:51:34.015265 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:51:34.025958 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:51:34.141332 tst ping.py:19: start network... 03:51:34.336492 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:51:34.789415 run create_hlr_db(pid=20555): Launched 03:51:34.909373 bus /gobi_6: Setting Powered False 03:51:35.968608 run create_hlr_db(pid=20555): Terminated: ok {rc=0} 03:51:36.397994 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20557): Launched 03:51:36.711641 run osmo-hlr_10.42.42.2(pid=20558): Launched 03:51:36.832671 run osmo-stp_10.42.42.5: Starting osmo-stp 03:51:37.380465 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20560): Launched 03:51:37.695186 run osmo-stp_10.42.42.5(pid=20561): Launched 03:51:37.815578 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:51:38.357981 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20563): Launched 03:51:38.478434 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:51:38.743901 run patchelf(pid=20564): Launched 03:51:38.920234 run osmo-stp_10.42.42.5(pid=20561): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20561)] 03:51:39.054131 run osmo-stp_10.42.42.5(pid=20561): stdout: | (launched: 2022-12-09_03:51:37.638179) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:51:39.189794 run osmo-stp_10.42.42.5(pid=20561): stderr: | 20221209035137828 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035137828 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035137828 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035137829 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035137829 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035137829 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035137829 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:51:39.325399 run osmo-stp_10.42.42.5(pid=20561): stdout: | (launched: 2022-12-09_03:51:37.638179) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:51:39.455481 run osmo-stp_10.42.42.5(pid=20561): stderr: | 20221209035137828 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035137828 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035137828 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035137829 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035137829 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035137829 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035137829 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:51:39.608886 run patchelf(pid=20564): Terminating (SIGINT) 03:51:39.787019 run patchelf(pid=20564): Terminated: ok {rc=0} 03:51:39.914959 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=20561): Process ended prematurely: osmo-stp_10.42.42.5(pid=20561) [trial-2354↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20561)] [trial-2354↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22] 03:51:39.924392 tst ping.py:22: Test FAILED (6.5 sec) 03:51:39.954281 run osmo-hlr_10.42.42.2(pid=20558): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20558)] 03:51:40.005600 run osmo-hlr_10.42.42.2(pid=20558): stdout: | (launched: 2022-12-09_03:51:36.654478) 03:51:40.058480 run osmo-hlr_10.42.42.2(pid=20558): stderr: | 20221209035136851 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209035136851 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209035136851 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209035136852 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209035136852 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209035136852 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209035136862 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:oc2g+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209035136871 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209035136871 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209035136871 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:51:40.111852 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20557): Terminating (SIGTERM) 03:51:40.154594 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20560): Terminating (SIGTERM) 03:51:40.197487 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20563): Terminating (SIGTERM) 03:51:40.241195 --- ParallelTerminationStrategy: PID 20557 died... 03:51:40.261502 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20557): Terminated: ok {rc=0} 03:51:40.309069 --- ParallelTerminationStrategy: PID 20560 died... 03:51:40.328847 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20560): Terminated: ok {rc=0} 03:51:40.376221 --- ParallelTerminationStrategy: PID 20563 died... 03:51:40.396137 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20563): Terminated: ok {rc=0} 03:51:40.485059 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:oc2g+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 03:51:41.573340 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:51:41.585311 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 03:51:41.643922 tst ping_idle_ping.py: using LAC 18874 03:51:41.769121 tst ping_idle_ping.py: using RAC 4 03:51:41.894468 tst ping_idle_ping.py: using CellId 18874 03:51:42.018251 tst ping_idle_ping.py: using BVCI 18875 03:51:42.133713 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:51:42.144902 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:51:42.156097 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:51:42.167517 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:51:42.178791 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:51:42.190101 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:51:42.201751 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:51:42.213282 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:51:42.331762 tst ping_idle_ping.py:24: start network... 03:51:42.543297 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:51:43.032920 run create_hlr_db(pid=20565): Launched 03:51:43.153089 bus /gobi_6: Setting Powered False 03:51:44.216363 run create_hlr_db(pid=20565): Terminated: ok {rc=0} 03:51:44.656427 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20567): Launched 03:51:44.971760 run osmo-hlr_10.42.42.2(pid=20568): Launched 03:51:45.093144 run osmo-stp_10.42.42.5: Starting osmo-stp 03:51:45.641569 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20570): Launched 03:51:45.975751 run osmo-stp_10.42.42.5(pid=20571): Launched 03:51:46.235013 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:51:46.789809 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20573): Launched 03:51:46.918197 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:51:47.193871 run patchelf(pid=20574): Launched 03:51:47.379022 run osmo-stp_10.42.42.5(pid=20571): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20571)] 03:51:47.507943 run osmo-stp_10.42.42.5(pid=20571): stdout: | (launched: 2022-12-09_03:51:45.910518) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:51:47.635275 run osmo-stp_10.42.42.5(pid=20571): stderr: | 20221209035146108 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035146108 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035146108 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035146109 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035146109 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035146109 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035146109 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:51:47.762353 run osmo-stp_10.42.42.5(pid=20571): stdout: | (launched: 2022-12-09_03:51:45.910518) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:51:47.884012 run osmo-stp_10.42.42.5(pid=20571): stderr: | 20221209035146108 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035146108 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035146108 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035146109 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035146109 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035146109 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035146109 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:51:48.027430 run patchelf(pid=20574): Terminating (SIGINT) 03:51:48.194222 run patchelf(pid=20574): Terminated: ok {rc=0} 03:51:48.314556 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=20571): Process ended prematurely: osmo-stp_10.42.42.5(pid=20571) [trial-2354↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20571)] [trial-2354↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 03:51:48.323539 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 03:51:48.351026 run osmo-hlr_10.42.42.2(pid=20568): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20568)] 03:51:48.399879 run osmo-hlr_10.42.42.2(pid=20568): stdout: | (launched: 2022-12-09_03:51:44.914769) 03:51:48.450448 run osmo-hlr_10.42.42.2(pid=20568): stderr: | 20221209035145110 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209035145110 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209035145110 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209035145110 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209035145110 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209035145110 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209035145122 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:oc2g+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209035145130 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209035145131 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209035145131 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:51:48.501056 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20567): Terminating (SIGTERM) 03:51:48.541184 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20570): Terminating (SIGTERM) 03:51:48.581452 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20573): Terminating (SIGTERM) 03:51:48.621894 --- ParallelTerminationStrategy: PID 20567 died... 03:51:48.641110 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20567): Terminated: ok {rc=0} 03:51:48.685936 --- ParallelTerminationStrategy: PID 20570 died... 03:51:48.704893 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20570): Terminated: ok {rc=0} 03:51:48.750024 --- ParallelTerminationStrategy: PID 20573 died... 03:51:48.768809 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20573): Terminated: ok {rc=0} 03:51:48.854607 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2354 gprs:oc2g+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 gprs:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 03:51:50.144025 tst gprs:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:51:50.149837 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 03:51:50.169758 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 03:51:50.207371 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 03:51:50.293092 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 03:51:50.313862 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 03:51:50.351302 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 03:51:50.942546 tst gprs:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2354 gprs:oc2g+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 03:51:50.990354 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:51:51.001041 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 03:51:51.057269 tst cs_paging_gprs_active.py: using LAC 18875 03:51:51.182403 tst cs_paging_gprs_active.py: using RAC 5 03:51:51.309133 tst cs_paging_gprs_active.py: using CellId 18875 03:51:51.432900 tst cs_paging_gprs_active.py: using BVCI 18876 03:51:51.550301 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:51:51.561765 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:51:51.572858 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:51:51.584272 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:51:51.595416 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:51:51.606593 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:51:51.617931 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:51:51.629065 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:51:51.640336 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 03:51:51.756882 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 03:51:51.877521 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 03:51:52.094276 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:51:52.415635 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20580): Launched 03:51:52.693885 run iperf3-srv_10.42.42.10(pid=20581): Launched 03:51:52.814773 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 03:51:53.030817 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:51:53.351566 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20582): Launched 03:51:53.630327 run iperf3-srv_10.42.42.10(pid=20583): Launched 03:51:53.750714 tst cs_paging_gprs_active.py:38: start network... 03:51:53.967128 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:51:54.463579 run create_hlr_db(pid=20584): Launched 03:51:54.586099 bus /gobi_6: Setting Powered False 03:51:55.649485 run create_hlr_db(pid=20584): Terminated: ok {rc=0} 03:51:56.078115 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20586): Launched 03:51:56.378075 run osmo-hlr_10.42.42.2(pid=20587): Launched 03:51:56.492593 run osmo-stp_10.42.42.5: Starting osmo-stp 03:51:57.009174 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20589): Launched 03:51:57.308634 run osmo-stp_10.42.42.5(pid=20590): Launched 03:51:57.423378 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:51:57.939154 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20592): Launched 03:51:58.053474 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:51:58.305113 run patchelf(pid=20593): Launched 03:51:58.471842 run osmo-stp_10.42.42.5(pid=20590): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20590)] 03:51:58.598648 run osmo-stp_10.42.42.5(pid=20590): stdout: | (launched: 2022-12-09_03:51:57.253838) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:51:58.726836 run osmo-stp_10.42.42.5(pid=20590): stderr: | 20221209035157422 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035157422 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035157422 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035157423 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035157423 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035157423 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035157423 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:51:58.855296 run osmo-stp_10.42.42.5(pid=20590): stdout: | (launched: 2022-12-09_03:51:57.253838) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:51:58.978007 run osmo-stp_10.42.42.5(pid=20590): stderr: | 20221209035157422 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035157422 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035157422 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035157423 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035157423 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035157423 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035157423 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:51:59.123259 run patchelf(pid=20593): Terminating (SIGINT) 03:51:59.291886 run patchelf(pid=20593): Terminated: ok {rc=0} 03:51:59.413872 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=20590): Process ended prematurely: osmo-stp_10.42.42.5(pid=20590) [trial-2354↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20590)] [trial-2354↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 03:51:59.423290 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 03:51:59.450396 run osmo-hlr_10.42.42.2(pid=20587): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20587)] 03:51:59.498231 run osmo-hlr_10.42.42.2(pid=20587): stdout: | (launched: 2022-12-09_03:51:56.323679) 03:51:59.547938 run osmo-hlr_10.42.42.2(pid=20587): stderr: | 20221209035156496 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209035156496 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209035156496 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209035156497 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209035156497 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209035156497 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209035156509 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:oc2g+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209035156518 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209035156518 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209035156518 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:51:59.598328 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20580): Terminating (SIGTERM) 03:51:59.637804 run iperf3-srv_10.42.42.10(pid=20581): Terminating (SIGTERM) 03:51:59.677045 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20582): Terminating (SIGTERM) 03:51:59.716345 run iperf3-srv_10.42.42.10(pid=20583): Terminating (SIGTERM) 03:51:59.755554 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20586): Terminating (SIGTERM) 03:51:59.794958 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20589): Terminating (SIGTERM) 03:51:59.834327 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20592): Terminating (SIGTERM) 03:51:59.873736 --- ParallelTerminationStrategy: PID 20580 died... 03:51:59.892518 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20580): Terminated: ok {rc=0} 03:51:59.936039 --- ParallelTerminationStrategy: PID 20581 died... 03:51:59.954321 run iperf3-srv_10.42.42.10(pid=20581): Terminated {rc=256} 03:51:59.997906 --- ParallelTerminationStrategy: PID 20582 died... 03:52:00.016199 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20582): Terminated: ok {rc=0} 03:52:00.059544 --- ParallelTerminationStrategy: PID 20583 died... 03:52:00.077832 run iperf3-srv_10.42.42.10(pid=20583): Terminated {rc=256} 03:52:00.121165 --- ParallelTerminationStrategy: PID 20586 died... 03:52:00.139520 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20586): Terminated: ok {rc=0} 03:52:00.183451 --- ParallelTerminationStrategy: PID 20589 died... 03:52:00.201843 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20589): Terminated: ok {rc=0} 03:52:00.245168 --- ParallelTerminationStrategy: PID 20592 died... 03:52:00.263616 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20592): Terminated: ok {rc=0} 03:52:00.348841 bus /gobi_0: Setting Powered False 03:52:01.454684 bus /gobi_0: Setting Powered False 03:52:02.582565 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:oc2g+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 03:52:03.731360 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:52:03.743253 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 03:52:03.803904 tst iperf3.py: using LAC 18876 03:52:03.930591 tst iperf3.py: using RAC 6 03:52:04.055657 tst iperf3.py: using CellId 18876 03:52:04.180471 tst iperf3.py: using BVCI 18877 03:52:04.296555 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:52:04.307822 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:52:04.318834 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:52:04.330164 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:52:04.341236 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:52:04.352913 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:52:04.364426 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:52:04.375654 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:52:04.387006 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 03:52:04.502611 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 03:52:04.702979 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:52:05.001944 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20594): Launched 03:52:05.261483 run iperf3-srv_10.42.42.10(pid=20595): Launched 03:52:05.373914 tst iperf3.py:8: start network... 03:52:05.572665 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:52:06.035154 run create_hlr_db(pid=20596): Launched 03:52:06.160307 bus /gobi_6: Setting Powered False 03:52:07.220635 run create_hlr_db(pid=20596): Terminated: ok {rc=0} 03:52:07.659139 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20598): Launched 03:52:07.980559 run osmo-hlr_10.42.42.2(pid=20599): Launched 03:52:08.103859 run osmo-stp_10.42.42.5: Starting osmo-stp 03:52:08.659270 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20601): Launched 03:52:08.979233 run osmo-stp_10.42.42.5(pid=20602): Launched 03:52:09.102217 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:52:09.653415 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20604): Launched 03:52:09.776414 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:52:10.047698 run patchelf(pid=20605): Launched 03:52:10.226220 run osmo-stp_10.42.42.5(pid=20602): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20602)] 03:52:10.361996 run osmo-stp_10.42.42.5(pid=20602): stdout: | (launched: 2022-12-09_03:52:08.921655) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:52:10.499406 run osmo-stp_10.42.42.5(pid=20602): stderr: | 20221209035209111 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035209112 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035209112 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035209112 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035209113 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035209113 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035209113 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:52:10.637515 run osmo-stp_10.42.42.5(pid=20602): stdout: | (launched: 2022-12-09_03:52:08.921655) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:52:10.769236 run osmo-stp_10.42.42.5(pid=20602): stderr: | 20221209035209111 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035209112 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035209112 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035209112 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035209113 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035209113 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035209113 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:52:10.925446 run patchelf(pid=20605): Terminating (SIGINT) 03:52:11.105298 run patchelf(pid=20605): Terminated: ok {rc=0} 03:52:11.235201 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20602): Process ended prematurely: osmo-stp_10.42.42.5(pid=20602) [trial-2354↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20602)] [trial-2354↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8] 03:52:11.245501 tst iperf3.py:8: Test FAILED (7.6 sec) 03:52:11.274830 run osmo-hlr_10.42.42.2(pid=20599): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20599)] 03:52:11.326045 run osmo-hlr_10.42.42.2(pid=20599): stdout: | (launched: 2022-12-09_03:52:07.922716) 03:52:11.378859 run osmo-hlr_10.42.42.2(pid=20599): stderr: | 20221209035208119 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209035208119 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209035208119 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209035208119 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209035208119 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209035208119 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209035208132 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:oc2g+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209035208140 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209035208140 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209035208140 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:52:11.432268 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20594): Terminating (SIGTERM) 03:52:11.474834 run iperf3-srv_10.42.42.10(pid=20595): Terminating (SIGTERM) 03:52:11.517581 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20598): Terminating (SIGTERM) 03:52:11.560196 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20601): Terminating (SIGTERM) 03:52:11.602876 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20604): Terminating (SIGTERM) 03:52:11.646208 --- ParallelTerminationStrategy: PID 20594 died... 03:52:11.666962 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20594): Terminated: ok {rc=0} 03:52:11.714587 --- ParallelTerminationStrategy: PID 20595 died... 03:52:11.734464 run iperf3-srv_10.42.42.10(pid=20595): Terminated {rc=256} 03:52:11.781543 --- ParallelTerminationStrategy: PID 20598 died... 03:52:11.801428 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20598): Terminated: ok {rc=0} 03:52:11.848566 --- ParallelTerminationStrategy: PID 20601 died... 03:52:11.868313 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20601): Terminated: ok {rc=0} 03:52:11.915408 --- ParallelTerminationStrategy: PID 20604 died... 03:52:11.935064 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20604): Terminated: ok {rc=0} 03:52:12.023351 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:oc2g+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 03:52:13.170249 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:52:13.181661 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 03:52:13.238742 tst iperf3m4.py: using LAC 18877 03:52:13.358300 tst iperf3m4.py: using RAC 7 03:52:13.476330 tst iperf3m4.py: using CellId 18877 03:52:13.594462 tst iperf3m4.py: using BVCI 18878 03:52:13.712047 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:52:13.723688 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:52:13.734675 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:52:13.746206 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:52:13.757598 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:52:13.768874 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:52:13.780260 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:52:13.791696 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:52:13.803044 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 03:52:13.920293 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 03:52:14.037545 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 03:52:14.157759 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 03:52:14.271704 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 03:52:14.471873 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:52:14.770995 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20606): Launched 03:52:15.031090 run iperf3-srv_10.42.42.10(pid=20607): Launched 03:52:15.143465 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 03:52:15.342512 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:52:15.640286 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20608): Launched 03:52:15.913670 run iperf3-srv_10.42.42.10(pid=20609): Launched 03:52:16.036258 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 03:52:16.274131 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:52:16.669557 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20610): Launched 03:52:16.965173 run iperf3-srv_10.42.42.10(pid=20611): Launched 03:52:17.125210 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 03:52:17.336864 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:52:17.635961 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20612): Launched 03:52:17.896272 run iperf3-srv_10.42.42.10(pid=20613): Launched 03:52:18.008584 tst iperf3m4.py:8: start network... 03:52:18.206576 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:52:18.666750 run create_hlr_db(pid=20614): Launched 03:52:18.789732 bus /gobi_6: Setting Powered False 03:52:19.849683 run create_hlr_db(pid=20614): Terminated: ok {rc=0} 03:52:20.266176 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20616): Launched 03:52:20.564675 run osmo-hlr_10.42.42.2(pid=20617): Launched 03:52:20.678042 run osmo-stp_10.42.42.5: Starting osmo-stp 03:52:21.203645 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20619): Launched 03:52:21.501530 run osmo-stp_10.42.42.5(pid=20620): Launched 03:52:21.615433 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:52:22.130348 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20622): Launched 03:52:22.244243 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:52:22.495639 run patchelf(pid=20623): Launched 03:52:22.662258 run osmo-stp_10.42.42.5(pid=20620): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20620)] 03:52:22.788180 run osmo-stp_10.42.42.5(pid=20620): stdout: | (launched: 2022-12-09_03:52:21.446849) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:52:22.916241 run osmo-stp_10.42.42.5(pid=20620): stderr: | 20221209035221614 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035221614 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035221614 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035221614 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035221615 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035221615 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035221615 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:52:23.043751 run osmo-stp_10.42.42.5(pid=20620): stdout: | (launched: 2022-12-09_03:52:21.446849) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:52:23.165559 run osmo-stp_10.42.42.5(pid=20620): stderr: | 20221209035221614 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035221614 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035221614 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035221614 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035221615 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035221615 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035221615 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:52:23.310124 run patchelf(pid=20623): Terminating (SIGINT) 03:52:23.477987 run patchelf(pid=20623): Terminated: ok {rc=0} 03:52:23.598779 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20620): Process ended prematurely: osmo-stp_10.42.42.5(pid=20620) [trial-2354↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20620)] [trial-2354↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8] 03:52:23.608170 tst iperf3m4.py:8: Test FAILED (10.5 sec) 03:52:23.635592 run osmo-hlr_10.42.42.2(pid=20617): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20617)] 03:52:23.683170 run osmo-hlr_10.42.42.2(pid=20617): stdout: | (launched: 2022-12-09_03:52:20.509669) 03:52:23.732832 run osmo-hlr_10.42.42.2(pid=20617): stderr: | 20221209035220685 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209035220686 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209035220686 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209035220686 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209035220686 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209035220686 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209035220698 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:oc2g+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209035220707 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209035220707 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209035220707 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:52:23.782683 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20606): Terminating (SIGTERM) 03:52:23.822552 run iperf3-srv_10.42.42.10(pid=20607): Terminating (SIGTERM) 03:52:23.862413 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20608): Terminating (SIGTERM) 03:52:23.902148 run iperf3-srv_10.42.42.10(pid=20609): Terminating (SIGTERM) 03:52:23.941888 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20610): Terminating (SIGTERM) 03:52:23.981671 run iperf3-srv_10.42.42.10(pid=20611): Terminating (SIGTERM) 03:52:24.022711 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20612): Terminating (SIGTERM) 03:52:24.063123 run iperf3-srv_10.42.42.10(pid=20613): Terminating (SIGTERM) 03:52:24.102714 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20616): Terminating (SIGTERM) 03:52:24.142407 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20619): Terminating (SIGTERM) 03:52:24.182057 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20622): Terminating (SIGTERM) 03:52:24.221739 --- ParallelTerminationStrategy: PID 20606 died... 03:52:24.240851 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20606): Terminated: ok {rc=0} 03:52:24.285044 --- ParallelTerminationStrategy: PID 20607 died... 03:52:24.303495 run iperf3-srv_10.42.42.10(pid=20607): Terminated {rc=256} 03:52:24.347577 --- ParallelTerminationStrategy: PID 20608 died... 03:52:24.366246 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20608): Terminated: ok {rc=0} 03:52:24.410203 --- ParallelTerminationStrategy: PID 20609 died... 03:52:24.428752 run iperf3-srv_10.42.42.10(pid=20609): Terminated {rc=256} 03:52:24.472576 --- ParallelTerminationStrategy: PID 20610 died... 03:52:24.491232 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20610): Terminated: ok {rc=0} 03:52:24.535229 --- ParallelTerminationStrategy: PID 20611 died... 03:52:24.553856 run iperf3-srv_10.42.42.10(pid=20611): Terminated {rc=256} 03:52:24.598283 --- ParallelTerminationStrategy: PID 20612 died... 03:52:24.616849 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20612): Terminated: ok {rc=0} 03:52:24.660665 --- ParallelTerminationStrategy: PID 20613 died... 03:52:24.679439 run iperf3-srv_10.42.42.10(pid=20613): Terminated {rc=256} 03:52:24.723174 --- ParallelTerminationStrategy: PID 20616 died... 03:52:24.741957 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20616): Terminated: ok {rc=0} 03:52:24.785827 --- ParallelTerminationStrategy: PID 20619 died... 03:52:24.804517 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20619): Terminated: ok {rc=0} 03:52:24.848327 --- ParallelTerminationStrategy: PID 20622 died... 03:52:24.866906 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20622): Terminated: ok {rc=0} 03:52:24.952418 bus /gobi_4: Setting Powered False 03:52:26.053144 bus /gobi_4: Setting Powered False 03:52:27.169240 bus /gobi_1: Setting Powered False 03:52:28.271640 bus /gobi_1: Setting Powered False 03:52:29.387473 bus /gobi_0: Setting Powered False 03:52:30.482251 bus /gobi_0: Setting Powered False 03:52:31.611381 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:oc2g+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 03:52:32.718992 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:52:32.731286 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 03:52:32.791178 tst ping.py: using LAC 18878 03:52:32.916136 tst ping.py: using RAC 8 03:52:33.039462 tst ping.py: using CellId 18878 03:52:33.163007 tst ping.py: using BVCI 18879 03:52:33.278600 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:52:33.289882 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:52:33.300815 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:52:33.312083 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:52:33.323593 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:52:33.334777 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:52:33.346266 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:52:33.357475 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 03:52:33.475499 tst ping.py:19: start network... 03:52:33.687106 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:52:34.173769 run create_hlr_db(pid=20624): Launched 03:52:34.293745 bus /gobi_6: Setting Powered False 03:52:35.356332 run create_hlr_db(pid=20624): Terminated: ok {rc=0} 03:52:35.781883 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20629): Launched 03:52:36.075380 run osmo-hlr_10.42.42.2(pid=20631): Launched 03:52:36.187023 run osmo-stp_10.42.42.5: Starting osmo-stp 03:52:36.693783 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20633): Launched 03:52:36.986978 run osmo-stp_10.42.42.5(pid=20634): Launched 03:52:37.098522 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:52:37.603103 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20636): Launched 03:52:37.715436 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:52:37.963755 run patchelf(pid=20637): Launched 03:52:38.127486 run osmo-stp_10.42.42.5(pid=20634): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20634)] 03:52:38.251751 run osmo-stp_10.42.42.5(pid=20634): stdout: | (launched: 2022-12-09_03:52:36.933347) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:52:38.377966 run osmo-stp_10.42.42.5(pid=20634): stderr: | 20221209035237102 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035237102 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035237102 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035237103 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035237103 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035237103 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035237103 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:52:38.504113 run osmo-stp_10.42.42.5(pid=20634): stdout: | (launched: 2022-12-09_03:52:36.933347) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:52:38.624629 run osmo-stp_10.42.42.5(pid=20634): stderr: | 20221209035237102 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035237102 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035237102 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035237103 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035237103 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035237103 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035237103 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:52:38.767505 run patchelf(pid=20637): Terminating (SIGINT) 03:52:38.932884 run patchelf(pid=20637): Terminated: ok {rc=0} 03:52:39.052120 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=20634): Process ended prematurely: osmo-stp_10.42.42.5(pid=20634) [trial-2354↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20634)] [trial-2354↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22] 03:52:39.061070 tst ping.py:22: Test FAILED (6.3 sec) 03:52:39.087890 run osmo-hlr_10.42.42.2(pid=20631): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20631)] 03:52:39.136059 run osmo-hlr_10.42.42.2(pid=20631): stdout: | (launched: 2022-12-09_03:52:36.021730) 03:52:39.185965 run osmo-hlr_10.42.42.2(pid=20631): stderr: | 20221209035236194 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209035236194 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209035236194 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209035236194 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209035236194 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209035236194 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209035236207 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:oc2g+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209035236218 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209035236218 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209035236218 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:52:39.236240 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20629): Terminating (SIGTERM) 03:52:39.276370 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20633): Terminating (SIGTERM) 03:52:39.316400 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20636): Terminating (SIGTERM) 03:52:39.356703 --- ParallelTerminationStrategy: PID 20629 died... 03:52:39.376044 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20629): Terminated: ok {rc=0} 03:52:39.420546 --- ParallelTerminationStrategy: PID 20633 died... 03:52:39.439547 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20633): Terminated: ok {rc=0} 03:52:39.484010 --- ParallelTerminationStrategy: PID 20636 died... 03:52:39.502885 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20636): Terminated: ok {rc=0} 03:52:39.586911 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:oc2g+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 03:52:40.674707 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:52:40.686739 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 03:52:40.746362 tst ping_idle_ping.py: using LAC 18879 03:52:40.871504 tst ping_idle_ping.py: using RAC 9 03:52:40.996815 tst ping_idle_ping.py: using CellId 18879 03:52:41.120554 tst ping_idle_ping.py: using BVCI 18880 03:52:41.235419 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:52:41.246741 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:52:41.257833 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:52:41.269121 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:52:41.280256 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:52:41.291513 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:52:41.302939 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:52:41.314436 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 03:52:41.428850 tst ping_idle_ping.py:24: start network... 03:52:41.625190 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:52:42.087827 run create_hlr_db(pid=20638): Launched 03:52:42.209392 bus /gobi_6: Setting Powered False 03:52:43.267920 run create_hlr_db(pid=20638): Terminated: ok {rc=0} 03:52:43.699203 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20640): Launched 03:52:43.994421 run osmo-hlr_10.42.42.2(pid=20641): Launched 03:52:44.105967 run osmo-stp_10.42.42.5: Starting osmo-stp 03:52:44.611841 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20643): Launched 03:52:44.905751 run osmo-stp_10.42.42.5(pid=20644): Launched 03:52:45.018628 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:52:45.525275 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20646): Launched 03:52:45.638246 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:52:45.897989 run patchelf(pid=20647): Launched 03:52:46.123979 run osmo-stp_10.42.42.5(pid=20644): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20644)] 03:52:46.264293 run osmo-stp_10.42.42.5(pid=20644): stdout: | (launched: 2022-12-09_03:52:44.852021) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:52:46.405661 run osmo-stp_10.42.42.5(pid=20644): stderr: | 20221209035245022 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035245022 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035245022 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035245023 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035245023 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035245023 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035245023 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:52:46.546459 run osmo-stp_10.42.42.5(pid=20644): stdout: | (launched: 2022-12-09_03:52:44.852021) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:52:46.682482 run osmo-stp_10.42.42.5(pid=20644): stderr: | 20221209035245022 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035245022 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035245022 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035245023 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035245023 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035245023 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035245023 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:52:46.843199 run patchelf(pid=20647): Terminating (SIGINT) 03:52:47.027599 run patchelf(pid=20647): Terminated: ok {rc=0} 03:52:47.160246 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=20644): Process ended prematurely: osmo-stp_10.42.42.5(pid=20644) [trial-2354↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20644)] [trial-2354↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 03:52:47.170883 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 03:52:47.202065 run osmo-hlr_10.42.42.2(pid=20641): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20641)] 03:52:47.250838 run osmo-hlr_10.42.42.2(pid=20641): stdout: | (launched: 2022-12-09_03:52:43.940236) 03:52:47.300701 run osmo-hlr_10.42.42.2(pid=20641): stderr: | 20221209035244113 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209035244113 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209035244113 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209035244113 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209035244113 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209035244113 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209035244125 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:oc2g+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209035244134 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209035244135 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209035244135 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:52:47.351076 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20640): Terminating (SIGTERM) 03:52:47.391478 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20643): Terminating (SIGTERM) 03:52:47.432053 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20646): Terminating (SIGTERM) 03:52:47.472564 --- ParallelTerminationStrategy: PID 20640 died... 03:52:47.491957 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20640): Terminated: ok {rc=0} 03:52:47.536361 --- ParallelTerminationStrategy: PID 20643 died... 03:52:47.555307 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20643): Terminated: ok {rc=0} 03:52:47.599589 --- ParallelTerminationStrategy: PID 20646 died... 03:52:47.618447 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20646): Terminated: ok {rc=0} 03:52:47.705127 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2354 gprs:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 03:52:48.994768 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:52:49.003561 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 03:52:49.026334 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 03:52:49.061661 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 03:52:49.114898 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 03:52:49.135616 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 03:52:49.170761 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 03:52:49.726844 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2354 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 03:52:49.731964 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:52:49.742902 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 03:52:49.798923 tst switch_tch_pdch.py: using LAC 18880 03:52:49.912819 tst switch_tch_pdch.py: using RAC 10 03:52:50.027543 tst switch_tch_pdch.py: using CellId 18880 03:52:50.145983 tst switch_tch_pdch.py: using BVCI 18881 03:52:50.251714 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:52:50.262780 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:52:50.273562 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:52:50.284466 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:52:50.295158 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:52:50.306061 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:52:50.316874 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:52:50.327598 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:52:50.446275 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:52:50.564088 tst switch_tch_pdch.py:51: start network... 03:52:50.775045 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:52:51.262007 run create_hlr_db(pid=20651): Launched 03:52:51.382318 bus /gobi_6: Setting Powered False 03:52:52.445725 run create_hlr_db(pid=20651): Terminated: ok {rc=0} 03:52:52.866531 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20653): Launched 03:52:53.158307 run osmo-hlr_10.42.42.2(pid=20654): Launched 03:52:53.269668 run osmo-stp_10.42.42.5: Starting osmo-stp 03:52:53.791600 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20656): Launched 03:52:54.084545 run osmo-stp_10.42.42.5(pid=20657): Launched 03:52:54.196056 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:52:54.702928 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20659): Launched 03:52:54.815331 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:52:55.062550 run patchelf(pid=20660): Launched 03:52:55.225861 run osmo-stp_10.42.42.5(pid=20657): ERR: Terminated: ERROR {rc=1} [trial-2354↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20657)] 03:52:55.350003 run osmo-stp_10.42.42.5(pid=20657): stdout: | (launched: 2022-12-09_03:52:54.031119) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:52:55.476117 run osmo-stp_10.42.42.5(pid=20657): stderr: | 20221209035254198 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035254198 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035254198 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035254199 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035254199 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035254199 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035254199 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:52:55.602067 run osmo-stp_10.42.42.5(pid=20657): stdout: | (launched: 2022-12-09_03:52:54.031119) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:52:55.722736 run osmo-stp_10.42.42.5(pid=20657): stderr: | 20221209035254198 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035254198 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035254198 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035254199 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035254199 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035254199 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035254199 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:52:55.865895 run patchelf(pid=20660): Terminating (SIGINT) 03:52:56.032130 run patchelf(pid=20660): Terminated: ok {rc=0} 03:52:56.151648 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=20657): Process ended prematurely: osmo-stp_10.42.42.5(pid=20657) [trial-2354↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20657)] [trial-2354↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 03:52:56.160590 tst switch_tch_pdch.py:54: Test FAILED (6.4 sec) 03:52:56.187412 run osmo-hlr_10.42.42.2(pid=20654): ERR: Terminated: ERROR {rc=237} [trial-2354↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20654)] 03:52:56.235224 run osmo-hlr_10.42.42.2(pid=20654): stdout: | (launched: 2022-12-09_03:52:53.104702) 03:52:56.285423 run osmo-hlr_10.42.42.2(pid=20654): stderr: | 20221209035253279 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209035253279 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209035253279 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209035253279 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209035253279 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209035253279 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209035253292 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209035253300 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209035253301 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209035253301 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:52:56.335601 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20653): Terminating (SIGTERM) 03:52:56.375885 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20656): Terminating (SIGTERM) 03:52:56.415690 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20659): Terminating (SIGTERM) 03:52:56.455708 --- ParallelTerminationStrategy: PID 20653 died... 03:52:56.474902 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20653): Terminated: ok {rc=0} 03:52:56.519079 --- ParallelTerminationStrategy: PID 20656 died... 03:52:56.537711 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20656): Terminated: ok {rc=0} 03:52:56.581837 --- ParallelTerminationStrategy: PID 20659 died... 03:52:56.600350 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20659): Terminated: ok {rc=0} 03:52:56.684549 bus /gobi_0: Setting Powered False 03:52:57.781207 bus /gobi_0: Setting Powered False 03:52:58.897285 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2354 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 dynts:oc2g+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 03:53:00.137110 tst dynts:oc2g+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:53:00.143076 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 03:53:00.164265 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 03:53:00.200472 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 03:53:00.255793 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 03:53:00.277315 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 03:53:00.312359 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 03:53:00.897503 tst dynts:oc2g+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2354 dynts:oc2g+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 03:53:00.904022 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 03:53:00.916244 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 03:53:00.978626 tst switch_tch_pdch.py: using LAC 18881 03:53:01.104692 tst switch_tch_pdch.py: using RAC 11 03:53:01.222701 tst switch_tch_pdch.py: using CellId 18881 03:53:01.353189 tst switch_tch_pdch.py: using BVCI 18882 03:53:01.509244 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 03:53:01.526844 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 03:53:01.542889 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 03:53:01.560206 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 03:53:01.577742 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 03:53:01.597560 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 03:53:01.615975 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 03:53:01.636067 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 03:53:01.780214 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 03:53:01.927381 tst switch_tch_pdch.py:51: start network... 03:53:02.161482 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:53:02.716615 run create_hlr_db(pid=20719): Launched 03:53:02.936250 bus /gobi_6: Setting Powered False 03:53:04.019434 run create_hlr_db(pid=20719): Terminated: ok {rc=0} 03:53:04.449884 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20936): Launched 03:53:04.759758 run osmo-hlr_10.42.42.2(pid=20937): Launched 03:53:04.991275 run osmo-stp_10.42.42.5: Starting osmo-stp 03:53:05.673170 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20939): Launched 03:53:05.998166 run osmo-stp_10.42.42.5(pid=20941): Launched 03:53:06.223886 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:53:06.849586 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20944): Launched 03:53:06.965466 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:53:07.225449 run patchelf(pid=20945): Launched 03:53:07.408831 run osmo-stp_10.42.42.5(pid=20941): ERR: Terminated: ERROR {rc=1} [trial-2354↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20941)] 03:53:07.538044 run osmo-stp_10.42.42.5(pid=20941): stdout: | (launched: 2022-12-09_03:53:05.931696) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:53:07.668763 run osmo-stp_10.42.42.5(pid=20941): stderr: | 20221209035306231 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035306231 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035306231 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035306232 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035306232 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035306232 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035306232 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:53:07.798593 run osmo-stp_10.42.42.5(pid=20941): stdout: | (launched: 2022-12-09_03:53:05.931696) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:53:07.925582 run osmo-stp_10.42.42.5(pid=20941): stderr: | 20221209035306231 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035306231 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035306231 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035306232 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035306232 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035306232 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035306232 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:53:08.072518 run patchelf(pid=20945): Terminating (SIGINT) 03:53:08.245478 run patchelf(pid=20945): Terminated: ok {rc=0} 03:53:08.368628 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=20941): Process ended prematurely: osmo-stp_10.42.42.5(pid=20941) [trial-2354↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20941)] [trial-2354↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 03:53:08.378846 tst switch_tch_pdch.py:54: Test FAILED (7.5 sec) 03:53:08.408204 run osmo-hlr_10.42.42.2(pid=20937): ERR: Terminated: ERROR {rc=237} [trial-2354↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20937)] 03:53:08.458194 run osmo-hlr_10.42.42.2(pid=20937): stdout: | (launched: 2022-12-09_03:53:04.699485) 03:53:08.509919 run osmo-hlr_10.42.42.2(pid=20937): stderr: | 20221209035305041 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209035305041 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209035305041 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209035305041 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209035305041 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209035305042 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209035305059 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/dynts:oc2g+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209035305072 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209035305072 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209035305072 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:53:08.562573 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20936): Terminating (SIGTERM) 03:53:08.606016 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20939): Terminating (SIGTERM) 03:53:08.649659 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20944): Terminating (SIGTERM) 03:53:08.693658 --- ParallelTerminationStrategy: PID 20936 died... 03:53:08.714112 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20936): Terminated: ok {rc=0} 03:53:08.761629 --- ParallelTerminationStrategy: PID 20939 died... 03:53:08.781477 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20939): Terminated: ok {rc=0} 03:53:08.829889 --- ParallelTerminationStrategy: PID 20944 died... 03:53:08.849646 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20944): Terminated: ok {rc=0} 03:53:08.937338 bus /gobi_0: Setting Powered False 03:53:10.037546 bus /gobi_0: Setting Powered False 03:53:11.157949 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2354 dynts:oc2g+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 nitb_sms:trx-b200 --------------------------------------------------------------------- 03:53:12.400809 tst nitb_sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:53:12.405993 tst nitb_sms:trx-b200: Verifying 1 x bts (candidates: 11) 03:53:12.444679 tst nitb_sms:trx-b200: Verifying 1 x ip_address (candidates: 9) 03:53:12.452902 tst nitb_sms:trx-b200: Verifying 2 x modem (candidates: 12) 03:53:12.507679 tst nitb_sms:trx-b200: Reserving 1 x bts (candidates: 11) 03:53:12.544157 tst nitb_sms:trx-b200: Reserving 1 x ip_address (candidates: 9) 03:53:12.551999 tst nitb_sms:trx-b200: Reserving 2 x modem (candidates: 12) 03:53:13.091463 tst nitb_sms:trx-b200: RESERVED RESOURCES for nitb_sms: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 nitb_sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 03:53:13.098236 tst nitb_sms:trx-b200: Using 1 x ip_address (candidates: 1) 03:53:13.110583 tst nitb_sms:trx-b200: Using 1 x bts (candidates: 1) 03:53:13.165568 tst mo_mt_sms.py: using LAC 18882 03:53:13.295491 tst mo_mt_sms.py: using RAC 12 03:53:13.426882 tst mo_mt_sms.py: using CellId 18882 03:53:13.560058 tst mo_mt_sms.py: using BVCI 18883 03:53:13.683362 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 03:53:13.806925 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 03:53:13.930441 tst mo_mt_sms.py:9: start nitb and bts... 03:53:14.155152 run osmo-nitb_10.42.42.2: Starting osmo-nitb 03:53:14.832138 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20949): Launched 03:53:15.170017 run osmo-nitb_10.42.42.2(pid=20950): Launched 03:53:15.373675 run osmo-nitb_10.42.42.2(pid=20950): ERR: Terminated: ERROR {rc=2} [trial-2354↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20950)] 03:53:15.523462 run osmo-nitb_10.42.42.2(pid=20950): stdout: | (launched: 2022-12-09_03:53:15.111506) 03:53:15.675419 run osmo-nitb_10.42.42.2(pid=20950): stderr: | (launched: 2022-12-09_03:53:15.160122) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:53:15.826892 run osmo-nitb_10.42.42.2(pid=20950): stdout: | (launched: 2022-12-09_03:53:15.111506) 03:53:15.986865 run osmo-nitb_10.42.42.2(pid=20950): stderr: | (launched: 2022-12-09_03:53:15.160122) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f4d467d3268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=20950): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20950) [trial-2354↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20950)] 03:53:16.315361 tst osmo-nitb_10.42.42.2(pid=20950): stdout: | (launched: 2022-12-09_03:53:15.111506) 03:53:16.455900 tst osmo-nitb_10.42.42.2(pid=20950): stderr: | (launched: 2022-12-09_03:53:15.160122) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:53:16.614230 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=20950): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20950) [trial-2354↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20950)] [trial-2354↪nitb_sms:trx-b200↪mo_mt_sms.py:11] 03:53:16.624604 tst mo_mt_sms.py:11: Test FAILED (3.5 sec) 03:53:16.633007 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20949): Terminating (SIGTERM) 03:53:16.850072 --- ParallelTerminationStrategy: PID 20949 died... 03:53:16.879876 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20949): Terminated: ok {rc=0} 03:53:16.990425 bus /sierra_3: Setting Powered False 03:53:18.099206 bus /sierra_3: Setting Powered False 03:53:19.226674 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 nitb_sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 sms:trx-b200 --------------------------------------------------------------------- 03:53:20.437768 tst sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:53:20.443097 tst sms:trx-b200: Verifying 1 x bts (candidates: 11) 03:53:20.481250 tst sms:trx-b200: Verifying 6 x ip_address (candidates: 9) 03:53:20.511040 tst sms:trx-b200: Verifying 2 x modem (candidates: 12) 03:53:20.564783 tst sms:trx-b200: Reserving 1 x bts (candidates: 11) 03:53:20.602256 tst sms:trx-b200: Reserving 6 x ip_address (candidates: 9) 03:53:20.631801 tst sms:trx-b200: Reserving 2 x modem (candidates: 12) 03:53:21.174343 tst sms:trx-b200: RESERVED RESOURCES for sms: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 03:53:21.181183 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 03:53:21.193726 tst sms:trx-b200: Using 1 x bts (candidates: 1) 03:53:21.248211 tst mo_mt_sms.py: using LAC 18883 03:53:21.376135 tst mo_mt_sms.py: using RAC 13 03:53:21.505423 tst mo_mt_sms.py: using CellId 18883 03:53:21.635597 tst mo_mt_sms.py: using BVCI 18884 03:53:21.756539 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 03:53:21.768559 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 03:53:21.780414 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 03:53:21.794725 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 03:53:21.809163 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 03:53:21.820864 tst sms:trx-b200: Using 1 x modem (candidates: 2) 03:53:21.946995 tst sms:trx-b200: Using 1 x modem (candidates: 2) 03:53:22.071119 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:53:22.582741 run create_hlr_db(pid=20954): Launched 03:53:22.748507 bus /sierra_2: Setting Powered False 03:53:23.813954 run create_hlr_db(pid=20954): Terminated: ok {rc=0} 03:53:24.255475 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20956): Launched 03:53:24.552009 run osmo-hlr_10.42.42.2(pid=20957): Launched 03:53:24.664269 run osmo-stp_10.42.42.5: Starting osmo-stp 03:53:25.187385 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20959): Launched 03:53:25.482096 run osmo-stp_10.42.42.5(pid=20960): Launched 03:53:25.596253 run osmo-msc_10.42.42.6: Starting osmo-msc 03:53:26.148320 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20962): Launched 03:53:26.444068 run osmo-msc_10.42.42.6(pid=20963): Launched 03:53:26.609286 run osmo-stp_10.42.42.5(pid=20960): ERR: Terminated: ERROR {rc=1} [trial-2354↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20960)] 03:53:26.733728 run osmo-stp_10.42.42.5(pid=20960): stdout: | (launched: 2022-12-09_03:53:25.428005) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:53:26.859471 run osmo-stp_10.42.42.5(pid=20960): stderr: | 20221209035325599 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035325599 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035325600 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035325600 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035325600 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035325601 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035325601 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:53:26.983093 run osmo-stp_10.42.42.5(pid=20960): stdout: | (launched: 2022-12-09_03:53:25.428005) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:53:27.100164 run osmo-stp_10.42.42.5(pid=20960): stderr: | 20221209035325599 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035325599 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035325600 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035325600 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035325600 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035325601 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035325601 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:53:27.240597 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=20960): Process ended prematurely: osmo-stp_10.42.42.5(pid=20960) [trial-2354↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20960)] [trial-2354↪sms:trx-b200↪mo_mt_sms.py:16] 03:53:27.249011 tst mo_mt_sms.py:16: Test FAILED (6.1 sec) 03:53:27.275167 run osmo-hlr_10.42.42.2(pid=20957): ERR: Terminated: ERROR {rc=237} [trial-2354↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20957)] 03:53:27.322821 run osmo-hlr_10.42.42.2(pid=20957): stdout: | (launched: 2022-12-09_03:53:24.496924) 03:53:27.372218 run osmo-hlr_10.42.42.2(pid=20957): stderr: | 20221209035324675 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209035324675 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209035324675 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209035324675 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209035324675 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209035324675 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209035324686 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/sms:trx-b200/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209035324695 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209035324695 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209035324695 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:53:27.441380 run osmo-msc_10.42.42.6(pid=20963): ERR: Terminated: ERROR {rc=2} [trial-2354↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20963)] 03:53:27.488807 run osmo-msc_10.42.42.6(pid=20963): stdout: | (launched: 2022-12-09_03:53:26.390047) 03:53:27.538017 run osmo-msc_10.42.42.6(pid=20963): stderr: | 20221209035326663 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209035326664 DLGLOBAL DEBUG validating counter group 0x7f0f5c082c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209035326664 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209035326664 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209035326664 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209035326664 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209035326666 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209035326666 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209035326667 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209035326667 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:53:27.587666 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20956): Terminating (SIGTERM) 03:53:27.627747 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20959): Terminating (SIGTERM) 03:53:27.667723 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20962): Terminating (SIGTERM) 03:53:27.707926 --- ParallelTerminationStrategy: PID 20956 died... 03:53:27.727148 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20956): Terminated: ok {rc=0} 03:53:27.771280 --- ParallelTerminationStrategy: PID 20959 died... 03:53:27.790012 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20959): Terminated: ok {rc=0} 03:53:27.834366 --- ParallelTerminationStrategy: PID 20962 died... 03:53:27.852868 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20962): Terminated: ok {rc=0} 03:53:27.940293 bus /sierra_3: Setting Powered False 03:53:29.041217 bus /sierra_3: Setting Powered False 03:53:30.155848 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 nitb_ussd:trx-b200 --------------------------------------------------------------------- 03:53:31.415425 tst nitb_ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:53:31.421634 tst nitb_ussd:trx-b200: Verifying 1 x bts (candidates: 11) 03:53:31.461628 tst nitb_ussd:trx-b200: Verifying 1 x ip_address (candidates: 9) 03:53:31.469225 tst nitb_ussd:trx-b200: Verifying 1 x modem (candidates: 12) 03:53:31.507911 tst nitb_ussd:trx-b200: Reserving 1 x bts (candidates: 11) 03:53:31.548862 tst nitb_ussd:trx-b200: Reserving 1 x ip_address (candidates: 9) 03:53:31.557240 tst nitb_ussd:trx-b200: Reserving 1 x modem (candidates: 12) 03:53:32.086148 tst nitb_ussd:trx-b200: RESERVED RESOURCES for nitb_ussd: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2354 nitb_ussd:trx-b200 assert_extension.py ---------------------------------------------- 03:53:32.094171 tst nitb_ussd:trx-b200: Using 1 x ip_address (candidates: 1) 03:53:32.111466 tst nitb_ussd:trx-b200: Using 1 x bts (candidates: 1) 03:53:32.175277 tst assert_extension.py: using LAC 18884 03:53:32.299592 tst assert_extension.py: using RAC 14 03:53:32.415941 tst assert_extension.py: using CellId 18884 03:53:32.536213 tst assert_extension.py: using BVCI 18885 03:53:32.643821 tst nitb_ussd:trx-b200: Using 1 x modem (candidates: 1) 03:53:32.761995 tst assert_extension.py:10: start nitb and bts... 03:53:32.977457 run osmo-nitb_10.42.42.2: Starting osmo-nitb 03:53:33.625329 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20968): Launched 03:53:33.944659 run osmo-nitb_10.42.42.2(pid=20969): Launched 03:53:34.121156 run osmo-nitb_10.42.42.2(pid=20969): ERR: Terminated: ERROR {rc=2} [trial-2354↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20969)] 03:53:34.263699 run osmo-nitb_10.42.42.2(pid=20969): stdout: | (launched: 2022-12-09_03:53:33.887000) 03:53:34.408127 run osmo-nitb_10.42.42.2(pid=20969): stderr: | (launched: 2022-12-09_03:53:33.934246) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:53:34.552018 run osmo-nitb_10.42.42.2(pid=20969): stdout: | (launched: 2022-12-09_03:53:33.887000) 03:53:34.690425 run osmo-nitb_10.42.42.2(pid=20969): stderr: | (launched: 2022-12-09_03:53:33.934246) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f4d467d3268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=20969): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20969) [trial-2354↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20969)] 03:53:35.065419 tst osmo-nitb_10.42.42.2(pid=20969): stdout: | (launched: 2022-12-09_03:53:33.887000) 03:53:35.193451 tst osmo-nitb_10.42.42.2(pid=20969): stderr: | (launched: 2022-12-09_03:53:33.934246) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:53:35.344323 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=20969): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20969) [trial-2354↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20969)] [trial-2354↪nitb_ussd:trx-b200↪assert_extension.py:12] 03:53:35.353443 tst assert_extension.py:12: Test FAILED (3.3 sec) 03:53:35.360429 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20968): Terminating (SIGTERM) 03:53:35.572325 --- ParallelTerminationStrategy: PID 20968 died... 03:53:35.593953 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20968): Terminated: ok {rc=0} 03:53:35.683154 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 nitb_ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 ussd:trx-b200 --------------------------------------------------------------------- 03:53:36.857790 tst ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:53:36.861846 tst ussd:trx-b200: Verifying 1 x bts (candidates: 11) 03:53:36.894967 tst ussd:trx-b200: Verifying 6 x ip_address (candidates: 9) 03:53:36.921381 tst ussd:trx-b200: Verifying 1 x modem (candidates: 12) 03:53:36.956764 tst ussd:trx-b200: Reserving 1 x bts (candidates: 11) 03:53:36.990965 tst ussd:trx-b200: Reserving 6 x ip_address (candidates: 9) 03:53:37.018545 tst ussd:trx-b200: Reserving 1 x modem (candidates: 12) 03:53:37.544170 tst ussd:trx-b200: RESERVED RESOURCES for ussd: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2354 ussd:trx-b200 assert_extension.py ---------------------------------------------- 03:53:37.549452 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 03:53:37.559988 tst ussd:trx-b200: Using 1 x bts (candidates: 1) 03:53:37.607523 tst assert_extension.py: using LAC 18885 03:53:37.723500 tst assert_extension.py: using RAC 15 03:53:37.840749 tst assert_extension.py: using CellId 18885 03:53:37.956905 tst assert_extension.py: using BVCI 18886 03:53:38.063949 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 03:53:38.074615 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 03:53:38.084917 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 03:53:38.095434 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 03:53:38.105768 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 03:53:38.116046 tst ussd:trx-b200: Using 1 x modem (candidates: 1) 03:53:38.233218 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:53:38.724342 run create_hlr_db(pid=20974): Launched 03:53:38.845892 bus /sierra_2: Setting Powered False 03:53:39.908323 run create_hlr_db(pid=20974): Terminated: ok {rc=0} 03:53:40.327896 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20976): Launched 03:53:40.626554 run osmo-hlr_10.42.42.2(pid=20977): Launched 03:53:40.740213 run osmo-stp_10.42.42.5: Starting osmo-stp 03:53:41.255531 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20979): Launched 03:53:41.551436 run osmo-stp_10.42.42.5(pid=20980): Launched 03:53:41.665378 run osmo-msc_10.42.42.6: Starting osmo-msc 03:53:42.199838 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20982): Launched 03:53:42.496011 run osmo-msc_10.42.42.6(pid=20983): Launched 03:53:42.661273 run osmo-stp_10.42.42.5(pid=20980): ERR: Terminated: ERROR {rc=1} [trial-2354↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20980)] 03:53:42.785891 run osmo-stp_10.42.42.5(pid=20980): stdout: | (launched: 2022-12-09_03:53:41.497319) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:53:42.910969 run osmo-stp_10.42.42.5(pid=20980): stderr: | 20221209035341667 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035341667 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035341668 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035341668 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035341669 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035341669 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035341669 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:53:43.034900 run osmo-stp_10.42.42.5(pid=20980): stdout: | (launched: 2022-12-09_03:53:41.497319) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:53:43.152459 run osmo-stp_10.42.42.5(pid=20980): stderr: | 20221209035341667 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035341667 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035341668 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035341668 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035341669 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035341669 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035341669 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:53:43.293212 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=20980): Process ended prematurely: osmo-stp_10.42.42.5(pid=20980) [trial-2354↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20980)] [trial-2354↪ussd:trx-b200↪assert_extension.py:17] 03:53:43.301648 tst assert_extension.py:17: Test FAILED (5.7 sec) 03:53:43.327934 run osmo-hlr_10.42.42.2(pid=20977): ERR: Terminated: ERROR {rc=237} [trial-2354↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20977)] 03:53:43.376014 run osmo-hlr_10.42.42.2(pid=20977): stdout: | (launched: 2022-12-09_03:53:40.572417) 03:53:43.425816 run osmo-hlr_10.42.42.2(pid=20977): stderr: | 20221209035340746 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209035340746 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209035340746 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209035340746 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209035340746 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209035340746 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209035340758 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/ussd:trx-b200/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209035340767 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209035340768 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209035340768 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:53:43.495079 run osmo-msc_10.42.42.6(pid=20983): ERR: Terminated: ERROR {rc=2} [trial-2354↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20983)] 03:53:43.543067 run osmo-msc_10.42.42.6(pid=20983): stdout: | (launched: 2022-12-09_03:53:42.441979) 03:53:43.592533 run osmo-msc_10.42.42.6(pid=20983): stderr: | 20221209035342715 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209035342715 DLGLOBAL DEBUG validating counter group 0x7fb87962dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209035342715 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209035342715 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209035342715 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209035342715 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209035342717 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209035342717 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209035342718 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209035342718 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:53:43.642612 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20976): Terminating (SIGTERM) 03:53:43.682366 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20979): Terminating (SIGTERM) 03:53:43.722286 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20982): Terminating (SIGTERM) 03:53:43.762524 --- ParallelTerminationStrategy: PID 20976 died... 03:53:43.781806 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20976): Terminated: ok {rc=0} 03:53:43.826198 --- ParallelTerminationStrategy: PID 20979 died... 03:53:43.844862 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20979): Terminated: ok {rc=0} 03:53:43.889219 --- ParallelTerminationStrategy: PID 20982 died... 03:53:43.907843 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20982): Terminated: ok {rc=0} 03:53:43.991395 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 03:53:45.211411 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:53:45.218986 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 03:53:45.254229 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 03:53:45.281648 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 03:53:45.333739 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 03:53:45.367635 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 03:53:45.394913 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 03:53:45.964631 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 03:53:46.038422 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:53:46.055180 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 03:53:46.138656 tst mo_mt_call.py: using LAC 18886 03:53:46.265759 tst mo_mt_call.py: using RAC 16 03:53:46.420721 tst mo_mt_call.py: using CellId 18886 03:53:46.565630 tst mo_mt_call.py: using BVCI 18887 03:53:46.683215 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:53:46.695034 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:53:46.706905 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:53:46.718899 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:53:46.730488 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:53:46.742116 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 03:53:46.861907 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 03:53:47.005076 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:53:47.535636 run create_hlr_db(pid=20988): Launched 03:53:47.659781 bus /sierra_2: Setting Powered False 03:53:48.724610 run create_hlr_db(pid=20988): Terminated: ok {rc=0} 03:53:49.157403 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20990): Launched 03:53:49.459724 run osmo-hlr_10.42.42.2(pid=20991): Launched 03:53:49.575283 run osmo-stp_10.42.42.5: Starting osmo-stp 03:53:50.109498 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20993): Launched 03:53:50.413326 run osmo-stp_10.42.42.5(pid=20994): Launched 03:53:50.528889 run osmo-msc_10.42.42.6: Starting osmo-msc 03:53:51.073516 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20996): Launched 03:53:51.376079 run osmo-msc_10.42.42.6(pid=20997): Launched 03:53:51.545503 run osmo-stp_10.42.42.5(pid=20994): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20994)] 03:53:51.674031 run osmo-stp_10.42.42.5(pid=20994): stdout: | (launched: 2022-12-09_03:53:50.357617) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:53:51.802190 run osmo-stp_10.42.42.5(pid=20994): stderr: | 20221209035350528 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035350528 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035350528 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035350529 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035350529 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035350529 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035350529 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:53:51.928102 run osmo-stp_10.42.42.5(pid=20994): stdout: | (launched: 2022-12-09_03:53:50.357617) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:53:52.048235 run osmo-stp_10.42.42.5(pid=20994): stderr: | 20221209035350528 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035350528 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035350528 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035350529 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035350529 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035350529 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035350529 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:53:52.192349 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20994): Process ended prematurely: osmo-stp_10.42.42.5(pid=20994) [trial-2354↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20994)] [trial-2354↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 03:53:52.201534 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 03:53:52.228172 run osmo-hlr_10.42.42.2(pid=20991): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20991)] 03:53:52.276507 run osmo-hlr_10.42.42.2(pid=20991): stdout: | (launched: 2022-12-09_03:53:49.404166) 03:53:52.326877 run osmo-hlr_10.42.42.2(pid=20991): stderr: | 20221209035349581 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209035349581 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209035349581 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209035349582 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209035349582 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209035349582 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209035349594 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209035349604 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209035349604 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209035349604 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:53:52.396623 run osmo-msc_10.42.42.6(pid=20997): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20997)] 03:53:52.445529 run osmo-msc_10.42.42.6(pid=20997): stdout: | (launched: 2022-12-09_03:53:51.320679) 03:53:52.495472 run osmo-msc_10.42.42.6(pid=20997): stderr: | 20221209035351591 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209035351591 DLGLOBAL DEBUG validating counter group 0x7f32271f5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209035351591 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209035351591 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209035351592 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209035351592 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209035351594 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209035351594 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209035351594 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209035351594 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:53:52.545958 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20990): Terminating (SIGTERM) 03:53:52.585942 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20993): Terminating (SIGTERM) 03:53:52.625828 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20996): Terminating (SIGTERM) 03:53:52.666129 --- ParallelTerminationStrategy: PID 20990 died... 03:53:52.685290 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20990): Terminated: ok {rc=0} 03:53:52.729738 --- ParallelTerminationStrategy: PID 20993 died... 03:53:52.749020 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20993): Terminated: ok {rc=0} 03:53:52.793428 --- ParallelTerminationStrategy: PID 20996 died... 03:53:52.812201 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20996): Terminated: ok {rc=0} 03:53:52.899179 bus /sierra_3: Setting Powered False 03:53:54.000608 bus /sierra_3: Setting Powered False 03:53:55.117445 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2354 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 03:53:56.264290 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:53:56.276058 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 03:53:56.345549 tst mo_mt_call_osmux.py: using LAC 18887 03:53:56.473261 tst mo_mt_call_osmux.py: using RAC 17 03:53:56.601398 tst mo_mt_call_osmux.py: using CellId 18887 03:53:56.728449 tst mo_mt_call_osmux.py: using BVCI 18888 03:53:56.846420 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:53:56.858189 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:53:56.869673 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:53:56.881385 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:53:56.893421 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:53:56.905051 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 03:53:57.020434 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 03:53:57.141173 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:53:57.642550 run create_hlr_db(pid=20999): Launched 03:53:57.766636 bus /sierra_2: Setting Powered False 03:53:58.830778 run create_hlr_db(pid=20999): Terminated: ok {rc=0} 03:53:59.264046 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21001): Launched 03:53:59.566346 run osmo-hlr_10.42.42.2(pid=21002): Launched 03:53:59.682414 run osmo-stp_10.42.42.5: Starting osmo-stp 03:54:00.220474 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21004): Launched 03:54:00.523004 run osmo-stp_10.42.42.5(pid=21005): Launched 03:54:00.638228 run osmo-msc_10.42.42.6: Starting osmo-msc 03:54:01.240188 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21007): Launched 03:54:01.579546 run osmo-msc_10.42.42.6(pid=21008): Launched 03:54:01.837305 run osmo-stp_10.42.42.5(pid=21005): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21005)] 03:54:02.121890 run osmo-stp_10.42.42.5(pid=21005): stdout: | (launched: 2022-12-09_03:54:00.467464) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:54:02.417605 run osmo-stp_10.42.42.5(pid=21005): stderr: | 20221209035400638 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035400639 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035400639 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035400639 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035400640 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035400640 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035400640 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:54:02.553988 run osmo-stp_10.42.42.5(pid=21005): stdout: | (launched: 2022-12-09_03:54:00.467464) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:54:02.684104 run osmo-stp_10.42.42.5(pid=21005): stderr: | 20221209035400638 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035400639 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035400639 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035400639 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035400640 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035400640 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035400640 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:54:02.839257 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21005): Process ended prematurely: osmo-stp_10.42.42.5(pid=21005) [trial-2354↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21005)] [trial-2354↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 03:54:02.849472 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 03:54:02.878541 run osmo-hlr_10.42.42.2(pid=21002): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21002)] 03:54:02.929972 run osmo-hlr_10.42.42.2(pid=21002): stdout: | (launched: 2022-12-09_03:53:59.510833) 03:54:02.983216 run osmo-hlr_10.42.42.2(pid=21002): stderr: | 20221209035359688 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209035359689 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209035359689 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209035359689 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209035359689 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209035359689 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209035359701 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209035359711 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209035359711 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209035359712 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:54:03.057114 run osmo-msc_10.42.42.6(pid=21008): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21008)] 03:54:03.108235 run osmo-msc_10.42.42.6(pid=21008): stdout: | (launched: 2022-12-09_03:54:01.515037) 03:54:03.161234 run osmo-msc_10.42.42.6(pid=21008): stderr: | 20221209035402068 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209035402068 DLGLOBAL DEBUG validating counter group 0x7faeb16d2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209035402068 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209035402068 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209035402069 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209035402070 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209035402079 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209035402080 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209035402080 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209035402080 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:54:03.214426 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21001): Terminating (SIGTERM) 03:54:03.257549 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21004): Terminating (SIGTERM) 03:54:03.300670 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21007): Terminating (SIGTERM) 03:54:03.344129 --- ParallelTerminationStrategy: PID 21001 died... 03:54:03.364567 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21001): Terminated: ok {rc=0} 03:54:03.412336 --- ParallelTerminationStrategy: PID 21004 died... 03:54:03.432367 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21004): Terminated: ok {rc=0} 03:54:03.480209 --- ParallelTerminationStrategy: PID 21007 died... 03:54:03.500217 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21007): Terminated: ok {rc=0} 03:54:03.590400 bus /sierra_3: Setting Powered False 03:54:04.689151 bus /sierra_3: Setting Powered False 03:54:05.808746 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 03:54:07.061768 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:54:07.068114 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 03:54:07.102098 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 03:54:07.128513 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 03:54:07.180184 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 03:54:07.212752 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 03:54:07.238987 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 03:54:07.791623 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 03:54:07.839547 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:54:07.850576 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 03:54:07.919361 tst mo_mt_call.py: using LAC 18888 03:54:08.036796 tst mo_mt_call.py: using RAC 18 03:54:08.154878 tst mo_mt_call.py: using CellId 18888 03:54:08.274152 tst mo_mt_call.py: using BVCI 18889 03:54:08.384191 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:54:08.395228 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:54:08.406146 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:54:08.417462 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:54:08.428255 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:54:08.439134 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 03:54:08.554747 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 03:54:08.669221 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:54:09.135352 run create_hlr_db(pid=21014): Launched 03:54:09.259139 bus /sierra_2: Setting Powered False 03:54:10.319424 run create_hlr_db(pid=21014): Terminated: ok {rc=0} 03:54:10.760265 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21016): Launched 03:54:11.084069 run osmo-hlr_10.42.42.2(pid=21017): Launched 03:54:11.207227 run osmo-stp_10.42.42.5: Starting osmo-stp 03:54:11.762566 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21019): Launched 03:54:12.086486 run osmo-stp_10.42.42.5(pid=21020): Launched 03:54:12.211554 run osmo-msc_10.42.42.6: Starting osmo-msc 03:54:12.796188 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21022): Launched 03:54:13.120785 run osmo-msc_10.42.42.6(pid=21023): Launched 03:54:13.300647 run osmo-stp_10.42.42.5(pid=21020): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21020)] 03:54:13.437418 run osmo-stp_10.42.42.5(pid=21020): stdout: | (launched: 2022-12-09_03:54:12.027900) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:54:13.574551 run osmo-stp_10.42.42.5(pid=21020): stderr: | 20221209035412220 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035412220 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035412221 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035412221 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035412221 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035412222 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035412222 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:54:13.710582 run osmo-stp_10.42.42.5(pid=21020): stdout: | (launched: 2022-12-09_03:54:12.027900) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:54:13.839534 run osmo-stp_10.42.42.5(pid=21020): stderr: | 20221209035412220 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035412220 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035412221 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035412221 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035412221 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035412222 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035412222 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:54:13.994679 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21020): Process ended prematurely: osmo-stp_10.42.42.5(pid=21020) [trial-2354↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21020)] [trial-2354↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 03:54:14.004266 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 03:54:14.032605 run osmo-hlr_10.42.42.2(pid=21017): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21017)] 03:54:14.083833 run osmo-hlr_10.42.42.2(pid=21017): stdout: | (launched: 2022-12-09_03:54:11.025019) 03:54:14.136565 run osmo-hlr_10.42.42.2(pid=21017): stderr: | 20221209035411226 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209035411226 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209035411226 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209035411226 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209035411226 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209035411226 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209035411239 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209035411247 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209035411247 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209035411247 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:54:14.209848 run osmo-msc_10.42.42.6(pid=21023): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21023)] 03:54:14.260730 run osmo-msc_10.42.42.6(pid=21023): stdout: | (launched: 2022-12-09_03:54:13.061615) 03:54:14.313202 run osmo-msc_10.42.42.6(pid=21023): stderr: | 20221209035413384 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209035413385 DLGLOBAL DEBUG validating counter group 0x7f5cdad57c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209035413385 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209035413385 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209035413385 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209035413385 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209035413387 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209035413387 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209035413387 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209035413387 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:54:14.366049 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21016): Terminating (SIGTERM) 03:54:14.408434 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21019): Terminating (SIGTERM) 03:54:14.451167 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21022): Terminating (SIGTERM) 03:54:14.493861 --- ParallelTerminationStrategy: PID 21016 died... 03:54:14.513992 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21016): Terminated: ok {rc=0} 03:54:14.561189 --- ParallelTerminationStrategy: PID 21019 died... 03:54:14.580893 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21019): Terminated: ok {rc=0} 03:54:14.629053 --- ParallelTerminationStrategy: PID 21022 died... 03:54:14.648871 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21022): Terminated: ok {rc=0} 03:54:14.738656 bus /sierra_3: Setting Powered False 03:54:15.854527 bus /sierra_3: Setting Powered False 03:54:16.981576 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2354 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 03:54:18.136072 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:54:18.148298 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 03:54:18.220488 tst mo_mt_call_osmux.py: using LAC 18889 03:54:18.348050 tst mo_mt_call_osmux.py: using RAC 19 03:54:18.474225 tst mo_mt_call_osmux.py: using CellId 18889 03:54:18.602395 tst mo_mt_call_osmux.py: using BVCI 18890 03:54:18.720301 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:54:18.731833 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:54:18.743081 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:54:18.754725 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:54:18.766401 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:54:18.778027 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 03:54:18.894197 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 03:54:19.014581 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:54:19.516805 run create_hlr_db(pid=21025): Launched 03:54:19.642241 bus /sierra_2: Setting Powered False 03:54:20.707648 run create_hlr_db(pid=21025): Terminated: ok {rc=0} 03:54:21.140410 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21027): Launched 03:54:21.442935 run osmo-hlr_10.42.42.2(pid=21028): Launched 03:54:21.559235 run osmo-stp_10.42.42.5: Starting osmo-stp 03:54:22.097544 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21030): Launched 03:54:22.398773 run osmo-stp_10.42.42.5(pid=21031): Launched 03:54:22.513673 run osmo-msc_10.42.42.6: Starting osmo-msc 03:54:23.067168 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21033): Launched 03:54:23.370573 run osmo-msc_10.42.42.6(pid=21034): Launched 03:54:23.539530 run osmo-stp_10.42.42.5(pid=21031): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21031)] 03:54:23.667550 run osmo-stp_10.42.42.5(pid=21031): stdout: | (launched: 2022-12-09_03:54:22.343601) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:54:23.795665 run osmo-stp_10.42.42.5(pid=21031): stderr: | 20221209035422514 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035422514 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035422514 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035422515 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035422515 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035422515 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035422515 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:54:23.921947 run osmo-stp_10.42.42.5(pid=21031): stdout: | (launched: 2022-12-09_03:54:22.343601) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:54:24.042232 run osmo-stp_10.42.42.5(pid=21031): stderr: | 20221209035422514 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035422514 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035422514 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035422515 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035422515 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035422515 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035422515 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:54:24.186128 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21031): Process ended prematurely: osmo-stp_10.42.42.5(pid=21031) [trial-2354↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21031)] [trial-2354↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 03:54:24.195075 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 03:54:24.221633 run osmo-hlr_10.42.42.2(pid=21028): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21028)] 03:54:24.269605 run osmo-hlr_10.42.42.2(pid=21028): stdout: | (launched: 2022-12-09_03:54:21.387598) 03:54:24.319284 run osmo-hlr_10.42.42.2(pid=21028): stderr: | 20221209035421562 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209035421562 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209035421562 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209035421562 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209035421562 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209035421562 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209035421574 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209035421584 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209035421584 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209035421584 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:54:24.389189 run osmo-msc_10.42.42.6(pid=21034): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21034)] 03:54:24.437157 run osmo-msc_10.42.42.6(pid=21034): stdout: | (launched: 2022-12-09_03:54:23.314953) 03:54:24.486861 run osmo-msc_10.42.42.6(pid=21034): stderr: | 20221209035423590 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209035423590 DLGLOBAL DEBUG validating counter group 0x7fb72ec75c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209035423591 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209035423591 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209035423591 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209035423591 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209035423593 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209035423594 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209035423594 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209035423594 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:54:24.536587 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21027): Terminating (SIGTERM) 03:54:24.576264 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21030): Terminating (SIGTERM) 03:54:24.615920 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21033): Terminating (SIGTERM) 03:54:24.655678 --- ParallelTerminationStrategy: PID 21027 died... 03:54:24.674836 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21027): Terminated: ok {rc=0} 03:54:24.720093 --- ParallelTerminationStrategy: PID 21030 died... 03:54:24.738993 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21030): Terminated: ok {rc=0} 03:54:24.782786 --- ParallelTerminationStrategy: PID 21033 died... 03:54:24.801321 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21033): Terminated: ok {rc=0} 03:54:24.888572 bus /sierra_3: Setting Powered False 03:54:25.989253 bus /sierra_3: Setting Powered False 03:54:27.106091 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 03:54:28.360341 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:54:28.366713 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 03:54:28.399363 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 03:54:28.425670 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 03:54:28.477194 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 03:54:28.509679 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 03:54:28.535898 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 03:54:29.087278 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 03:54:29.135423 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:54:29.146516 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 03:54:29.215407 tst mo_mt_call.py: using LAC 18890 03:54:29.333928 tst mo_mt_call.py: using RAC 20 03:54:29.465435 tst mo_mt_call.py: using CellId 18890 03:54:29.583751 tst mo_mt_call.py: using BVCI 18891 03:54:29.703041 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:54:29.714921 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:54:29.726536 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:54:29.738403 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:54:29.750697 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:54:29.763114 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 03:54:29.883869 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 03:54:30.004878 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:54:30.509603 run create_hlr_db(pid=21040): Launched 03:54:30.634891 bus /sierra_2: Setting Powered False 03:54:31.698171 run create_hlr_db(pid=21040): Terminated: ok {rc=0} 03:54:32.153104 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21042): Launched 03:54:32.466313 run osmo-hlr_10.42.42.2(pid=21043): Launched 03:54:32.583417 run osmo-stp_10.42.42.5: Starting osmo-stp 03:54:33.102081 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21045): Launched 03:54:33.426952 run osmo-stp_10.42.42.5(pid=21046): Launched 03:54:33.551279 run osmo-msc_10.42.42.6: Starting osmo-msc 03:54:34.136884 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21048): Launched 03:54:34.460818 run osmo-msc_10.42.42.6(pid=21049): Launched 03:54:34.642950 run osmo-stp_10.42.42.5(pid=21046): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21046)] 03:54:34.780383 run osmo-stp_10.42.42.5(pid=21046): stdout: | (launched: 2022-12-09_03:54:33.368188) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:54:34.919022 run osmo-stp_10.42.42.5(pid=21046): stderr: | 20221209035433559 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035433559 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035433560 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035433560 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035433562 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035433562 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035433563 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:54:35.055921 run osmo-stp_10.42.42.5(pid=21046): stdout: | (launched: 2022-12-09_03:54:33.368188) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:54:35.185740 run osmo-stp_10.42.42.5(pid=21046): stderr: | 20221209035433559 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035433559 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035433560 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035433560 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035433562 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035433562 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035433563 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:54:35.340391 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21046): Process ended prematurely: osmo-stp_10.42.42.5(pid=21046) [trial-2354↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21046)] [trial-2354↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 03:54:35.349998 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 03:54:35.378582 run osmo-hlr_10.42.42.2(pid=21043): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21043)] 03:54:35.429449 run osmo-hlr_10.42.42.2(pid=21043): stdout: | (launched: 2022-12-09_03:54:32.411109) 03:54:35.482040 run osmo-hlr_10.42.42.2(pid=21043): stderr: | 20221209035432587 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209035432587 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209035432587 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209035432587 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209035432587 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209035432587 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209035432599 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209035432611 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209035432611 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209035432611 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:54:35.555197 run osmo-msc_10.42.42.6(pid=21049): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21049)] 03:54:35.605903 run osmo-msc_10.42.42.6(pid=21049): stdout: | (launched: 2022-12-09_03:54:34.401902) 03:54:35.658227 run osmo-msc_10.42.42.6(pid=21049): stderr: | 20221209035434726 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209035434726 DLGLOBAL DEBUG validating counter group 0x7f6d4249dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209035434726 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209035434726 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209035434726 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209035434727 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209035434728 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209035434729 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209035434729 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209035434729 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:54:35.710997 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21042): Terminating (SIGTERM) 03:54:35.752891 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21045): Terminating (SIGTERM) 03:54:35.795005 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21048): Terminating (SIGTERM) 03:54:35.837227 --- ParallelTerminationStrategy: PID 21042 died... 03:54:35.857202 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21042): Terminated: ok {rc=0} 03:54:35.904071 --- ParallelTerminationStrategy: PID 21045 died... 03:54:35.923754 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21045): Terminated: ok {rc=0} 03:54:35.970380 --- ParallelTerminationStrategy: PID 21048 died... 03:54:35.989871 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21048): Terminated: ok {rc=0} 03:54:36.078881 bus /sierra_3: Setting Powered False 03:54:37.179295 bus /sierra_3: Setting Powered False 03:54:38.297220 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2354 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 03:54:39.448715 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:54:39.461125 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 03:54:39.533113 tst mo_mt_call_osmux.py: using LAC 18891 03:54:39.661303 tst mo_mt_call_osmux.py: using RAC 21 03:54:39.790017 tst mo_mt_call_osmux.py: using CellId 18891 03:54:39.918561 tst mo_mt_call_osmux.py: using BVCI 18892 03:54:40.036282 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:54:40.047837 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:54:40.059239 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:54:40.070778 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:54:40.082445 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:54:40.094016 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 03:54:40.211202 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 03:54:40.329574 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:54:40.797617 run create_hlr_db(pid=21052): Launched 03:54:40.922626 bus /sierra_2: Setting Powered False 03:54:41.983421 run create_hlr_db(pid=21052): Terminated: ok {rc=0} 03:54:42.424088 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21054): Launched 03:54:42.747329 run osmo-hlr_10.42.42.2(pid=21055): Launched 03:54:42.871192 run osmo-stp_10.42.42.5: Starting osmo-stp 03:54:43.431663 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21057): Launched 03:54:43.754320 run osmo-stp_10.42.42.5(pid=21058): Launched 03:54:43.878514 run osmo-msc_10.42.42.6: Starting osmo-msc 03:54:44.462706 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21060): Launched 03:54:44.785742 run osmo-msc_10.42.42.6(pid=21061): Launched 03:54:44.968681 run osmo-stp_10.42.42.5(pid=21058): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21058)] 03:54:45.104742 run osmo-stp_10.42.42.5(pid=21058): stdout: | (launched: 2022-12-09_03:54:43.695619) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:54:45.242014 run osmo-stp_10.42.42.5(pid=21058): stderr: | 20221209035443889 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035443889 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035443890 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035443890 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035443890 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035443891 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035443891 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:54:45.378176 run osmo-stp_10.42.42.5(pid=21058): stdout: | (launched: 2022-12-09_03:54:43.695619) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:54:45.507557 run osmo-stp_10.42.42.5(pid=21058): stderr: | 20221209035443889 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035443889 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035443890 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035443890 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035443890 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035443891 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035443891 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:54:45.662004 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21058): Process ended prematurely: osmo-stp_10.42.42.5(pid=21058) [trial-2354↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21058)] [trial-2354↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 03:54:45.671764 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 03:54:45.700517 run osmo-hlr_10.42.42.2(pid=21055): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21055)] 03:54:45.751208 run osmo-hlr_10.42.42.2(pid=21055): stdout: | (launched: 2022-12-09_03:54:42.688111) 03:54:45.803676 run osmo-hlr_10.42.42.2(pid=21055): stderr: | 20221209035442890 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209035442890 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209035442890 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209035442890 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209035442890 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209035442890 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209035442902 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209035442910 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209035442911 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209035442911 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:54:45.896082 run osmo-msc_10.42.42.6(pid=21061): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21061)] 03:54:45.953456 run osmo-msc_10.42.42.6(pid=21061): stdout: | (launched: 2022-12-09_03:54:44.727043) 03:54:46.007392 run osmo-msc_10.42.42.6(pid=21061): stderr: | 20221209035445049 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209035445049 DLGLOBAL DEBUG validating counter group 0x7faefb507c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209035445049 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209035445049 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209035445050 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209035445050 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209035445051 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209035445052 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209035445052 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209035445052 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:54:46.061835 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21054): Terminating (SIGTERM) 03:54:46.105926 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21057): Terminating (SIGTERM) 03:54:46.149869 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21060): Terminating (SIGTERM) 03:54:46.194134 --- ParallelTerminationStrategy: PID 21054 died... 03:54:46.214833 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21054): Terminated: ok {rc=0} 03:54:46.263884 --- ParallelTerminationStrategy: PID 21057 died... 03:54:46.284544 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21057): Terminated: ok {rc=0} 03:54:46.333984 --- ParallelTerminationStrategy: PID 21060 died... 03:54:46.354817 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21060): Terminated: ok {rc=0} 03:54:46.447154 bus /sierra_3: Setting Powered False 03:54:47.549547 bus /sierra_3: Setting Powered False 03:54:48.665424 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 03:54:49.923446 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:54:49.930701 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 03:54:49.965866 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 03:54:49.993467 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 03:54:50.044554 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 03:54:50.078790 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 03:54:50.106368 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 03:54:50.659501 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 03:54:50.711672 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:54:50.723207 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 03:54:50.792515 tst mo_mt_call.py: using LAC 18892 03:54:50.917351 tst mo_mt_call.py: using RAC 22 03:54:51.042218 tst mo_mt_call.py: using CellId 18892 03:54:51.169215 tst mo_mt_call.py: using BVCI 18893 03:54:51.286430 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:54:51.297979 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:54:51.309521 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:54:51.321111 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:54:51.332779 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:54:51.344388 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 03:54:51.459536 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 03:54:51.573522 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:54:52.041581 run create_hlr_db(pid=21067): Launched 03:54:52.165839 bus /sierra_2: Setting Powered False 03:54:53.226148 run create_hlr_db(pid=21067): Terminated: ok {rc=0} 03:54:53.667861 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21069): Launched 03:54:53.992734 run osmo-hlr_10.42.42.2(pid=21070): Launched 03:54:54.116783 run osmo-stp_10.42.42.5: Starting osmo-stp 03:54:54.678505 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21072): Launched 03:54:55.003451 run osmo-stp_10.42.42.5(pid=21073): Launched 03:54:55.126909 run osmo-msc_10.42.42.6: Starting osmo-msc 03:54:55.715225 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21075): Launched 03:54:56.039904 run osmo-msc_10.42.42.6(pid=21076): Launched 03:54:56.221806 run osmo-stp_10.42.42.5(pid=21073): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21073)] 03:54:56.358889 run osmo-stp_10.42.42.5(pid=21073): stdout: | (launched: 2022-12-09_03:54:54.944511) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:54:56.496575 run osmo-stp_10.42.42.5(pid=21073): stderr: | 20221209035455137 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035455137 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035455137 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035455138 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035455138 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035455138 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035455138 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:54:56.633233 run osmo-stp_10.42.42.5(pid=21073): stdout: | (launched: 2022-12-09_03:54:54.944511) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:54:56.762664 run osmo-stp_10.42.42.5(pid=21073): stderr: | 20221209035455137 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035455137 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035455137 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035455138 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035455138 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035455138 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035455138 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:54:56.917651 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21073): Process ended prematurely: osmo-stp_10.42.42.5(pid=21073) [trial-2354↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21073)] [trial-2354↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 03:54:56.927363 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 03:54:56.955649 run osmo-hlr_10.42.42.2(pid=21070): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21070)] 03:54:57.006818 run osmo-hlr_10.42.42.2(pid=21070): stdout: | (launched: 2022-12-09_03:54:53.933683) 03:54:57.059512 run osmo-hlr_10.42.42.2(pid=21070): stderr: | 20221209035454135 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209035454135 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209035454135 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209035454135 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209035454135 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209035454135 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209035454146 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209035454154 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209035454155 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209035454155 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:54:57.132772 run osmo-msc_10.42.42.6(pid=21076): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21076)] 03:54:57.183812 run osmo-msc_10.42.42.6(pid=21076): stdout: | (launched: 2022-12-09_03:54:55.981240) 03:54:57.236610 run osmo-msc_10.42.42.6(pid=21076): stderr: | 20221209035456304 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209035456304 DLGLOBAL DEBUG validating counter group 0x7fea1c1a5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209035456305 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209035456305 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209035456305 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209035456305 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209035456307 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209035456307 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209035456307 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209035456307 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:54:57.289549 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21069): Terminating (SIGTERM) 03:54:57.332013 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21072): Terminating (SIGTERM) 03:54:57.374437 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21075): Terminating (SIGTERM) 03:54:57.417050 --- ParallelTerminationStrategy: PID 21069 died... 03:54:57.437154 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21069): Terminated: ok {rc=0} 03:54:57.484343 --- ParallelTerminationStrategy: PID 21072 died... 03:54:57.504226 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21072): Terminated: ok {rc=0} 03:54:57.551182 --- ParallelTerminationStrategy: PID 21075 died... 03:54:57.570883 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21075): Terminated: ok {rc=0} 03:54:57.660381 bus /sierra_3: Setting Powered False 03:54:58.761272 bus /sierra_3: Setting Powered False 03:54:59.881220 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2354 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 03:55:01.038109 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:55:01.050878 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 03:55:01.121390 tst mo_mt_call_osmux.py: using LAC 18893 03:55:01.280460 tst mo_mt_call_osmux.py: using RAC 23 03:55:01.409876 tst mo_mt_call_osmux.py: using CellId 18893 03:55:01.546285 tst mo_mt_call_osmux.py: using BVCI 18894 03:55:01.695072 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:55:01.709097 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:55:01.723684 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:55:01.738139 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:55:01.751621 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:55:01.772058 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 03:55:01.921426 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 03:55:02.069621 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:55:02.582486 run create_hlr_db(pid=21081): Launched 03:55:02.707339 bus /sierra_2: Setting Powered False 03:55:03.767296 run create_hlr_db(pid=21081): Terminated: ok {rc=0} 03:55:04.187324 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21083): Launched 03:55:04.487458 run osmo-hlr_10.42.42.2(pid=21084): Launched 03:55:04.601876 run osmo-stp_10.42.42.5: Starting osmo-stp 03:55:05.120203 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21086): Launched 03:55:05.421342 run osmo-stp_10.42.42.5(pid=21087): Launched 03:55:05.535240 run osmo-msc_10.42.42.6: Starting osmo-msc 03:55:06.080505 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21089): Launched 03:55:06.382122 run osmo-msc_10.42.42.6(pid=21090): Launched 03:55:06.549999 run osmo-stp_10.42.42.5(pid=21087): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21087)] 03:55:06.677206 run osmo-stp_10.42.42.5(pid=21087): stdout: | (launched: 2022-12-09_03:55:05.366271) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:55:06.804349 run osmo-stp_10.42.42.5(pid=21087): stderr: | 20221209035505537 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035505537 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035505537 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035505538 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035505538 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035505538 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035505538 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:55:06.930005 run osmo-stp_10.42.42.5(pid=21087): stdout: | (launched: 2022-12-09_03:55:05.366271) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:55:07.050601 run osmo-stp_10.42.42.5(pid=21087): stderr: | 20221209035505537 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035505537 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035505537 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035505538 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035505538 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035505538 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035505538 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:55:07.194177 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21087): Process ended prematurely: osmo-stp_10.42.42.5(pid=21087) [trial-2354↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21087)] [trial-2354↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 03:55:07.202999 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 03:55:07.229647 run osmo-hlr_10.42.42.2(pid=21084): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21084)] 03:55:07.277629 run osmo-hlr_10.42.42.2(pid=21084): stdout: | (launched: 2022-12-09_03:55:04.432474) 03:55:07.327471 run osmo-hlr_10.42.42.2(pid=21084): stderr: | 20221209035504613 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209035504614 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209035504614 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209035504614 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209035504614 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209035504614 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209035504626 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209035504634 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209035504634 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209035504634 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:55:07.396771 run osmo-msc_10.42.42.6(pid=21090): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21090)] 03:55:07.444766 run osmo-msc_10.42.42.6(pid=21090): stdout: | (launched: 2022-12-09_03:55:06.326853) 03:55:07.494461 run osmo-msc_10.42.42.6(pid=21090): stderr: | 20221209035506599 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209035506600 DLGLOBAL DEBUG validating counter group 0x7ffb108d6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209035506600 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209035506600 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209035506600 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209035506600 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209035506603 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209035506603 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209035506604 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209035506604 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:55:07.544299 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21083): Terminating (SIGTERM) 03:55:07.584273 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21086): Terminating (SIGTERM) 03:55:07.624142 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21089): Terminating (SIGTERM) 03:55:07.664308 --- ParallelTerminationStrategy: PID 21083 died... 03:55:07.683526 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21083): Terminated: ok {rc=0} 03:55:07.727635 --- ParallelTerminationStrategy: PID 21086 died... 03:55:07.746212 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21086): Terminated: ok {rc=0} 03:55:07.790088 --- ParallelTerminationStrategy: PID 21089 died... 03:55:07.808695 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21089): Terminated: ok {rc=0} 03:55:07.892624 bus /sierra_3: Setting Powered False 03:55:08.989116 bus /sierra_3: Setting Powered False 03:55:10.105843 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 03:55:11.359030 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:55:11.365677 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 03:55:11.398750 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 03:55:11.425314 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 03:55:11.478323 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 03:55:11.511502 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 03:55:11.537840 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 03:55:12.087677 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 03:55:12.135866 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:55:12.146904 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 03:55:12.215506 tst mo_mt_call.py: using LAC 18894 03:55:12.333245 tst mo_mt_call.py: using RAC 24 03:55:12.455723 tst mo_mt_call.py: using CellId 18894 03:55:12.581645 tst mo_mt_call.py: using BVCI 18895 03:55:12.700586 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:55:12.712293 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:55:12.723743 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:55:12.735847 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:55:12.747778 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:55:12.759773 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 03:55:12.881903 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 03:55:12.997492 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:55:13.466958 run create_hlr_db(pid=21095): Launched 03:55:13.591587 bus /sierra_2: Setting Powered False 03:55:14.651768 run create_hlr_db(pid=21095): Terminated: ok {rc=0} 03:55:15.091549 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21097): Launched 03:55:15.415559 run osmo-hlr_10.42.42.2(pid=21098): Launched 03:55:15.539225 run osmo-stp_10.42.42.5: Starting osmo-stp 03:55:16.110164 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21100): Launched 03:55:16.450126 run osmo-stp_10.42.42.5(pid=21101): Launched 03:55:16.722218 run osmo-msc_10.42.42.6: Starting osmo-msc 03:55:17.346144 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21103): Launched 03:55:17.671330 run osmo-msc_10.42.42.6(pid=21104): Launched 03:55:17.851245 run osmo-stp_10.42.42.5(pid=21101): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21101)] 03:55:17.987854 run osmo-stp_10.42.42.5(pid=21101): stdout: | (launched: 2022-12-09_03:55:16.391170) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:55:18.125358 run osmo-stp_10.42.42.5(pid=21101): stderr: | 20221209035516610 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035516610 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035516610 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035516611 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035516611 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035516611 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035516611 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:55:18.261785 run osmo-stp_10.42.42.5(pid=21101): stdout: | (launched: 2022-12-09_03:55:16.391170) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:55:18.391070 run osmo-stp_10.42.42.5(pid=21101): stderr: | 20221209035516610 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035516610 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035516610 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035516611 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035516611 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035516611 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035516611 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:55:18.545613 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21101): Process ended prematurely: osmo-stp_10.42.42.5(pid=21101) [trial-2354↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21101)] [trial-2354↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 03:55:18.555368 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 03:55:18.584174 run osmo-hlr_10.42.42.2(pid=21098): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21098)] 03:55:18.635290 run osmo-hlr_10.42.42.2(pid=21098): stdout: | (launched: 2022-12-09_03:55:15.356933) 03:55:18.688099 run osmo-hlr_10.42.42.2(pid=21098): stderr: | 20221209035515555 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209035515556 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209035515556 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209035515556 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209035515556 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209035515556 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209035515567 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209035515576 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209035515576 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209035515576 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:55:18.761581 run osmo-msc_10.42.42.6(pid=21104): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21104)] 03:55:18.812421 run osmo-msc_10.42.42.6(pid=21104): stdout: | (launched: 2022-12-09_03:55:17.612370) 03:55:18.865115 run osmo-msc_10.42.42.6(pid=21104): stderr: | 20221209035517934 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209035517934 DLGLOBAL DEBUG validating counter group 0x7efe9ddd6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209035517934 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209035517934 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209035517934 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209035517934 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209035517936 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209035517936 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209035517936 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209035517936 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:55:18.918462 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21097): Terminating (SIGTERM) 03:55:18.961155 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21100): Terminating (SIGTERM) 03:55:19.003653 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21103): Terminating (SIGTERM) 03:55:19.046411 --- ParallelTerminationStrategy: PID 21097 died... 03:55:19.066717 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21097): Terminated: ok {rc=0} 03:55:19.114136 --- ParallelTerminationStrategy: PID 21100 died... 03:55:19.133977 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21100): Terminated: ok {rc=0} 03:55:19.181625 --- ParallelTerminationStrategy: PID 21103 died... 03:55:19.201491 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21103): Terminated: ok {rc=0} 03:55:19.291304 bus /sierra_3: Setting Powered False 03:55:20.391623 bus /sierra_3: Setting Powered False 03:55:21.510129 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2354 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 03:55:22.660549 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:55:22.673000 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 03:55:22.744678 tst mo_mt_call_osmux.py: using LAC 18895 03:55:22.875451 tst mo_mt_call_osmux.py: using RAC 25 03:55:23.002353 tst mo_mt_call_osmux.py: using CellId 18895 03:55:23.127347 tst mo_mt_call_osmux.py: using BVCI 18896 03:55:23.245716 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:55:23.257339 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:55:23.268640 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:55:23.280327 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:55:23.292174 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:55:23.303809 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 03:55:23.420583 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 03:55:23.536616 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:55:24.006310 run create_hlr_db(pid=21106): Launched 03:55:24.130920 bus /sierra_2: Setting Powered False 03:55:25.192201 run create_hlr_db(pid=21106): Terminated: ok {rc=0} 03:55:25.614574 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21108): Launched 03:55:25.916336 run osmo-hlr_10.42.42.2(pid=21109): Launched 03:55:26.030793 run osmo-stp_10.42.42.5: Starting osmo-stp 03:55:26.551417 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21111): Launched 03:55:26.853183 run osmo-stp_10.42.42.5(pid=21112): Launched 03:55:26.968318 run osmo-msc_10.42.42.6: Starting osmo-msc 03:55:27.516151 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21114): Launched 03:55:27.819346 run osmo-msc_10.42.42.6(pid=21115): Launched 03:55:27.989130 run osmo-stp_10.42.42.5(pid=21112): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21112)] 03:55:28.116913 run osmo-stp_10.42.42.5(pid=21112): stdout: | (launched: 2022-12-09_03:55:26.797835) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:55:28.244753 run osmo-stp_10.42.42.5(pid=21112): stderr: | 20221209035526968 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035526968 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035526968 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035526968 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035526971 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035526971 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035526971 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:55:28.370488 run osmo-stp_10.42.42.5(pid=21112): stdout: | (launched: 2022-12-09_03:55:26.797835) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:55:28.490779 run osmo-stp_10.42.42.5(pid=21112): stderr: | 20221209035526968 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035526968 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035526968 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035526968 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035526971 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035526971 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035526971 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:55:28.634777 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21112): Process ended prematurely: osmo-stp_10.42.42.5(pid=21112) [trial-2354↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21112)] [trial-2354↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 03:55:28.643799 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 03:55:28.670410 run osmo-hlr_10.42.42.2(pid=21109): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21109)] 03:55:28.718032 run osmo-hlr_10.42.42.2(pid=21109): stdout: | (launched: 2022-12-09_03:55:25.861159) 03:55:28.767592 run osmo-hlr_10.42.42.2(pid=21109): stderr: | 20221209035526039 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209035526039 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209035526039 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209035526039 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209035526039 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209035526039 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209035526051 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209035526060 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209035526060 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209035526060 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:55:28.836642 run osmo-msc_10.42.42.6(pid=21115): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21115)] 03:55:28.883964 run osmo-msc_10.42.42.6(pid=21115): stdout: | (launched: 2022-12-09_03:55:27.763419) 03:55:28.933316 run osmo-msc_10.42.42.6(pid=21115): stderr: | 20221209035528034 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209035528034 DLGLOBAL DEBUG validating counter group 0x7fd05e588c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209035528035 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209035528035 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209035528035 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209035528035 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209035528037 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209035528038 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209035528038 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209035528038 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:55:28.982815 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21108): Terminating (SIGTERM) 03:55:29.022294 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21111): Terminating (SIGTERM) 03:55:29.061940 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21114): Terminating (SIGTERM) 03:55:29.101735 --- ParallelTerminationStrategy: PID 21108 died... 03:55:29.120855 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21108): Terminated: ok {rc=0} 03:55:29.165196 --- ParallelTerminationStrategy: PID 21111 died... 03:55:29.183727 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21111): Terminated: ok {rc=0} 03:55:29.227976 --- ParallelTerminationStrategy: PID 21114 died... 03:55:29.246642 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21114): Terminated: ok {rc=0} 03:55:29.333254 bus /sierra_3: Setting Powered False 03:55:30.432859 bus /sierra_3: Setting Powered False 03:55:31.551844 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 03:55:32.812526 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:55:32.819004 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 03:55:32.851748 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 03:55:32.878060 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 03:55:32.931324 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 03:55:32.964348 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 03:55:32.990689 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 03:55:33.545633 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 03:55:33.593626 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:55:33.604837 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 03:55:33.673642 tst mo_mt_call.py: using LAC 18896 03:55:33.793674 tst mo_mt_call.py: using RAC 26 03:55:33.912527 tst mo_mt_call.py: using CellId 18896 03:55:34.032516 tst mo_mt_call.py: using BVCI 18897 03:55:34.143615 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:55:34.154843 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:55:34.165855 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:55:34.176748 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:55:34.187858 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:55:34.198811 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:55:34.316501 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:55:34.437146 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:55:34.940837 run create_hlr_db(pid=21120): Launched 03:55:35.067608 bus /sierra_2: Setting Powered False 03:55:36.131608 run create_hlr_db(pid=21120): Terminated: ok {rc=0} 03:55:36.564422 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21122): Launched 03:55:36.867002 run osmo-hlr_10.42.42.2(pid=21123): Launched 03:55:36.982204 run osmo-stp_10.42.42.5: Starting osmo-stp 03:55:37.501420 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21125): Launched 03:55:37.802705 run osmo-stp_10.42.42.5(pid=21126): Launched 03:55:37.917588 run osmo-msc_10.42.42.6: Starting osmo-msc 03:55:38.462268 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21128): Launched 03:55:38.763645 run osmo-msc_10.42.42.6(pid=21129): Launched 03:55:38.932132 run osmo-stp_10.42.42.5(pid=21126): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21126)] 03:55:39.058701 run osmo-stp_10.42.42.5(pid=21126): stdout: | (launched: 2022-12-09_03:55:37.747459) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:55:39.185928 run osmo-stp_10.42.42.5(pid=21126): stderr: | 20221209035537921 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035537921 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035537921 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035537922 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035537922 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035537922 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035537922 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:55:39.311969 run osmo-stp_10.42.42.5(pid=21126): stdout: | (launched: 2022-12-09_03:55:37.747459) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:55:39.431859 run osmo-stp_10.42.42.5(pid=21126): stderr: | 20221209035537921 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035537921 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035537921 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035537922 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035537922 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035537922 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035537922 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:55:39.575538 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21126): Process ended prematurely: osmo-stp_10.42.42.5(pid=21126) [trial-2354↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21126)] [trial-2354↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 03:55:39.584418 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 03:55:39.610938 run osmo-hlr_10.42.42.2(pid=21123): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21123)] 03:55:39.658645 run osmo-hlr_10.42.42.2(pid=21123): stdout: | (launched: 2022-12-09_03:55:36.811423) 03:55:39.708349 run osmo-hlr_10.42.42.2(pid=21123): stderr: | 20221209035536989 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209035536989 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209035536989 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209035536989 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209035536989 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209035536989 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209035537011 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209035537020 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209035537020 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209035537020 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:55:39.777568 run osmo-msc_10.42.42.6(pid=21129): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21129)] 03:55:39.825509 run osmo-msc_10.42.42.6(pid=21129): stdout: | (launched: 2022-12-09_03:55:38.708491) 03:55:39.874809 run osmo-msc_10.42.42.6(pid=21129): stderr: | 20221209035538982 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209035538982 DLGLOBAL DEBUG validating counter group 0x7f3bb5bdac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209035538982 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209035538982 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209035538982 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209035538983 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209035538985 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209035538986 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209035538986 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209035538986 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:55:39.924499 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21122): Terminating (SIGTERM) 03:55:39.965147 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21125): Terminating (SIGTERM) 03:55:40.005114 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21128): Terminating (SIGTERM) 03:55:40.045166 --- ParallelTerminationStrategy: PID 21122 died... 03:55:40.064218 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21122): Terminated: ok {rc=0} 03:55:40.108870 --- ParallelTerminationStrategy: PID 21125 died... 03:55:40.127975 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21125): Terminated: ok {rc=0} 03:55:40.171632 --- ParallelTerminationStrategy: PID 21128 died... 03:55:40.190295 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21128): Terminated: ok {rc=0} 03:55:40.274001 bus /sierra_3: Setting Powered False 03:55:41.372713 bus /sierra_3: Setting Powered False 03:55:42.493088 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2354 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 03:55:43.647217 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:55:43.659781 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 03:55:43.732584 tst mo_mt_call_osmux.py: using LAC 18897 03:55:43.861396 tst mo_mt_call_osmux.py: using RAC 27 03:55:43.993797 tst mo_mt_call_osmux.py: using CellId 18897 03:55:44.120518 tst mo_mt_call_osmux.py: using BVCI 18898 03:55:44.238383 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:55:44.250306 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:55:44.262009 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:55:44.274168 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:55:44.286296 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:55:44.298402 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:55:44.416536 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:55:44.533237 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:55:45.004768 run create_hlr_db(pid=21131): Launched 03:55:45.128733 bus /sierra_2: Setting Powered False 03:55:46.205617 run create_hlr_db(pid=21131): Terminated: ok {rc=0} 03:55:46.696131 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21133): Launched 03:55:47.015117 run osmo-hlr_10.42.42.2(pid=21134): Launched 03:55:47.262178 run osmo-stp_10.42.42.5: Starting osmo-stp 03:55:47.871959 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21136): Launched 03:55:48.197521 run osmo-stp_10.42.42.5(pid=21137): Launched 03:55:48.323406 run osmo-msc_10.42.42.6: Starting osmo-msc 03:55:48.910549 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21139): Launched 03:55:49.235416 run osmo-msc_10.42.42.6(pid=21140): Launched 03:55:49.417565 run osmo-stp_10.42.42.5(pid=21137): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21137)] 03:55:49.554488 run osmo-stp_10.42.42.5(pid=21137): stdout: | (launched: 2022-12-09_03:55:48.138769) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:55:49.691895 run osmo-stp_10.42.42.5(pid=21137): stderr: | 20221209035548332 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035548333 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035548333 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035548333 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035548334 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035548334 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035548334 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:55:49.829239 run osmo-stp_10.42.42.5(pid=21137): stdout: | (launched: 2022-12-09_03:55:48.138769) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:55:49.959552 run osmo-stp_10.42.42.5(pid=21137): stderr: | 20221209035548332 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035548333 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035548333 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035548333 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035548334 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035548334 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035548334 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:55:50.114535 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21137): Process ended prematurely: osmo-stp_10.42.42.5(pid=21137) [trial-2354↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21137)] [trial-2354↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 03:55:50.124308 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 03:55:50.153593 run osmo-hlr_10.42.42.2(pid=21134): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21134)] 03:55:50.204856 run osmo-hlr_10.42.42.2(pid=21134): stdout: | (launched: 2022-12-09_03:55:46.958686) 03:55:50.257964 run osmo-hlr_10.42.42.2(pid=21134): stderr: | 20221209035547223 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209035547223 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209035547223 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209035547223 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209035547223 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209035547223 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209035547241 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209035547256 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209035547256 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209035547256 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:55:50.332152 run osmo-msc_10.42.42.6(pid=21140): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21140)] 03:55:50.383387 run osmo-msc_10.42.42.6(pid=21140): stdout: | (launched: 2022-12-09_03:55:49.176590) 03:55:50.436726 run osmo-msc_10.42.42.6(pid=21140): stderr: | 20221209035549499 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209035549499 DLGLOBAL DEBUG validating counter group 0x7f83e27cec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209035549499 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209035549499 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209035549499 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209035549500 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209035549501 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209035549502 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209035549502 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209035549502 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:55:50.489910 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21133): Terminating (SIGTERM) 03:55:50.532282 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21136): Terminating (SIGTERM) 03:55:50.575095 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21139): Terminating (SIGTERM) 03:55:50.618031 --- ParallelTerminationStrategy: PID 21133 died... 03:55:50.638227 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21133): Terminated: ok {rc=0} 03:55:50.685319 --- ParallelTerminationStrategy: PID 21136 died... 03:55:50.704917 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21136): Terminated: ok {rc=0} 03:55:50.751863 --- ParallelTerminationStrategy: PID 21139 died... 03:55:50.771588 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21139): Terminated: ok {rc=0} 03:55:50.860206 bus /sierra_3: Setting Powered False 03:55:51.960529 bus /sierra_3: Setting Powered False 03:55:53.079863 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 voice:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 03:55:54.330452 tst voice:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:55:54.336105 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 03:55:54.371732 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 03:55:54.400364 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 03:55:54.454922 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 03:55:54.490302 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 03:55:54.517181 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 03:55:55.063182 tst voice:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 03:55:55.112673 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:55:55.123956 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 03:55:55.194816 tst mo_mt_call.py: using LAC 18898 03:55:55.324723 tst mo_mt_call.py: using RAC 28 03:55:55.452308 tst mo_mt_call.py: using CellId 18898 03:55:55.581414 tst mo_mt_call.py: using BVCI 18899 03:55:55.701431 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:55:55.713018 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:55:55.724407 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:55:55.736252 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:55:55.747948 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:55:55.759552 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 03:55:55.876432 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 03:55:55.992197 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:55:56.461185 run create_hlr_db(pid=21145): Launched 03:55:56.585072 bus /sierra_2: Setting Powered False 03:55:57.645750 run create_hlr_db(pid=21145): Terminated: ok {rc=0} 03:55:58.089191 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21147): Launched 03:55:58.413535 run osmo-hlr_10.42.42.2(pid=21148): Launched 03:55:58.539084 run osmo-stp_10.42.42.5: Starting osmo-stp 03:55:59.096671 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21150): Launched 03:55:59.421633 run osmo-stp_10.42.42.5(pid=21151): Launched 03:55:59.548031 run osmo-msc_10.42.42.6: Starting osmo-msc 03:56:00.135697 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21153): Launched 03:56:00.460819 run osmo-msc_10.42.42.6(pid=21154): Launched 03:56:00.643832 run osmo-stp_10.42.42.5(pid=21151): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21151)] 03:56:00.781149 run osmo-stp_10.42.42.5(pid=21151): stdout: | (launched: 2022-12-09_03:55:59.362772) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:56:00.974466 run osmo-stp_10.42.42.5(pid=21151): stderr: | 20221209035559554 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035559554 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035559555 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035559555 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035559555 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035559556 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035559556 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:56:01.159521 run osmo-stp_10.42.42.5(pid=21151): stdout: | (launched: 2022-12-09_03:55:59.362772) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:56:01.293841 run osmo-stp_10.42.42.5(pid=21151): stderr: | 20221209035559554 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035559554 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035559555 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035559555 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035559555 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035559556 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035559556 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:56:01.454323 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21151): Process ended prematurely: osmo-stp_10.42.42.5(pid=21151) [trial-2354↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21151)] [trial-2354↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 03:56:01.464928 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 03:56:01.497208 run osmo-hlr_10.42.42.2(pid=21148): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21148)] 03:56:01.551456 run osmo-hlr_10.42.42.2(pid=21148): stdout: | (launched: 2022-12-09_03:55:58.354602) 03:56:01.607289 run osmo-hlr_10.42.42.2(pid=21148): stderr: | 20221209035558553 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209035558553 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209035558553 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209035558553 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209035558553 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209035558553 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209035558566 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209035558574 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209035558574 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209035558574 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:56:01.684355 run osmo-msc_10.42.42.6(pid=21154): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21154)] 03:56:01.738327 run osmo-msc_10.42.42.6(pid=21154): stdout: | (launched: 2022-12-09_03:56:00.401474) 03:56:01.793962 run osmo-msc_10.42.42.6(pid=21154): stderr: | 20221209035600724 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209035600724 DLGLOBAL DEBUG validating counter group 0x7f7b2bfd5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209035600724 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209035600724 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209035600724 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209035600724 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209035600726 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209035600726 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209035600727 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209035600727 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:56:01.850184 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21147): Terminating (SIGTERM) 03:56:01.895845 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21150): Terminating (SIGTERM) 03:56:01.941816 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21153): Terminating (SIGTERM) 03:56:01.988662 --- ParallelTerminationStrategy: PID 21147 died... 03:56:02.010006 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21147): Terminated: ok {rc=0} 03:56:02.060610 --- ParallelTerminationStrategy: PID 21150 died... 03:56:02.081719 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21150): Terminated: ok {rc=0} 03:56:02.131980 --- ParallelTerminationStrategy: PID 21153 died... 03:56:02.152749 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21153): Terminated: ok {rc=0} 03:56:02.245830 bus /sierra_3: Setting Powered False 03:56:03.347769 bus /sierra_3: Setting Powered False 03:56:04.463444 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2354 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 03:56:05.613706 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:56:05.626086 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 03:56:05.703299 tst mo_mt_call_osmux.py: using LAC 18899 03:56:05.832783 tst mo_mt_call_osmux.py: using RAC 29 03:56:05.960030 tst mo_mt_call_osmux.py: using CellId 18899 03:56:06.085602 tst mo_mt_call_osmux.py: using BVCI 18900 03:56:06.203687 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:56:06.215379 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:56:06.226653 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:56:06.238237 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:56:06.249876 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:56:06.261615 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 03:56:06.378289 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 03:56:06.499868 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:56:07.004473 run create_hlr_db(pid=21156): Launched 03:56:07.128831 bus /sierra_2: Setting Powered False 03:56:08.193578 run create_hlr_db(pid=21156): Terminated: ok {rc=0} 03:56:08.644370 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21158): Launched 03:56:08.969741 run osmo-hlr_10.42.42.2(pid=21160): Launched 03:56:09.095886 run osmo-stp_10.42.42.5: Starting osmo-stp 03:56:09.657709 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21162): Launched 03:56:09.985497 run osmo-stp_10.42.42.5(pid=21163): Launched 03:56:10.111309 run osmo-msc_10.42.42.6: Starting osmo-msc 03:56:10.698829 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21165): Launched 03:56:11.025787 run osmo-msc_10.42.42.6(pid=21166): Launched 03:56:11.207759 run osmo-stp_10.42.42.5(pid=21163): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21163)] 03:56:11.345516 run osmo-stp_10.42.42.5(pid=21163): stdout: | (launched: 2022-12-09_03:56:09.925940) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:56:11.483535 run osmo-stp_10.42.42.5(pid=21163): stderr: | 20221209035610117 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035610118 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035610118 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035610118 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035610119 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035610119 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035610119 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:56:11.621135 run osmo-stp_10.42.42.5(pid=21163): stdout: | (launched: 2022-12-09_03:56:09.925940) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:56:11.750992 run osmo-stp_10.42.42.5(pid=21163): stderr: | 20221209035610117 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035610118 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035610118 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035610118 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035610119 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035610119 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035610119 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:56:11.906999 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21163): Process ended prematurely: osmo-stp_10.42.42.5(pid=21163) [trial-2354↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21163)] [trial-2354↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 03:56:11.916749 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 03:56:11.945747 run osmo-hlr_10.42.42.2(pid=21160): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21160)] 03:56:11.997147 run osmo-hlr_10.42.42.2(pid=21160): stdout: | (launched: 2022-12-09_03:56:08.910717) 03:56:12.049928 run osmo-hlr_10.42.42.2(pid=21160): stderr: | 20221209035609108 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209035609108 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209035609108 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209035609108 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209035609108 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209035609109 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209035609124 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209035609134 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209035609134 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209035609134 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:56:12.123228 run osmo-msc_10.42.42.6(pid=21166): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21166)] 03:56:12.174192 run osmo-msc_10.42.42.6(pid=21166): stdout: | (launched: 2022-12-09_03:56:10.966773) 03:56:12.226903 run osmo-msc_10.42.42.6(pid=21166): stderr: | 20221209035611288 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209035611289 DLGLOBAL DEBUG validating counter group 0x7fad08b7ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209035611289 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209035611289 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209035611289 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209035611289 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209035611291 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209035611291 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209035611291 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209035611292 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:56:12.280127 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21158): Terminating (SIGTERM) 03:56:12.322851 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21162): Terminating (SIGTERM) 03:56:12.365580 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21165): Terminating (SIGTERM) 03:56:12.408301 --- ParallelTerminationStrategy: PID 21158 died... 03:56:12.428612 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21158): Terminated: ok {rc=0} 03:56:12.476173 --- ParallelTerminationStrategy: PID 21162 died... 03:56:12.496166 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21162): Terminated: ok {rc=0} 03:56:12.543354 --- ParallelTerminationStrategy: PID 21165 died... 03:56:12.563279 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21165): Terminated: ok {rc=0} 03:56:12.653166 bus /sierra_3: Setting Powered False 03:56:13.752271 bus /sierra_3: Setting Powered False 03:56:14.868365 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 voice:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 voice:trx-b200+mod-bts0-trxdversion0 --------------------------------------------------------------------- 03:56:16.154083 tst voice:trx-b200+mod-bts0-trxdversion0: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:56:16.159894 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 1 x bts (candidates: 11) 03:56:16.196720 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 6 x ip_address (candidates: 9) 03:56:16.226496 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 2 x modem (candidates: 12) 03:56:16.280659 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 1 x bts (candidates: 11) 03:56:16.317883 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 6 x ip_address (candidates: 9) 03:56:16.348204 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 2 x modem (candidates: 12) 03:56:16.890531 tst voice:trx-b200+mod-bts0-trxdversion0: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call.py ---------------------------------------------- 03:56:16.946861 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 03:56:16.959420 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 03:56:17.012918 tst mo_mt_call.py: using LAC 18900 03:56:17.143320 tst mo_mt_call.py: using RAC 30 03:56:17.273378 tst mo_mt_call.py: using CellId 18900 03:56:17.403554 tst mo_mt_call.py: using BVCI 18901 03:56:17.522776 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 03:56:17.534500 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 03:56:17.545971 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 03:56:17.557653 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 03:56:17.569616 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 03:56:17.581929 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 03:56:17.701635 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 03:56:17.818393 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:56:18.287373 run create_hlr_db(pid=21171): Launched 03:56:18.412325 bus /sierra_2: Setting Powered False 03:56:19.472872 run create_hlr_db(pid=21171): Terminated: ok {rc=0} 03:56:19.916088 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21173): Launched 03:56:20.241741 run osmo-hlr_10.42.42.2(pid=21174): Launched 03:56:20.366225 run osmo-stp_10.42.42.5: Starting osmo-stp 03:56:20.927567 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21176): Launched 03:56:21.252387 run osmo-stp_10.42.42.5(pid=21177): Launched 03:56:21.376153 run osmo-msc_10.42.42.6: Starting osmo-msc 03:56:21.961482 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21179): Launched 03:56:22.286453 run osmo-msc_10.42.42.6(pid=21180): Launched 03:56:22.468321 run osmo-stp_10.42.42.5(pid=21177): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21177)] 03:56:22.605912 run osmo-stp_10.42.42.5(pid=21177): stdout: | (launched: 2022-12-09_03:56:21.192913) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:56:22.743985 run osmo-stp_10.42.42.5(pid=21177): stderr: | 20221209035621384 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035621384 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035621384 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035621385 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035621385 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035621385 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035621385 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:56:22.880676 run osmo-stp_10.42.42.5(pid=21177): stdout: | (launched: 2022-12-09_03:56:21.192913) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:56:23.010716 run osmo-stp_10.42.42.5(pid=21177): stderr: | 20221209035621384 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035621384 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035621384 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035621385 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035621385 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035621385 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035621385 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:56:23.165950 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21177): Process ended prematurely: osmo-stp_10.42.42.5(pid=21177) [trial-2354↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21177)] [trial-2354↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8] 03:56:23.175666 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 03:56:23.204440 run osmo-hlr_10.42.42.2(pid=21174): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21174)] 03:56:23.255647 run osmo-hlr_10.42.42.2(pid=21174): stdout: | (launched: 2022-12-09_03:56:20.182429) 03:56:23.308551 run osmo-hlr_10.42.42.2(pid=21174): stderr: | 20221209035620380 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209035620380 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209035620380 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209035620380 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209035620380 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209035620380 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209035620393 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209035620401 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209035620402 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209035620402 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:56:23.382309 run osmo-msc_10.42.42.6(pid=21180): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21180)] 03:56:23.433314 run osmo-msc_10.42.42.6(pid=21180): stdout: | (launched: 2022-12-09_03:56:22.227793) 03:56:23.486090 run osmo-msc_10.42.42.6(pid=21180): stderr: | 20221209035622552 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209035622552 DLGLOBAL DEBUG validating counter group 0x7fbea75abc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209035622552 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209035622552 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209035622553 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209035622553 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209035622554 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209035622555 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209035622555 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209035622555 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:56:23.539328 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21173): Terminating (SIGTERM) 03:56:23.581861 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21176): Terminating (SIGTERM) 03:56:23.624571 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21179): Terminating (SIGTERM) 03:56:23.667632 --- ParallelTerminationStrategy: PID 21173 died... 03:56:23.687967 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21173): Terminated: ok {rc=0} 03:56:23.735220 --- ParallelTerminationStrategy: PID 21176 died... 03:56:23.754946 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21176): Terminated: ok {rc=0} 03:56:23.802197 --- ParallelTerminationStrategy: PID 21179 died... 03:56:23.822124 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21179): Terminated: ok {rc=0} 03:56:23.911565 bus /sierra_3: Setting Powered False 03:56:25.011426 bus /sierra_3: Setting Powered False 03:56:26.130454 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2354 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call_osmux.py ---------------------------------------------- 03:56:27.281262 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 03:56:27.293772 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 03:56:27.346111 tst mo_mt_call_osmux.py: using LAC 18901 03:56:27.473759 tst mo_mt_call_osmux.py: using RAC 31 03:56:27.598758 tst mo_mt_call_osmux.py: using CellId 18901 03:56:27.726897 tst mo_mt_call_osmux.py: using BVCI 18902 03:56:27.844347 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 03:56:27.855977 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 03:56:27.867718 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 03:56:27.879199 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 03:56:27.890833 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 03:56:27.902320 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 03:56:28.022883 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 03:56:28.139002 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:56:28.608910 run create_hlr_db(pid=21182): Launched 03:56:28.733364 bus /sierra_2: Setting Powered False 03:56:29.793608 run create_hlr_db(pid=21182): Terminated: ok {rc=0} 03:56:30.236469 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21184): Launched 03:56:30.561465 run osmo-hlr_10.42.42.2(pid=21185): Launched 03:56:30.686290 run osmo-stp_10.42.42.5: Starting osmo-stp 03:56:31.264161 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21187): Launched 03:56:31.685335 run osmo-stp_10.42.42.5(pid=21188): Launched 03:56:32.046091 run osmo-msc_10.42.42.6: Starting osmo-msc 03:56:32.693651 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21190): Launched 03:56:33.018415 run osmo-msc_10.42.42.6(pid=21191): Launched 03:56:33.198995 run osmo-stp_10.42.42.5(pid=21188): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21188)] 03:56:33.336252 run osmo-stp_10.42.42.5(pid=21188): stdout: | (launched: 2022-12-09_03:56:31.604352) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:56:33.474333 run osmo-stp_10.42.42.5(pid=21188): stderr: | 20221209035631859 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035631859 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035631860 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035631861 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035631863 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035631863 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035631863 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:56:33.609971 run osmo-stp_10.42.42.5(pid=21188): stdout: | (launched: 2022-12-09_03:56:31.604352) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:56:33.739660 run osmo-stp_10.42.42.5(pid=21188): stderr: | 20221209035631859 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035631859 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035631860 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035631861 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035631863 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035631863 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035631863 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:56:33.894212 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21188): Process ended prematurely: osmo-stp_10.42.42.5(pid=21188) [trial-2354↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21188)] [trial-2354↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8] 03:56:33.903664 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 03:56:33.932504 run osmo-hlr_10.42.42.2(pid=21185): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21185)] 03:56:33.983353 run osmo-hlr_10.42.42.2(pid=21185): stdout: | (launched: 2022-12-09_03:56:30.502070) 03:56:34.035818 run osmo-hlr_10.42.42.2(pid=21185): stderr: | 20221209035630701 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209035630701 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209035630701 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209035630701 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209035630701 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209035630702 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209035630713 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209035630722 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209035630722 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209035630722 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:56:34.108854 run osmo-msc_10.42.42.6(pid=21191): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21191)] 03:56:34.159760 run osmo-msc_10.42.42.6(pid=21191): stdout: | (launched: 2022-12-09_03:56:32.959025) 03:56:34.212117 run osmo-msc_10.42.42.6(pid=21191): stderr: | 20221209035633282 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209035633282 DLGLOBAL DEBUG validating counter group 0x7f502667ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209035633282 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209035633282 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209035633282 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209035633283 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209035633284 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209035633285 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209035633285 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209035633285 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:56:34.265021 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21184): Terminating (SIGTERM) 03:56:34.307125 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21187): Terminating (SIGTERM) 03:56:34.349850 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21190): Terminating (SIGTERM) 03:56:34.392784 --- ParallelTerminationStrategy: PID 21184 died... 03:56:34.413332 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21184): Terminated: ok {rc=0} 03:56:34.460321 --- ParallelTerminationStrategy: PID 21187 died... 03:56:34.480024 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21187): Terminated: ok {rc=0} 03:56:34.526728 --- ParallelTerminationStrategy: PID 21190 died... 03:56:34.546334 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21190): Terminated: ok {rc=0} 03:56:34.635435 bus /sierra_3: Setting Powered False 03:56:35.734589 bus /sierra_3: Setting Powered False 03:56:36.851140 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 voice:trx-b200+mod-bts0-trxdversion0 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 03:56:38.102906 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:56:38.109887 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 03:56:38.144481 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 03:56:38.172207 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 03:56:38.226868 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 03:56:38.262143 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 03:56:38.289704 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 03:56:38.840220 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 03:56:38.892556 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 03:56:38.904369 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 03:56:38.958595 tst mo_mt_call.py: using LAC 18902 03:56:39.090914 tst mo_mt_call.py: using RAC 32 03:56:39.218170 tst mo_mt_call.py: using CellId 18902 03:56:39.345799 tst mo_mt_call.py: using BVCI 18903 03:56:39.457776 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 03:56:39.469201 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 03:56:39.480326 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 03:56:39.491502 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 03:56:39.502804 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 03:56:39.514049 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 03:56:39.629757 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 03:56:39.746086 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:56:40.215990 run create_hlr_db(pid=21197): Launched 03:56:40.342046 bus /sierra_2: Setting Powered False 03:56:41.406302 run create_hlr_db(pid=21197): Terminated: ok {rc=0} 03:56:41.856823 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21199): Launched 03:56:42.182099 run osmo-hlr_10.42.42.2(pid=21200): Launched 03:56:42.306414 run osmo-stp_10.42.42.5: Starting osmo-stp 03:56:42.864819 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21202): Launched 03:56:43.190561 run osmo-stp_10.42.42.5(pid=21203): Launched 03:56:43.315627 run osmo-msc_10.42.42.6: Starting osmo-msc 03:56:43.902579 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21205): Launched 03:56:44.229431 run osmo-msc_10.42.42.6(pid=21206): Launched 03:56:44.411638 run osmo-stp_10.42.42.5(pid=21203): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21203)] 03:56:44.549537 run osmo-stp_10.42.42.5(pid=21203): stdout: | (launched: 2022-12-09_03:56:43.131574) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:56:44.688170 run osmo-stp_10.42.42.5(pid=21203): stderr: | 20221209035643325 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035643325 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035643325 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035643326 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035643326 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035643326 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035643326 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:56:44.825501 run osmo-stp_10.42.42.5(pid=21203): stdout: | (launched: 2022-12-09_03:56:43.131574) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:56:44.955827 run osmo-stp_10.42.42.5(pid=21203): stderr: | 20221209035643325 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035643325 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035643325 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035643326 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035643326 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035643326 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035643326 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:56:45.111386 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21203): Process ended prematurely: osmo-stp_10.42.42.5(pid=21203) [trial-2354↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21203)] [trial-2354↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 03:56:45.121149 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 03:56:45.149635 run osmo-hlr_10.42.42.2(pid=21200): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21200)] 03:56:45.201212 run osmo-hlr_10.42.42.2(pid=21200): stdout: | (launched: 2022-12-09_03:56:42.122821) 03:56:45.254210 run osmo-hlr_10.42.42.2(pid=21200): stderr: | 20221209035642321 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209035642321 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209035642321 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209035642321 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209035642321 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209035642321 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209035642333 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209035642341 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209035642342 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209035642342 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:56:45.327841 run osmo-msc_10.42.42.6(pid=21206): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21206)] 03:56:45.378943 run osmo-msc_10.42.42.6(pid=21206): stdout: | (launched: 2022-12-09_03:56:44.169987) 03:56:45.431799 run osmo-msc_10.42.42.6(pid=21206): stderr: | 20221209035644494 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209035644494 DLGLOBAL DEBUG validating counter group 0x7ff39013ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209035644494 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209035644494 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209035644495 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209035644495 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209035644496 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209035644497 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209035644497 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209035644497 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:56:45.485057 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21199): Terminating (SIGTERM) 03:56:45.527842 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21202): Terminating (SIGTERM) 03:56:45.570649 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21205): Terminating (SIGTERM) 03:56:45.613644 --- ParallelTerminationStrategy: PID 21199 died... 03:56:45.633975 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21199): Terminated: ok {rc=0} 03:56:45.681123 --- ParallelTerminationStrategy: PID 21202 died... 03:56:45.700889 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21202): Terminated: ok {rc=0} 03:56:45.747878 --- ParallelTerminationStrategy: PID 21205 died... 03:56:45.767573 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21205): Terminated: ok {rc=0} 03:56:45.863730 bus /sierra_3: Setting Powered False 03:56:46.988832 bus /sierra_3: Setting Powered False 03:56:48.118398 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2354 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 03:56:49.265644 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 03:56:49.277740 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 03:56:49.330405 tst mo_mt_call_osmux.py: using LAC 18903 03:56:49.448602 tst mo_mt_call_osmux.py: using RAC 33 03:56:49.567071 tst mo_mt_call_osmux.py: using CellId 18903 03:56:49.687641 tst mo_mt_call_osmux.py: using BVCI 18904 03:56:49.798693 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 03:56:49.810113 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 03:56:49.821573 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 03:56:49.832794 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 03:56:49.844521 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 03:56:49.855970 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 03:56:49.976620 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 03:56:50.100061 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:56:50.571802 run create_hlr_db(pid=21208): Launched 03:56:50.695909 bus /sierra_2: Setting Powered False 03:56:51.756938 run create_hlr_db(pid=21208): Terminated: ok {rc=0} 03:56:52.202495 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21210): Launched 03:56:52.526882 run osmo-hlr_10.42.42.2(pid=21211): Launched 03:56:52.651216 run osmo-stp_10.42.42.5: Starting osmo-stp 03:56:53.212618 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21213): Launched 03:56:53.536560 run osmo-stp_10.42.42.5(pid=21214): Launched 03:56:53.661409 run osmo-msc_10.42.42.6: Starting osmo-msc 03:56:54.248680 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21216): Launched 03:56:54.573628 run osmo-msc_10.42.42.6(pid=21217): Launched 03:56:54.754873 run osmo-stp_10.42.42.5(pid=21214): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21214)] 03:56:54.891854 run osmo-stp_10.42.42.5(pid=21214): stdout: | (launched: 2022-12-09_03:56:53.477789) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:56:55.029806 run osmo-stp_10.42.42.5(pid=21214): stderr: | 20221209035653670 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035653670 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035653670 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035653670 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035653671 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035653671 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035653671 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:56:55.166196 run osmo-stp_10.42.42.5(pid=21214): stdout: | (launched: 2022-12-09_03:56:53.477789) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:56:55.296073 run osmo-stp_10.42.42.5(pid=21214): stderr: | 20221209035653670 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035653670 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035653670 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035653670 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035653671 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035653671 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035653671 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:56:55.451069 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21214): Process ended prematurely: osmo-stp_10.42.42.5(pid=21214) [trial-2354↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21214)] [trial-2354↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 03:56:55.460890 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 03:56:55.489729 run osmo-hlr_10.42.42.2(pid=21211): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21211)] 03:56:55.540470 run osmo-hlr_10.42.42.2(pid=21211): stdout: | (launched: 2022-12-09_03:56:52.467848) 03:56:55.593256 run osmo-hlr_10.42.42.2(pid=21211): stderr: | 20221209035652670 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209035652670 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209035652670 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209035652670 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209035652670 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209035652670 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209035652682 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209035652690 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209035652690 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209035652690 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:56:55.666451 run osmo-msc_10.42.42.6(pid=21217): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21217)] 03:56:55.717257 run osmo-msc_10.42.42.6(pid=21217): stdout: | (launched: 2022-12-09_03:56:54.514652) 03:56:55.769618 run osmo-msc_10.42.42.6(pid=21217): stderr: | 20221209035654841 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209035654841 DLGLOBAL DEBUG validating counter group 0x7ffb9c15ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209035654841 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209035654841 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209035654841 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209035654842 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209035654843 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209035654844 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209035654844 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209035654844 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:56:55.822415 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21210): Terminating (SIGTERM) 03:56:55.864796 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21213): Terminating (SIGTERM) 03:56:55.907546 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21216): Terminating (SIGTERM) 03:56:55.950763 --- ParallelTerminationStrategy: PID 21210 died... 03:56:55.971109 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21210): Terminated: ok {rc=0} 03:56:56.018284 --- ParallelTerminationStrategy: PID 21213 died... 03:56:56.038152 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21213): Terminated: ok {rc=0} 03:56:56.085346 --- ParallelTerminationStrategy: PID 21216 died... 03:56:56.105107 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21216): Terminated: ok {rc=0} 03:56:56.194524 bus /sierra_3: Setting Powered False 03:56:57.295270 bus /sierra_3: Setting Powered False 03:56:58.414608 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 emergency:trx-b200 --------------------------------------------------------------------- 03:56:59.664637 tst emergency:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:56:59.669017 tst emergency:trx-b200: Verifying 1 x bts (candidates: 11) 03:56:59.702061 tst emergency:trx-b200: Verifying 6 x ip_address (candidates: 9) 03:56:59.728813 tst emergency:trx-b200: Verifying 4 x modem (candidates: 12) 03:56:59.814233 tst emergency:trx-b200: Reserving 1 x bts (candidates: 11) 03:56:59.847271 tst emergency:trx-b200: Reserving 6 x ip_address (candidates: 9) 03:56:59.873544 tst emergency:trx-b200: Reserving 4 x modem (candidates: 12) 03:57:00.454779 tst emergency:trx-b200: RESERVED RESOURCES for emergency: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2354 emergency:trx-b200 emergency_mo_mt_call.py ---------------------------------------------- 03:57:00.459628 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 03:57:00.470253 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 03:57:00.518888 tst emergency_mo_mt_call.py: using LAC 18904 03:57:00.637155 tst emergency_mo_mt_call.py: using RAC 34 03:57:00.752913 tst emergency_mo_mt_call.py: using CellId 18904 03:57:00.881385 tst emergency_mo_mt_call.py: using BVCI 18905 03:57:01.008205 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 03:57:01.020099 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 03:57:01.031865 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 03:57:01.043533 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 03:57:01.054727 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 03:57:01.065879 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 03:57:01.182955 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 03:57:01.300552 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:57:01.794915 run create_hlr_db(pid=21222): Launched 03:57:01.997776 bus /sierra_2: Setting Powered False 03:57:03.057255 run create_hlr_db(pid=21222): Terminated: ok {rc=0} 03:57:03.521627 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21224): Launched 03:57:03.841923 run osmo-hlr_10.42.42.2(pid=21225): Launched 03:57:03.963086 run osmo-stp_10.42.42.5: Starting osmo-stp 03:57:04.478606 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21227): Launched 03:57:04.776761 run osmo-stp_10.42.42.5(pid=21228): Launched 03:57:04.900117 tst emergency_mo_mt_call.py: using MSISDN 7016 03:57:05.053978 run osmo-msc_10.42.42.6: Starting osmo-msc 03:57:05.590219 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21230): Launched 03:57:05.887663 run osmo-msc_10.42.42.6(pid=21231): Launched 03:57:06.057758 run osmo-stp_10.42.42.5(pid=21228): ERR: Terminated: ERROR {rc=1} [trial-2354↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21228)] 03:57:06.182930 run osmo-stp_10.42.42.5(pid=21228): stdout: | (launched: 2022-12-09_03:57:04.721634) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:57:06.309200 run osmo-stp_10.42.42.5(pid=21228): stderr: | 20221209035704895 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035704895 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035704895 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035704895 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035704896 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035704896 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035704896 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:57:06.433749 run osmo-stp_10.42.42.5(pid=21228): stdout: | (launched: 2022-12-09_03:57:04.721634) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:57:06.551723 run osmo-stp_10.42.42.5(pid=21228): stderr: | 20221209035704895 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035704895 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035704895 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035704895 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035704896 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035704896 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035704896 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:57:06.693204 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=21228): Process ended prematurely: osmo-stp_10.42.42.5(pid=21228) [trial-2354↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21228)] [trial-2354↪emergency:trx-b200↪emergency_mo_mt_call.py:19] 03:57:06.701721 tst emergency_mo_mt_call.py:19: Test FAILED (6.2 sec) 03:57:06.727997 run osmo-hlr_10.42.42.2(pid=21225): ERR: Terminated: ERROR {rc=237} [trial-2354↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21225)] 03:57:06.775977 run osmo-hlr_10.42.42.2(pid=21225): stdout: | (launched: 2022-12-09_03:57:03.783650) 03:57:06.826118 run osmo-hlr_10.42.42.2(pid=21225): stderr: | 20221209035703965 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209035703965 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209035703965 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209035703965 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209035703965 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209035703966 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209035703978 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/emergency:trx-b200/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209035703986 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209035703986 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209035703986 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:57:06.895453 run osmo-msc_10.42.42.6(pid=21231): ERR: Terminated: ERROR {rc=2} [trial-2354↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21231)] 03:57:06.943907 run osmo-msc_10.42.42.6(pid=21231): stdout: | (launched: 2022-12-09_03:57:05.833537) 03:57:06.993611 run osmo-msc_10.42.42.6(pid=21231): stderr: | 20221209035706106 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209035706106 DLGLOBAL DEBUG validating counter group 0x7f199efe0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209035706106 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209035706106 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209035706106 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209035706106 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209035706109 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209035706110 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209035706110 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209035706110 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:57:07.043692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21224): Terminating (SIGTERM) 03:57:07.083686 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21227): Terminating (SIGTERM) 03:57:07.123908 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21230): Terminating (SIGTERM) 03:57:07.163971 --- ParallelTerminationStrategy: PID 21224 died... 03:57:07.183268 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21224): Terminated: ok {rc=0} 03:57:07.227784 --- ParallelTerminationStrategy: PID 21227 died... 03:57:07.246554 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21227): Terminated: ok {rc=0} 03:57:07.290945 --- ParallelTerminationStrategy: PID 21230 died... 03:57:07.309696 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21230): Terminated: ok {rc=0} 03:57:07.393360 bus /sierra_3: Setting Powered False 03:57:08.491655 bus /sierra_3: Setting Powered False 03:57:09.611846 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2354 emergency:trx-b200 emergency_preemptive_call.py ---------------------------------------------- 03:57:10.699394 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 03:57:10.711055 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 03:57:10.761727 tst emergency_preemptive_call.py: using LAC 18905 03:57:10.880054 tst emergency_preemptive_call.py: using RAC 35 03:57:10.998117 tst emergency_preemptive_call.py: using CellId 18905 03:57:11.116374 tst emergency_preemptive_call.py: using BVCI 18906 03:57:11.225535 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 03:57:11.236179 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 03:57:11.246702 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 03:57:11.257345 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 03:57:11.267926 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 03:57:11.278540 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 03:57:11.392840 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 03:57:11.511565 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 03:57:11.624897 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 03:57:11.738817 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:57:12.203176 run create_hlr_db(pid=21233): Launched 03:57:12.325501 bus /sierra_2: Setting Powered False 03:57:13.385447 run create_hlr_db(pid=21233): Terminated: ok {rc=0} 03:57:13.822958 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21235): Launched 03:57:14.144449 run osmo-hlr_10.42.42.2(pid=21236): Launched 03:57:14.266196 run osmo-stp_10.42.42.5: Starting osmo-stp 03:57:14.818395 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21238): Launched 03:57:15.139110 run osmo-stp_10.42.42.5(pid=21239): Launched 03:57:15.270660 tst emergency_preemptive_call.py: using MSISDN 7017 03:57:15.435039 run osmo-msc_10.42.42.6: Starting osmo-msc 03:57:16.028309 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21241): Launched 03:57:16.363193 run osmo-msc_10.42.42.6(pid=21242): Launched 03:57:16.705222 run osmo-stp_10.42.42.5(pid=21239): ERR: Terminated: ERROR {rc=1} [trial-2354↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21239)] 03:57:17.071597 run osmo-stp_10.42.42.5(pid=21239): stdout: | (launched: 2022-12-09_03:57:15.081157) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:57:17.245801 run osmo-stp_10.42.42.5(pid=21239): stderr: | 20221209035715273 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035715274 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035715274 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035715274 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035715276 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035715277 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035715277 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:57:17.412938 run osmo-stp_10.42.42.5(pid=21239): stdout: | (launched: 2022-12-09_03:57:15.081157) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:57:17.544636 run osmo-stp_10.42.42.5(pid=21239): stderr: | 20221209035715273 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035715274 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035715274 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035715274 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035715276 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035715277 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035715277 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:57:17.686589 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=21239): Process ended prematurely: osmo-stp_10.42.42.5(pid=21239) [trial-2354↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21239)] [trial-2354↪emergency:trx-b200↪emergency_preemptive_call.py:32] 03:57:17.695153 tst emergency_preemptive_call.py:32: Test FAILED (7.0 sec) 03:57:17.721733 run osmo-hlr_10.42.42.2(pid=21236): ERR: Terminated: ERROR {rc=237} [trial-2354↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21236)] 03:57:17.770152 run osmo-hlr_10.42.42.2(pid=21236): stdout: | (launched: 2022-12-09_03:57:14.086156) 03:57:17.820372 run osmo-hlr_10.42.42.2(pid=21236): stderr: | 20221209035714284 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209035714284 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209035714284 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209035714284 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209035714284 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209035714284 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209035714295 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/emergency:trx-b200/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209035714303 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209035714303 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209035714303 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:57:17.890468 run osmo-msc_10.42.42.6(pid=21242): ERR: Terminated: ERROR {rc=2} [trial-2354↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21242)] 03:57:17.938891 run osmo-msc_10.42.42.6(pid=21242): stdout: | (launched: 2022-12-09_03:57:16.304804) 03:57:17.988831 run osmo-msc_10.42.42.6(pid=21242): stderr: | 20221209035716691 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209035716691 DLGLOBAL DEBUG validating counter group 0x7f94c6445c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209035716692 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209035716692 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209035716692 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209035716693 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209035716694 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209035716695 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209035716695 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209035716695 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:57:18.039114 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21235): Terminating (SIGTERM) 03:57:18.079670 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21238): Terminating (SIGTERM) 03:57:18.120000 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21241): Terminating (SIGTERM) 03:57:18.160435 --- ParallelTerminationStrategy: PID 21235 died... 03:57:18.179497 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21235): Terminated: ok {rc=0} 03:57:18.223909 --- ParallelTerminationStrategy: PID 21238 died... 03:57:18.242918 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21238): Terminated: ok {rc=0} 03:57:18.287426 --- ParallelTerminationStrategy: PID 21241 died... 03:57:18.306281 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21241): Terminated: ok {rc=0} 03:57:18.392634 bus /sierra_9: Setting Powered False 03:57:19.493773 bus /sierra_9: Setting Powered False 03:57:20.611638 bus /sierra_8: Setting Powered False 03:57:21.710847 bus /sierra_8: Setting Powered False 03:57:22.827674 bus /sierra_3: Setting Powered False 03:57:23.927166 bus /sierra_3: Setting Powered False 03:57:25.044507 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 emergency:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 gprs:trx-b200 --------------------------------------------------------------------- 03:57:26.321066 tst gprs:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:57:26.325363 tst gprs:trx-b200: Verifying 1 x bts (candidates: 11) 03:57:26.357852 tst gprs:trx-b200: Verifying 9 x ip_address (candidates: 9) 03:57:26.395758 tst gprs:trx-b200: Verifying 4 x modem (candidates: 12) 03:57:26.481897 tst gprs:trx-b200: Reserving 1 x bts (candidates: 11) 03:57:26.514471 tst gprs:trx-b200: Reserving 9 x ip_address (candidates: 9) 03:57:26.552241 tst gprs:trx-b200: Reserving 4 x modem (candidates: 12) 03:57:27.142008 tst gprs:trx-b200: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2354 gprs:trx-b200 cs_paging_gprs_active.py ---------------------------------------------- 03:57:27.197088 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:57:27.208061 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 03:57:27.257802 tst cs_paging_gprs_active.py: using LAC 18906 03:57:27.385125 tst cs_paging_gprs_active.py: using RAC 36 03:57:27.513772 tst cs_paging_gprs_active.py: using CellId 18906 03:57:27.642674 tst cs_paging_gprs_active.py: using BVCI 18907 03:57:27.760799 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:57:27.771864 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:57:27.782738 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:57:27.793783 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:57:27.805240 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:57:27.816120 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:57:27.827351 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:57:27.838573 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:57:27.849866 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 03:57:27.969101 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 03:57:28.089087 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 03:57:28.308867 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:57:28.635313 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21247): Launched 03:57:28.918000 run iperf3-srv_10.42.42.10(pid=21248): Launched 03:57:29.042592 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 03:57:29.262334 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:57:29.587931 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21249): Launched 03:57:29.871029 run iperf3-srv_10.42.42.10(pid=21250): Launched 03:57:29.993893 tst cs_paging_gprs_active.py:38: start network... 03:57:30.213826 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:57:30.717803 run create_hlr_db(pid=21251): Launched 03:57:30.855599 bus /sierra_2: Setting Powered False 03:57:31.918556 run create_hlr_db(pid=21251): Terminated: ok {rc=0} 03:57:32.348573 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21253): Launched 03:57:32.652145 run osmo-hlr_10.42.42.2(pid=21254): Launched 03:57:32.770628 run osmo-stp_10.42.42.5: Starting osmo-stp 03:57:33.293537 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21256): Launched 03:57:33.596743 run osmo-stp_10.42.42.5(pid=21257): Launched 03:57:33.712261 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:57:34.237676 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21259): Launched 03:57:34.354167 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:57:34.611327 run patchelf(pid=21260): Launched 03:57:34.780450 run osmo-stp_10.42.42.5(pid=21257): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21257)] 03:57:34.909475 run osmo-stp_10.42.42.5(pid=21257): stdout: | (launched: 2022-12-09_03:57:33.541439) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:57:35.039516 run osmo-stp_10.42.42.5(pid=21257): stderr: | 20221209035733714 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035733714 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035733714 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035733715 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035733715 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035733715 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035733715 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:57:35.169664 run osmo-stp_10.42.42.5(pid=21257): stdout: | (launched: 2022-12-09_03:57:33.541439) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:57:35.294859 run osmo-stp_10.42.42.5(pid=21257): stderr: | 20221209035733714 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035733714 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035733714 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035733715 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035733715 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035733715 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035733715 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:57:35.442627 run patchelf(pid=21260): Terminating (SIGINT) 03:57:35.614155 run patchelf(pid=21260): Terminated: ok {rc=0} 03:57:35.737717 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=21257): Process ended prematurely: osmo-stp_10.42.42.5(pid=21257) [trial-2354↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21257)] [trial-2354↪gprs:trx-b200↪cs_paging_gprs_active.py:38] 03:57:35.747256 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 03:57:35.774961 run osmo-hlr_10.42.42.2(pid=21254): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-b200↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21254)] 03:57:35.823241 run osmo-hlr_10.42.42.2(pid=21254): stdout: | (launched: 2022-12-09_03:57:32.596429) 03:57:35.873569 run osmo-hlr_10.42.42.2(pid=21254): stderr: | 20221209035732773 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209035732773 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209035732773 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209035732773 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209035732773 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209035732773 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209035732785 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-b200/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209035732793 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209035732794 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209035732794 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:57:35.923936 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21247): Terminating (SIGTERM) 03:57:35.964092 run iperf3-srv_10.42.42.10(pid=21248): Terminating (SIGTERM) 03:57:36.004075 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21249): Terminating (SIGTERM) 03:57:36.044285 run iperf3-srv_10.42.42.10(pid=21250): Terminating (SIGTERM) 03:57:36.084263 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21253): Terminating (SIGTERM) 03:57:36.124419 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21256): Terminating (SIGTERM) 03:57:36.164605 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21259): Terminating (SIGTERM) 03:57:36.205493 --- ParallelTerminationStrategy: PID 21247 died... 03:57:36.224837 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21247): Terminated: ok {rc=0} 03:57:36.269376 --- ParallelTerminationStrategy: PID 21248 died... 03:57:36.287942 run iperf3-srv_10.42.42.10(pid=21248): Terminated {rc=256} 03:57:36.331889 --- ParallelTerminationStrategy: PID 21249 died... 03:57:36.350551 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21249): Terminated: ok {rc=0} 03:57:36.394555 --- ParallelTerminationStrategy: PID 21250 died... 03:57:36.413296 run iperf3-srv_10.42.42.10(pid=21250): Terminated {rc=256} 03:57:36.457315 --- ParallelTerminationStrategy: PID 21253 died... 03:57:36.476169 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21253): Terminated: ok {rc=0} 03:57:36.520190 --- ParallelTerminationStrategy: PID 21256 died... 03:57:36.538934 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21256): Terminated: ok {rc=0} 03:57:36.583084 --- ParallelTerminationStrategy: PID 21259 died... 03:57:36.601883 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21259): Terminated: ok {rc=0} 03:57:36.685226 bus /gobi_0: Setting Powered False 03:57:37.783525 bus /gobi_0: Setting Powered False 03:57:38.902030 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:trx-b200 iperf3.py ---------------------------------------------- 03:57:40.051528 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:57:40.063264 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 03:57:40.116655 tst iperf3.py: using LAC 18907 03:57:40.243734 tst iperf3.py: using RAC 37 03:57:40.370395 tst iperf3.py: using CellId 18907 03:57:40.508178 tst iperf3.py: using BVCI 18908 03:57:40.627975 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:57:40.639159 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:57:40.650098 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:57:40.661292 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:57:40.672352 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:57:40.683422 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:57:40.694728 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:57:40.705821 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:57:40.717099 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 03:57:40.832363 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 03:57:41.035740 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:57:41.339604 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21265): Launched 03:57:41.605860 run iperf3-srv_10.42.42.10(pid=21266): Launched 03:57:41.720241 tst iperf3.py:8: start network... 03:57:41.923364 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:57:42.394476 run create_hlr_db(pid=21267): Launched 03:57:42.521226 bus /gobi_6: Setting Powered False 03:57:43.581709 run create_hlr_db(pid=21267): Terminated: ok {rc=0} 03:57:44.024913 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21269): Launched 03:57:44.350496 run osmo-hlr_10.42.42.2(pid=21270): Launched 03:57:44.477559 run osmo-stp_10.42.42.5: Starting osmo-stp 03:57:45.037638 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21272): Launched 03:57:45.364744 run osmo-stp_10.42.42.5(pid=21273): Launched 03:57:45.490817 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:57:46.082042 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21275): Launched 03:57:46.203663 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:57:46.472686 run patchelf(pid=21276): Launched 03:57:46.662917 run osmo-stp_10.42.42.5(pid=21273): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21273)] 03:57:46.794091 run osmo-stp_10.42.42.5(pid=21273): stdout: | (launched: 2022-12-09_03:57:45.305586) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:57:46.928281 run osmo-stp_10.42.42.5(pid=21273): stderr: | 20221209035745500 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035745501 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035745501 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035745501 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035745502 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035745502 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035745502 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:57:47.063513 run osmo-stp_10.42.42.5(pid=21273): stdout: | (launched: 2022-12-09_03:57:45.305586) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:57:47.189715 run osmo-stp_10.42.42.5(pid=21273): stderr: | 20221209035745500 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035745501 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035745501 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035745501 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035745502 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035745502 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035745502 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:57:47.337262 run patchelf(pid=21276): Terminating (SIGINT) 03:57:47.508617 run patchelf(pid=21276): Terminated: ok {rc=0} 03:57:47.632316 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21273): Process ended prematurely: osmo-stp_10.42.42.5(pid=21273) [trial-2354↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21273)] [trial-2354↪gprs:trx-b200↪iperf3.py:8] 03:57:47.642110 tst iperf3.py:8: Test FAILED (7.6 sec) 03:57:47.669843 run osmo-hlr_10.42.42.2(pid=21270): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-b200↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21270)] 03:57:47.718136 run osmo-hlr_10.42.42.2(pid=21270): stdout: | (launched: 2022-12-09_03:57:44.291494) 03:57:47.767986 run osmo-hlr_10.42.42.2(pid=21270): stderr: | 20221209035744489 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209035744489 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209035744489 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209035744489 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209035744489 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209035744489 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209035744502 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-b200/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209035744511 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209035744511 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209035744511 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:57:47.818514 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21265): Terminating (SIGTERM) 03:57:47.858999 run iperf3-srv_10.42.42.10(pid=21266): Terminating (SIGTERM) 03:57:47.899247 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21269): Terminating (SIGTERM) 03:57:47.939582 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21272): Terminating (SIGTERM) 03:57:47.979920 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21275): Terminating (SIGTERM) 03:57:48.020654 --- ParallelTerminationStrategy: PID 21265 died... 03:57:48.040138 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21265): Terminated: ok {rc=0} 03:57:48.084842 --- ParallelTerminationStrategy: PID 21266 died... 03:57:48.104063 run iperf3-srv_10.42.42.10(pid=21266): Terminated {rc=256} 03:57:48.148497 --- ParallelTerminationStrategy: PID 21269 died... 03:57:48.167369 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21269): Terminated: ok {rc=0} 03:57:48.211728 --- ParallelTerminationStrategy: PID 21272 died... 03:57:48.230575 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21272): Terminated: ok {rc=0} 03:57:48.275062 --- ParallelTerminationStrategy: PID 21275 died... 03:57:48.293945 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21275): Terminated: ok {rc=0} 03:57:48.379409 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:trx-b200 iperf3m4.py ---------------------------------------------- 03:57:49.529733 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:57:49.541662 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 03:57:49.590449 tst iperf3m4.py: using LAC 18908 03:57:49.716503 tst iperf3m4.py: using RAC 38 03:57:49.842288 tst iperf3m4.py: using CellId 18908 03:57:49.968393 tst iperf3m4.py: using BVCI 18909 03:57:50.086429 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:57:50.097676 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:57:50.108582 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:57:50.119543 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:57:50.130944 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:57:50.142019 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:57:50.153333 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:57:50.164060 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:57:50.176040 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 03:57:50.292596 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 03:57:50.415671 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 03:57:50.536624 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 03:57:50.658126 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 03:57:50.878384 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:57:51.206007 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21277): Launched 03:57:51.491150 run iperf3-srv_10.42.42.10(pid=21278): Launched 03:57:51.615477 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 03:57:51.834710 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:57:52.162914 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21279): Launched 03:57:52.447786 run iperf3-srv_10.42.42.10(pid=21280): Launched 03:57:52.570702 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 03:57:52.790137 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:57:53.117724 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21281): Launched 03:57:53.401307 run iperf3-srv_10.42.42.10(pid=21282): Launched 03:57:53.525301 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 03:57:53.743860 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:57:54.070933 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21283): Launched 03:57:54.355342 run iperf3-srv_10.42.42.10(pid=21284): Launched 03:57:54.479553 tst iperf3m4.py:8: start network... 03:57:54.698254 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:57:55.202685 run create_hlr_db(pid=21285): Launched 03:57:55.327070 bus /gobi_6: Setting Powered False 03:57:56.391357 run create_hlr_db(pid=21285): Terminated: ok {rc=0} 03:57:56.826460 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21287): Launched 03:57:57.130428 run osmo-hlr_10.42.42.2(pid=21288): Launched 03:57:57.246702 run osmo-stp_10.42.42.5: Starting osmo-stp 03:57:57.770494 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21290): Launched 03:57:58.074294 run osmo-stp_10.42.42.5(pid=21291): Launched 03:57:58.189892 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:57:58.711711 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21293): Launched 03:57:58.828088 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:57:59.085496 run patchelf(pid=21294): Launched 03:57:59.254937 run osmo-stp_10.42.42.5(pid=21291): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21291)] 03:57:59.383702 run osmo-stp_10.42.42.5(pid=21291): stdout: | (launched: 2022-12-09_03:57:58.018178) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:57:59.513969 run osmo-stp_10.42.42.5(pid=21291): stderr: | 20221209035758190 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035758190 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035758190 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035758191 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035758191 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035758191 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035758191 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:57:59.644300 run osmo-stp_10.42.42.5(pid=21291): stdout: | (launched: 2022-12-09_03:57:58.018178) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:57:59.769384 run osmo-stp_10.42.42.5(pid=21291): stderr: | 20221209035758190 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035758190 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035758190 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035758191 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035758191 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035758191 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035758191 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:57:59.917555 run patchelf(pid=21294): Terminating (SIGINT) 03:58:00.089087 run patchelf(pid=21294): Terminated: ok {rc=0} 03:58:00.212662 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21291): Process ended prematurely: osmo-stp_10.42.42.5(pid=21291) [trial-2354↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21291)] [trial-2354↪gprs:trx-b200↪iperf3m4.py:8] 03:58:00.222355 tst iperf3m4.py:8: Test FAILED (10.7 sec) 03:58:00.249998 run osmo-hlr_10.42.42.2(pid=21288): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-b200↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21288)] 03:58:00.298176 run osmo-hlr_10.42.42.2(pid=21288): stdout: | (launched: 2022-12-09_03:57:57.074509) 03:58:00.347414 run osmo-hlr_10.42.42.2(pid=21288): stderr: | 20221209035757253 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209035757253 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209035757253 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209035757254 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209035757254 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209035757254 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209035757269 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-b200/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209035757279 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209035757280 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209035757280 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:58:00.397468 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21277): Terminating (SIGTERM) 03:58:00.437154 run iperf3-srv_10.42.42.10(pid=21278): Terminating (SIGTERM) 03:58:00.476571 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21279): Terminating (SIGTERM) 03:58:00.516035 run iperf3-srv_10.42.42.10(pid=21280): Terminating (SIGTERM) 03:58:00.555460 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21281): Terminating (SIGTERM) 03:58:00.594977 run iperf3-srv_10.42.42.10(pid=21282): Terminating (SIGTERM) 03:58:00.634192 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21283): Terminating (SIGTERM) 03:58:00.673550 run iperf3-srv_10.42.42.10(pid=21284): Terminating (SIGTERM) 03:58:00.712717 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21287): Terminating (SIGTERM) 03:58:00.752672 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21290): Terminating (SIGTERM) 03:58:00.791994 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21293): Terminating (SIGTERM) 03:58:00.831770 --- ParallelTerminationStrategy: PID 21277 died... 03:58:00.855876 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21277): Terminated: ok {rc=0} 03:58:00.906719 --- ParallelTerminationStrategy: PID 21278 died... 03:58:00.926169 run iperf3-srv_10.42.42.10(pid=21278): Terminated {rc=256} 03:58:00.970830 --- ParallelTerminationStrategy: PID 21279 died... 03:58:00.989908 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21279): Terminated: ok {rc=0} 03:58:01.034783 --- ParallelTerminationStrategy: PID 21280 died... 03:58:01.054078 run iperf3-srv_10.42.42.10(pid=21280): Terminated {rc=256} 03:58:01.098875 --- ParallelTerminationStrategy: PID 21281 died... 03:58:01.118157 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21281): Terminated: ok {rc=0} 03:58:01.162875 --- ParallelTerminationStrategy: PID 21282 died... 03:58:01.182084 run iperf3-srv_10.42.42.10(pid=21282): Terminated {rc=256} 03:58:01.226783 --- ParallelTerminationStrategy: PID 21283 died... 03:58:01.246037 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21283): Terminated: ok {rc=0} 03:58:01.290893 --- ParallelTerminationStrategy: PID 21284 died... 03:58:01.310187 run iperf3-srv_10.42.42.10(pid=21284): Terminated {rc=256} 03:58:01.355042 --- ParallelTerminationStrategy: PID 21287 died... 03:58:01.374342 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21287): Terminated: ok {rc=0} 03:58:01.419090 --- ParallelTerminationStrategy: PID 21290 died... 03:58:01.438562 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21290): Terminated: ok {rc=0} 03:58:01.483330 --- ParallelTerminationStrategy: PID 21293 died... 03:58:01.502610 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21293): Terminated: ok {rc=0} 03:58:01.592135 bus /gobi_4: Setting Powered False 03:58:02.696868 bus /gobi_4: Setting Powered False 03:58:03.812230 bus /gobi_1: Setting Powered False 03:58:04.911704 bus /gobi_1: Setting Powered False 03:58:06.024278 bus /gobi_0: Setting Powered False 03:58:07.123007 bus /gobi_0: Setting Powered False 03:58:08.242913 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:trx-b200 ping.py ---------------------------------------------- 03:58:09.343158 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:58:09.354605 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 03:58:09.404083 tst ping.py: using LAC 18909 03:58:09.523389 tst ping.py: using RAC 39 03:58:09.643100 tst ping.py: using CellId 18909 03:58:09.760548 tst ping.py: using BVCI 18910 03:58:09.869054 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:58:09.879649 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:58:09.890165 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:58:09.900611 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:58:09.910989 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:58:09.921401 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:58:09.931847 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:58:09.942361 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 03:58:10.060549 tst ping.py:19: start network... 03:58:10.260710 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:58:10.723261 run create_hlr_db(pid=21296): Launched 03:58:10.844864 bus /gobi_6: Setting Powered False 03:58:11.905079 run create_hlr_db(pid=21296): Terminated: ok {rc=0} 03:58:12.340920 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21298): Launched 03:58:12.661748 run osmo-hlr_10.42.42.2(pid=21299): Launched 03:58:12.784215 run osmo-stp_10.42.42.5: Starting osmo-stp 03:58:13.342558 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21301): Launched 03:58:13.664502 run osmo-stp_10.42.42.5(pid=21302): Launched 03:58:13.787665 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:58:14.340426 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21304): Launched 03:58:14.465388 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:58:14.736240 run patchelf(pid=21305): Launched 03:58:14.916364 run osmo-stp_10.42.42.5(pid=21302): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21302)] 03:58:15.052440 run osmo-stp_10.42.42.5(pid=21302): stdout: | (launched: 2022-12-09_03:58:13.606045) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:58:15.189593 run osmo-stp_10.42.42.5(pid=21302): stderr: | 20221209035813797 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035813797 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035813798 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035813798 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035813798 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035813799 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035813799 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:58:15.326974 run osmo-stp_10.42.42.5(pid=21302): stdout: | (launched: 2022-12-09_03:58:13.606045) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:58:15.458806 run osmo-stp_10.42.42.5(pid=21302): stderr: | 20221209035813797 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035813797 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035813798 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035813798 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035813798 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035813799 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035813799 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:58:15.614928 run patchelf(pid=21305): Terminating (SIGINT) 03:58:15.795277 run patchelf(pid=21305): Terminated: ok {rc=0} 03:58:15.928686 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=21302): Process ended prematurely: osmo-stp_10.42.42.5(pid=21302) [trial-2354↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21302)] [trial-2354↪gprs:trx-b200↪ping.py:22] 03:58:15.938546 tst ping.py:22: Test FAILED (6.6 sec) 03:58:15.967148 run osmo-hlr_10.42.42.2(pid=21299): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-b200↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21299)] 03:58:16.017202 run osmo-hlr_10.42.42.2(pid=21299): stdout: | (launched: 2022-12-09_03:58:12.603454) 03:58:16.069724 run osmo-hlr_10.42.42.2(pid=21299): stderr: | 20221209035812801 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209035812801 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209035812801 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209035812802 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209035812802 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209035812802 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209035812813 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-b200/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209035812823 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209035812823 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209035812823 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:58:16.121413 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21298): Terminating (SIGTERM) 03:58:16.163227 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21301): Terminating (SIGTERM) 03:58:16.206373 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21304): Terminating (SIGTERM) 03:58:16.250599 --- ParallelTerminationStrategy: PID 21298 died... 03:58:16.270254 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21298): Terminated: ok {rc=0} 03:58:16.316646 --- ParallelTerminationStrategy: PID 21301 died... 03:58:16.335972 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21301): Terminated: ok {rc=0} 03:58:16.381530 --- ParallelTerminationStrategy: PID 21304 died... 03:58:16.400540 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21304): Terminated: ok {rc=0} 03:58:16.487728 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:trx-b200 ping_idle_ping.py ---------------------------------------------- 03:58:17.574891 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:58:17.587342 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 03:58:17.644326 tst ping_idle_ping.py: using LAC 18910 03:58:17.770297 tst ping_idle_ping.py: using RAC 40 03:58:17.897162 tst ping_idle_ping.py: using CellId 18910 03:58:18.022346 tst ping_idle_ping.py: using BVCI 18911 03:58:18.141610 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:58:18.152685 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:58:18.163823 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:58:18.175191 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:58:18.186475 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:58:18.197842 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:58:18.209278 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:58:18.220581 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 03:58:18.336512 tst ping_idle_ping.py:24: start network... 03:58:18.536805 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:58:19.002420 run create_hlr_db(pid=21306): Launched 03:58:19.127226 bus /gobi_6: Setting Powered False 03:58:20.191088 run create_hlr_db(pid=21306): Terminated: ok {rc=0} 03:58:20.637801 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21308): Launched 03:58:20.959557 run osmo-hlr_10.42.42.2(pid=21309): Launched 03:58:21.084534 run osmo-stp_10.42.42.5: Starting osmo-stp 03:58:21.634704 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21311): Launched 03:58:21.956720 run osmo-stp_10.42.42.5(pid=21312): Launched 03:58:22.081886 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:58:22.634817 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21314): Launched 03:58:22.757593 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:58:23.029003 run patchelf(pid=21315): Launched 03:58:23.207308 run osmo-stp_10.42.42.5(pid=21312): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21312)] 03:58:23.342999 run osmo-stp_10.42.42.5(pid=21312): stdout: | (launched: 2022-12-09_03:58:21.898339) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:58:23.480150 run osmo-stp_10.42.42.5(pid=21312): stderr: | 20221209035822093 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035822093 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035822093 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035822094 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035822094 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035822094 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035822094 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:58:23.617598 run osmo-stp_10.42.42.5(pid=21312): stdout: | (launched: 2022-12-09_03:58:21.898339) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:58:23.749204 run osmo-stp_10.42.42.5(pid=21312): stderr: | 20221209035822093 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035822093 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035822093 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035822094 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035822094 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035822094 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035822094 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:58:23.905218 run patchelf(pid=21315): Terminating (SIGINT) 03:58:24.086295 run patchelf(pid=21315): Terminated: ok {rc=0} 03:58:24.215968 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=21312): Process ended prematurely: osmo-stp_10.42.42.5(pid=21312) [trial-2354↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21312)] [trial-2354↪gprs:trx-b200↪ping_idle_ping.py:27] 03:58:24.225635 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 03:58:24.254600 run osmo-hlr_10.42.42.2(pid=21309): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-b200↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21309)] 03:58:24.305752 run osmo-hlr_10.42.42.2(pid=21309): stdout: | (launched: 2022-12-09_03:58:20.901473) 03:58:24.358456 run osmo-hlr_10.42.42.2(pid=21309): stderr: | 20221209035821098 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209035821098 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209035821098 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209035821098 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209035821098 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209035821098 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209035821109 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-b200/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209035821118 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209035821118 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209035821118 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:58:24.411534 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21308): Terminating (SIGTERM) 03:58:24.454271 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21311): Terminating (SIGTERM) 03:58:24.496892 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21314): Terminating (SIGTERM) 03:58:24.539700 --- ParallelTerminationStrategy: PID 21308 died... 03:58:24.560167 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21308): Terminated: ok {rc=0} 03:58:24.607436 --- ParallelTerminationStrategy: PID 21311 died... 03:58:24.627397 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21311): Terminated: ok {rc=0} 03:58:24.674564 --- ParallelTerminationStrategy: PID 21314 died... 03:58:24.694511 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21314): Terminated: ok {rc=0} 03:58:24.782924 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2354 gprs:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 gprs:trx-b200+mod-bts0-egprs --------------------------------------------------------------------- 03:58:26.100161 tst gprs:trx-b200+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:58:26.105996 tst gprs:trx-b200+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 03:58:26.141112 tst gprs:trx-b200+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 03:58:26.180404 tst gprs:trx-b200+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 03:58:26.269591 tst gprs:trx-b200+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 03:58:26.303628 tst gprs:trx-b200+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 03:58:26.343330 tst gprs:trx-b200+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 03:58:26.937094 tst gprs:trx-b200+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2354 gprs:trx-b200+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 03:58:26.990397 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:58:27.001802 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:58:27.053692 tst cs_paging_gprs_active.py: using LAC 18911 03:58:27.175609 tst cs_paging_gprs_active.py: using RAC 41 03:58:27.297511 tst cs_paging_gprs_active.py: using CellId 18911 03:58:27.420236 tst cs_paging_gprs_active.py: using BVCI 18912 03:58:27.541509 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:58:27.553154 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:58:27.564317 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:58:27.575766 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:58:27.587058 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:58:27.598550 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:58:27.609969 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:58:27.621250 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:58:27.632468 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:58:27.748550 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:58:27.868419 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 03:58:28.091020 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:58:28.419522 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21319): Launched 03:58:28.705447 run iperf3-srv_10.42.42.10(pid=21320): Launched 03:58:28.829720 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 03:58:29.050199 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:58:29.377700 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21321): Launched 03:58:29.662662 run iperf3-srv_10.42.42.10(pid=21322): Launched 03:58:29.787370 tst cs_paging_gprs_active.py:38: start network... 03:58:30.007572 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:58:30.513633 run create_hlr_db(pid=21323): Launched 03:58:30.639575 bus /gobi_6: Setting Powered False 03:58:31.704179 run create_hlr_db(pid=21323): Terminated: ok {rc=0} 03:58:32.172433 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21325): Launched 03:58:32.511238 run osmo-hlr_10.42.42.2(pid=21326): Launched 03:58:32.638903 run osmo-stp_10.42.42.5: Starting osmo-stp 03:58:33.162497 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21328): Launched 03:58:33.467085 run osmo-stp_10.42.42.5(pid=21329): Launched 03:58:33.582623 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:58:34.104396 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21331): Launched 03:58:34.219876 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:58:34.475749 run patchelf(pid=21332): Launched 03:58:34.644840 run osmo-stp_10.42.42.5(pid=21329): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21329)] 03:58:34.774224 run osmo-stp_10.42.42.5(pid=21329): stdout: | (launched: 2022-12-09_03:58:33.411737) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:58:34.904396 run osmo-stp_10.42.42.5(pid=21329): stderr: | 20221209035833584 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035833584 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035833584 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035833585 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035833585 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035833585 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035833585 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:58:35.034554 run osmo-stp_10.42.42.5(pid=21329): stdout: | (launched: 2022-12-09_03:58:33.411737) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:58:35.159154 run osmo-stp_10.42.42.5(pid=21329): stderr: | 20221209035833584 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035833584 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035833584 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035833585 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035833585 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035833585 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035833585 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:58:35.306933 run patchelf(pid=21332): Terminating (SIGINT) 03:58:35.478903 run patchelf(pid=21332): Terminated: ok {rc=0} 03:58:35.602856 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=21329): Process ended prematurely: osmo-stp_10.42.42.5(pid=21329) [trial-2354↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21329)] [trial-2354↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 03:58:35.612452 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 03:58:35.639830 run osmo-hlr_10.42.42.2(pid=21326): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21326)] 03:58:35.687728 run osmo-hlr_10.42.42.2(pid=21326): stdout: | (launched: 2022-12-09_03:58:32.452080) 03:58:35.737306 run osmo-hlr_10.42.42.2(pid=21326): stderr: | 20221209035832654 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209035832654 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209035832654 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209035832654 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209035832654 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209035832654 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209035832667 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-b200+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209035832675 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209035832675 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209035832676 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:58:35.787482 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21319): Terminating (SIGTERM) 03:58:35.827422 run iperf3-srv_10.42.42.10(pid=21320): Terminating (SIGTERM) 03:58:35.867104 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21321): Terminating (SIGTERM) 03:58:35.906790 run iperf3-srv_10.42.42.10(pid=21322): Terminating (SIGTERM) 03:58:35.946206 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21325): Terminating (SIGTERM) 03:58:35.985903 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21328): Terminating (SIGTERM) 03:58:36.025654 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21331): Terminating (SIGTERM) 03:58:36.065560 --- ParallelTerminationStrategy: PID 21319 died... 03:58:36.084631 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21319): Terminated: ok {rc=0} 03:58:36.128614 --- ParallelTerminationStrategy: PID 21320 died... 03:58:36.147250 run iperf3-srv_10.42.42.10(pid=21320): Terminated {rc=256} 03:58:36.191911 --- ParallelTerminationStrategy: PID 21321 died... 03:58:36.210684 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21321): Terminated: ok {rc=0} 03:58:36.255130 --- ParallelTerminationStrategy: PID 21322 died... 03:58:36.273860 run iperf3-srv_10.42.42.10(pid=21322): Terminated {rc=256} 03:58:36.317544 --- ParallelTerminationStrategy: PID 21325 died... 03:58:36.336338 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21325): Terminated: ok {rc=0} 03:58:36.380343 --- ParallelTerminationStrategy: PID 21328 died... 03:58:36.399209 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21328): Terminated: ok {rc=0} 03:58:36.443184 --- ParallelTerminationStrategy: PID 21331 died... 03:58:36.461977 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21331): Terminated: ok {rc=0} 03:58:36.547997 bus /gobi_0: Setting Powered False 03:58:37.648387 bus /gobi_0: Setting Powered False 03:58:38.764639 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:trx-b200+mod-bts0-egprs iperf3.py ---------------------------------------------- 03:58:39.912112 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:58:39.923985 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:58:39.976907 tst iperf3.py: using LAC 18912 03:58:40.096551 tst iperf3.py: using RAC 42 03:58:40.217440 tst iperf3.py: using CellId 18912 03:58:40.337119 tst iperf3.py: using BVCI 18913 03:58:40.456770 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:58:40.468267 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:58:40.479984 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:58:40.491678 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:58:40.503240 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:58:40.514823 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:58:40.526533 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:58:40.537970 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:58:40.549596 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:58:40.664585 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 03:58:40.872304 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:58:41.178138 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21335): Launched 03:58:41.445585 run iperf3-srv_10.42.42.10(pid=21336): Launched 03:58:41.560156 tst iperf3.py:8: start network... 03:58:41.763027 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:58:42.234330 run create_hlr_db(pid=21337): Launched 03:58:42.358598 bus /gobi_6: Setting Powered False 03:58:43.419908 run create_hlr_db(pid=21337): Terminated: ok {rc=0} 03:58:43.841504 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21339): Launched 03:58:44.145699 run osmo-hlr_10.42.42.2(pid=21340): Launched 03:58:44.260484 run osmo-stp_10.42.42.5: Starting osmo-stp 03:58:44.781558 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21342): Launched 03:58:45.085093 run osmo-stp_10.42.42.5(pid=21343): Launched 03:58:45.200745 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:58:45.722041 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21345): Launched 03:58:45.850936 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:58:46.148748 run patchelf(pid=21346): Launched 03:58:46.344570 run osmo-stp_10.42.42.5(pid=21343): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21343)] 03:58:46.487739 run osmo-stp_10.42.42.5(pid=21343): stdout: | (launched: 2022-12-09_03:58:45.028656) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:58:46.634266 run osmo-stp_10.42.42.5(pid=21343): stderr: | 20221209035845200 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035845200 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035845200 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035845201 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035845201 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035845201 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035845201 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:58:46.778369 run osmo-stp_10.42.42.5(pid=21343): stdout: | (launched: 2022-12-09_03:58:45.028656) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:58:46.918033 run osmo-stp_10.42.42.5(pid=21343): stderr: | 20221209035845200 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035845200 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035845200 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035845201 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035845201 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035845201 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035845201 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:58:47.082736 run patchelf(pid=21346): Terminating (SIGINT) 03:58:47.269171 run patchelf(pid=21346): Terminated: ok {rc=0} 03:58:47.403134 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21343): Process ended prematurely: osmo-stp_10.42.42.5(pid=21343) [trial-2354↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21343)] [trial-2354↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8] 03:58:47.413810 tst iperf3.py:8: Test FAILED (7.5 sec) 03:58:47.444606 run osmo-hlr_10.42.42.2(pid=21340): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21340)] 03:58:47.497100 run osmo-hlr_10.42.42.2(pid=21340): stdout: | (launched: 2022-12-09_03:58:44.089723) 03:58:47.551043 run osmo-hlr_10.42.42.2(pid=21340): stderr: | 20221209035844265 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209035844265 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209035844265 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209035844265 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209035844265 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209035844265 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209035844278 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-b200+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209035844286 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209035844286 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209035844286 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:58:47.605405 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21335): Terminating (SIGTERM) 03:58:47.648754 run iperf3-srv_10.42.42.10(pid=21336): Terminating (SIGTERM) 03:58:47.692008 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21339): Terminating (SIGTERM) 03:58:47.735357 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21342): Terminating (SIGTERM) 03:58:47.778705 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21345): Terminating (SIGTERM) 03:58:47.822216 --- ParallelTerminationStrategy: PID 21335 died... 03:58:47.842523 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21335): Terminated: ok {rc=0} 03:58:47.890796 --- ParallelTerminationStrategy: PID 21336 died... 03:58:47.910723 run iperf3-srv_10.42.42.10(pid=21336): Terminated {rc=256} 03:58:47.959127 --- ParallelTerminationStrategy: PID 21339 died... 03:58:47.979080 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21339): Terminated: ok {rc=0} 03:58:48.026787 --- ParallelTerminationStrategy: PID 21342 died... 03:58:48.046946 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21342): Terminated: ok {rc=0} 03:58:48.094189 --- ParallelTerminationStrategy: PID 21345 died... 03:58:48.114010 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21345): Terminated: ok {rc=0} 03:58:48.203244 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:trx-b200+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 03:58:49.354792 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:58:49.367078 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:58:49.424479 tst iperf3m4.py: using LAC 18913 03:58:49.551080 tst iperf3m4.py: using RAC 43 03:58:49.677795 tst iperf3m4.py: using CellId 18913 03:58:49.802777 tst iperf3m4.py: using BVCI 18914 03:58:49.922227 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:58:49.933587 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:58:49.944717 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:58:49.956127 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:58:49.967485 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:58:49.978927 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:58:49.990905 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:58:50.002260 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:58:50.013856 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:58:50.133847 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:58:50.254735 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:58:50.375143 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:58:50.492014 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 03:58:50.711842 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:58:51.039527 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21347): Launched 03:58:51.323720 run iperf3-srv_10.42.42.10(pid=21348): Launched 03:58:51.446484 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 03:58:51.665791 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:58:51.992307 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21349): Launched 03:58:52.276079 run iperf3-srv_10.42.42.10(pid=21350): Launched 03:58:52.398578 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 03:58:52.617232 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:58:52.943971 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21351): Launched 03:58:53.228434 run iperf3-srv_10.42.42.10(pid=21352): Launched 03:58:53.350826 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 03:58:53.569815 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:58:53.895818 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21353): Launched 03:58:54.179872 run iperf3-srv_10.42.42.10(pid=21354): Launched 03:58:54.302483 tst iperf3m4.py:8: start network... 03:58:54.521264 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:58:55.026890 run create_hlr_db(pid=21355): Launched 03:58:55.151969 bus /gobi_6: Setting Powered False 03:58:56.216857 run create_hlr_db(pid=21355): Terminated: ok {rc=0} 03:58:56.670252 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21357): Launched 03:58:56.997431 run osmo-hlr_10.42.42.2(pid=21358): Launched 03:58:57.124464 run osmo-stp_10.42.42.5: Starting osmo-stp 03:58:57.690210 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21360): Launched 03:58:58.016858 run osmo-stp_10.42.42.5(pid=21361): Launched 03:58:58.141500 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:58:58.702270 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21363): Launched 03:58:58.829035 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:58:59.105167 run patchelf(pid=21364): Launched 03:58:59.286448 run osmo-stp_10.42.42.5(pid=21361): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21361)] 03:58:59.424105 run osmo-stp_10.42.42.5(pid=21361): stdout: | (launched: 2022-12-09_03:58:57.957288) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:58:59.563579 run osmo-stp_10.42.42.5(pid=21361): stderr: | 20221209035858151 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035858151 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035858151 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035858151 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035858152 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035858152 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035858152 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:58:59.703304 run osmo-stp_10.42.42.5(pid=21361): stdout: | (launched: 2022-12-09_03:58:57.957288) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:58:59.836729 run osmo-stp_10.42.42.5(pid=21361): stderr: | 20221209035858151 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035858151 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035858151 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035858151 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035858152 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035858152 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035858152 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:58:59.994769 run patchelf(pid=21364): Terminating (SIGINT) 03:59:00.177937 run patchelf(pid=21364): Terminated: ok {rc=0} 03:59:00.310235 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21361): Process ended prematurely: osmo-stp_10.42.42.5(pid=21361) [trial-2354↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21361)] [trial-2354↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8] 03:59:00.320414 tst iperf3m4.py:8: Test FAILED (11.0 sec) 03:59:00.350203 run osmo-hlr_10.42.42.2(pid=21358): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21358)] 03:59:00.401290 run osmo-hlr_10.42.42.2(pid=21358): stdout: | (launched: 2022-12-09_03:58:56.937822) 03:59:00.453809 run osmo-hlr_10.42.42.2(pid=21358): stderr: | 20221209035857138 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209035857139 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209035857139 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209035857139 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209035857139 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209035857139 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209035857152 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-b200+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209035857160 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209035857161 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209035857161 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:59:00.506817 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21347): Terminating (SIGTERM) 03:59:00.549682 run iperf3-srv_10.42.42.10(pid=21348): Terminating (SIGTERM) 03:59:00.592576 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21349): Terminating (SIGTERM) 03:59:00.635720 run iperf3-srv_10.42.42.10(pid=21350): Terminating (SIGTERM) 03:59:00.678411 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21351): Terminating (SIGTERM) 03:59:00.721379 run iperf3-srv_10.42.42.10(pid=21352): Terminating (SIGTERM) 03:59:00.763891 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21353): Terminating (SIGTERM) 03:59:00.806606 run iperf3-srv_10.42.42.10(pid=21354): Terminating (SIGTERM) 03:59:00.849773 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21357): Terminating (SIGTERM) 03:59:00.894722 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21360): Terminating (SIGTERM) 03:59:00.938399 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21363): Terminating (SIGTERM) 03:59:00.982539 --- ParallelTerminationStrategy: PID 21347 died... 03:59:01.003348 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21347): Terminated: ok {rc=0} 03:59:01.051921 --- ParallelTerminationStrategy: PID 21348 died... 03:59:01.072396 run iperf3-srv_10.42.42.10(pid=21348): Terminated {rc=256} 03:59:01.121032 --- ParallelTerminationStrategy: PID 21349 died... 03:59:01.141456 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21349): Terminated: ok {rc=0} 03:59:01.189802 --- ParallelTerminationStrategy: PID 21350 died... 03:59:01.210365 run iperf3-srv_10.42.42.10(pid=21350): Terminated {rc=256} 03:59:01.258607 --- ParallelTerminationStrategy: PID 21351 died... 03:59:01.279092 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21351): Terminated: ok {rc=0} 03:59:01.327445 --- ParallelTerminationStrategy: PID 21352 died... 03:59:01.347591 run iperf3-srv_10.42.42.10(pid=21352): Terminated {rc=256} 03:59:01.395317 --- ParallelTerminationStrategy: PID 21353 died... 03:59:01.415681 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21353): Terminated: ok {rc=0} 03:59:01.464071 --- ParallelTerminationStrategy: PID 21354 died... 03:59:01.484287 run iperf3-srv_10.42.42.10(pid=21354): Terminated {rc=256} 03:59:01.532676 --- ParallelTerminationStrategy: PID 21357 died... 03:59:01.553232 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21357): Terminated: ok {rc=0} 03:59:01.601215 --- ParallelTerminationStrategy: PID 21360 died... 03:59:01.621644 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21360): Terminated: ok {rc=0} 03:59:01.670041 --- ParallelTerminationStrategy: PID 21363 died... 03:59:01.690433 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21363): Terminated: ok {rc=0} 03:59:01.790924 bus /gobi_4: Setting Powered False 03:59:02.892110 bus /gobi_4: Setting Powered False 03:59:04.011944 bus /gobi_1: Setting Powered False 03:59:05.111920 bus /gobi_1: Setting Powered False 03:59:06.227391 bus /gobi_0: Setting Powered False 03:59:07.327919 bus /gobi_0: Setting Powered False 03:59:08.443854 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:trx-b200+mod-bts0-egprs ping.py ---------------------------------------------- 03:59:09.548441 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:59:09.560435 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:59:09.611692 tst ping.py: using LAC 18914 03:59:09.731256 tst ping.py: using RAC 44 03:59:09.849710 tst ping.py: using CellId 18914 03:59:09.967170 tst ping.py: using BVCI 18915 03:59:10.077078 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:59:10.088007 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:59:10.098766 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:59:10.109518 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:59:10.120072 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:59:10.130722 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:59:10.141626 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:59:10.152211 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:59:10.271707 tst ping.py:19: start network... 03:59:10.486511 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:59:10.981590 run create_hlr_db(pid=21365): Launched 03:59:11.105236 bus /gobi_6: Setting Powered False 03:59:12.168939 run create_hlr_db(pid=21365): Terminated: ok {rc=0} 03:59:12.596342 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21367): Launched 03:59:12.895265 run osmo-hlr_10.42.42.2(pid=21368): Launched 03:59:13.009900 run osmo-stp_10.42.42.5: Starting osmo-stp 03:59:13.540638 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21370): Launched 03:59:13.838631 run osmo-stp_10.42.42.5(pid=21371): Launched 03:59:13.952542 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:59:14.465830 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21373): Launched 03:59:14.579409 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:59:14.830019 run patchelf(pid=21374): Launched 03:59:14.998362 run osmo-stp_10.42.42.5(pid=21371): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21371)] 03:59:15.124764 run osmo-stp_10.42.42.5(pid=21371): stdout: | (launched: 2022-12-09_03:59:13.783956) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:59:15.252585 run osmo-stp_10.42.42.5(pid=21371): stderr: | 20221209035913953 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035913953 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035913954 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035913954 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035913956 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035913956 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035913957 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:59:15.380234 run osmo-stp_10.42.42.5(pid=21371): stdout: | (launched: 2022-12-09_03:59:13.783956) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:59:15.502431 run osmo-stp_10.42.42.5(pid=21371): stderr: | 20221209035913953 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035913953 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035913954 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035913954 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035913956 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035913956 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035913957 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:59:15.646886 run patchelf(pid=21374): Terminating (SIGINT) 03:59:15.815244 run patchelf(pid=21374): Terminated: ok {rc=0} 03:59:15.958983 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=21371): Process ended prematurely: osmo-stp_10.42.42.5(pid=21371) [trial-2354↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21371)] [trial-2354↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22] 03:59:15.969777 tst ping.py:22: Test FAILED (6.4 sec) 03:59:16.002356 run osmo-hlr_10.42.42.2(pid=21368): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-b200+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21368)] 03:59:16.058314 run osmo-hlr_10.42.42.2(pid=21368): stdout: | (launched: 2022-12-09_03:59:12.840514) 03:59:16.113712 run osmo-hlr_10.42.42.2(pid=21368): stderr: | 20221209035913015 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209035913015 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209035913015 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209035913015 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209035913015 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209035913015 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209035913028 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-b200+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209035913037 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209035913038 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209035913038 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:59:16.170418 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21367): Terminating (SIGTERM) 03:59:16.215852 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21370): Terminating (SIGTERM) 03:59:16.263794 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21373): Terminating (SIGTERM) 03:59:16.311110 --- ParallelTerminationStrategy: PID 21367 died... 03:59:16.335002 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21367): Terminated: ok {rc=0} 03:59:16.389675 --- ParallelTerminationStrategy: PID 21370 died... 03:59:16.413245 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21370): Terminated: ok {rc=0} 03:59:16.468257 --- ParallelTerminationStrategy: PID 21373 died... 03:59:16.491783 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21373): Terminated: ok {rc=0} 03:59:16.598937 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:trx-b200+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 03:59:17.694400 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:59:17.705916 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:59:17.761577 tst ping_idle_ping.py: using LAC 18915 03:59:17.887739 tst ping_idle_ping.py: using RAC 45 03:59:18.004404 tst ping_idle_ping.py: using CellId 18915 03:59:18.119817 tst ping_idle_ping.py: using BVCI 18916 03:59:18.238115 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:59:18.249717 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:59:18.260859 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:59:18.273165 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:59:18.285268 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:59:18.297417 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:59:18.309653 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:59:18.321746 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:59:18.439472 tst ping_idle_ping.py:24: start network... 03:59:18.639574 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:59:19.105291 run create_hlr_db(pid=21375): Launched 03:59:19.228361 bus /gobi_6: Setting Powered False 03:59:20.292189 run create_hlr_db(pid=21375): Terminated: ok {rc=0} 03:59:20.722631 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21377): Launched 03:59:21.023051 run osmo-hlr_10.42.42.2(pid=21378): Launched 03:59:21.148420 run osmo-stp_10.42.42.5: Starting osmo-stp 03:59:21.704104 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21380): Launched 03:59:22.026197 run osmo-stp_10.42.42.5(pid=21381): Launched 03:59:22.149514 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:59:22.703073 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21383): Launched 03:59:22.827233 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:59:23.099829 run patchelf(pid=21384): Launched 03:59:23.278490 run osmo-stp_10.42.42.5(pid=21381): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21381)] 03:59:23.415018 run osmo-stp_10.42.42.5(pid=21381): stdout: | (launched: 2022-12-09_03:59:21.967421) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:59:23.552867 run osmo-stp_10.42.42.5(pid=21381): stderr: | 20221209035922160 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035922160 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035922160 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035922160 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035922161 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035922161 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035922161 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:59:23.691075 run osmo-stp_10.42.42.5(pid=21381): stdout: | (launched: 2022-12-09_03:59:21.967421) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:59:23.823326 run osmo-stp_10.42.42.5(pid=21381): stderr: | 20221209035922160 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035922160 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035922160 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035922160 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035922161 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035922161 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035922161 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:59:23.979728 run patchelf(pid=21384): Terminating (SIGINT) 03:59:24.161658 run patchelf(pid=21384): Terminated: ok {rc=0} 03:59:24.292497 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=21381): Process ended prematurely: osmo-stp_10.42.42.5(pid=21381) [trial-2354↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21381)] [trial-2354↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27] 03:59:24.302235 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 03:59:24.331282 run osmo-hlr_10.42.42.2(pid=21378): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21378)] 03:59:24.383172 run osmo-hlr_10.42.42.2(pid=21378): stdout: | (launched: 2022-12-09_03:59:20.966853) 03:59:24.436346 run osmo-hlr_10.42.42.2(pid=21378): stderr: | 20221209035921159 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209035921159 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209035921159 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209035921159 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209035921159 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209035921159 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209035921175 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-b200+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209035921184 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209035921184 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209035921184 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:59:24.489979 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21377): Terminating (SIGTERM) 03:59:24.532788 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21380): Terminating (SIGTERM) 03:59:24.575803 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21383): Terminating (SIGTERM) 03:59:24.618834 --- ParallelTerminationStrategy: PID 21377 died... 03:59:24.639112 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21377): Terminated: ok {rc=0} 03:59:24.686584 --- ParallelTerminationStrategy: PID 21380 died... 03:59:24.706490 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21380): Terminated: ok {rc=0} 03:59:24.753535 --- ParallelTerminationStrategy: PID 21383 died... 03:59:24.773576 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21383): Terminated: ok {rc=0} 03:59:24.861992 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2354 gprs:trx-b200+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 gprs:trx-b200+mod-bts0-dynts-ipa --------------------------------------------------------------------- 03:59:26.171925 tst gprs:trx-b200+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:59:26.178355 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 03:59:26.211713 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 03:59:26.249716 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 03:59:26.335962 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 03:59:26.368572 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 03:59:26.406360 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 03:59:27.000311 tst gprs:trx-b200+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2354 gprs:trx-b200+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 03:59:27.048854 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:59:27.059669 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 03:59:27.128913 tst cs_paging_gprs_active.py: using LAC 18916 03:59:27.249208 tst cs_paging_gprs_active.py: using RAC 46 03:59:27.368143 tst cs_paging_gprs_active.py: using CellId 18916 03:59:27.489595 tst cs_paging_gprs_active.py: using BVCI 18917 03:59:27.599561 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:59:27.610444 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:59:27.621096 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:59:27.631700 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:59:27.642291 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:59:27.653073 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:59:27.663713 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:59:27.674238 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:59:27.684885 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:59:27.804708 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:59:27.923158 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 03:59:28.127309 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:59:28.432757 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21388): Launched 03:59:28.698626 run iperf3-srv_10.42.42.10(pid=21389): Launched 03:59:28.812736 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 03:59:29.016069 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:59:29.321103 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21390): Launched 03:59:29.585689 run iperf3-srv_10.42.42.10(pid=21391): Launched 03:59:29.699953 tst cs_paging_gprs_active.py:38: start network... 03:59:29.903140 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:59:30.375132 run create_hlr_db(pid=21392): Launched 03:59:30.499766 bus /gobi_6: Setting Powered False 03:59:31.558445 run create_hlr_db(pid=21392): Terminated: ok {rc=0} 03:59:31.993351 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21394): Launched 03:59:32.332861 run osmo-hlr_10.42.42.2(pid=21395): Launched 03:59:32.449678 run osmo-stp_10.42.42.5: Starting osmo-stp 03:59:32.972628 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21397): Launched 03:59:33.276605 run osmo-stp_10.42.42.5(pid=21398): Launched 03:59:33.392554 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:59:33.916312 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21400): Launched 03:59:34.032482 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:59:34.289008 run patchelf(pid=21401): Launched 03:59:34.458334 run osmo-stp_10.42.42.5(pid=21398): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21398)] 03:59:34.586781 run osmo-stp_10.42.42.5(pid=21398): stdout: | (launched: 2022-12-09_03:59:33.221310) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:59:34.717496 run osmo-stp_10.42.42.5(pid=21398): stderr: | 20221209035933394 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035933394 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035933394 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035933394 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035933395 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035933395 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035933395 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:59:34.847625 run osmo-stp_10.42.42.5(pid=21398): stdout: | (launched: 2022-12-09_03:59:33.221310) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:59:34.972226 run osmo-stp_10.42.42.5(pid=21398): stderr: | 20221209035933394 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035933394 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035933394 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035933394 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035933395 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035933395 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035933395 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:59:35.120124 run patchelf(pid=21401): Terminating (SIGINT) 03:59:35.292067 run patchelf(pid=21401): Terminated: ok {rc=0} 03:59:35.415740 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=21398): Process ended prematurely: osmo-stp_10.42.42.5(pid=21398) [trial-2354↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21398)] [trial-2354↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 03:59:35.425397 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 03:59:35.452775 run osmo-hlr_10.42.42.2(pid=21395): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21395)] 03:59:35.500825 run osmo-hlr_10.42.42.2(pid=21395): stdout: | (launched: 2022-12-09_03:59:32.277123) 03:59:35.550869 run osmo-hlr_10.42.42.2(pid=21395): stderr: | 20221209035932454 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209035932454 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209035932455 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209035932455 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209035932455 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209035932455 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209035932467 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-b200+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209035932475 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209035932476 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209035932476 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:59:35.601289 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21388): Terminating (SIGTERM) 03:59:35.641695 run iperf3-srv_10.42.42.10(pid=21389): Terminating (SIGTERM) 03:59:35.681678 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21390): Terminating (SIGTERM) 03:59:35.721777 run iperf3-srv_10.42.42.10(pid=21391): Terminating (SIGTERM) 03:59:35.761773 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21394): Terminating (SIGTERM) 03:59:35.801874 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21397): Terminating (SIGTERM) 03:59:35.841923 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21400): Terminating (SIGTERM) 03:59:35.882073 --- ParallelTerminationStrategy: PID 21388 died... 03:59:35.901211 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21388): Terminated: ok {rc=0} 03:59:35.945600 --- ParallelTerminationStrategy: PID 21389 died... 03:59:35.964381 run iperf3-srv_10.42.42.10(pid=21389): Terminated {rc=256} 03:59:36.008629 --- ParallelTerminationStrategy: PID 21390 died... 03:59:36.027679 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21390): Terminated: ok {rc=0} 03:59:36.071885 --- ParallelTerminationStrategy: PID 21391 died... 03:59:36.090596 run iperf3-srv_10.42.42.10(pid=21391): Terminated {rc=256} 03:59:36.134817 --- ParallelTerminationStrategy: PID 21394 died... 03:59:36.153610 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21394): Terminated: ok {rc=0} 03:59:36.197562 --- ParallelTerminationStrategy: PID 21397 died... 03:59:36.216155 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21397): Terminated: ok {rc=0} 03:59:36.260913 --- ParallelTerminationStrategy: PID 21400 died... 03:59:36.279907 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21400): Terminated: ok {rc=0} 03:59:36.367271 bus /gobi_0: Setting Powered False 03:59:37.468780 bus /gobi_0: Setting Powered False 03:59:38.586826 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:trx-b200+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 03:59:39.740211 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:59:39.752414 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 03:59:39.826038 tst iperf3.py: using LAC 18917 03:59:39.952888 tst iperf3.py: using RAC 47 03:59:40.079956 tst iperf3.py: using CellId 18917 03:59:40.208531 tst iperf3.py: using BVCI 18918 03:59:40.319758 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:59:40.330647 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:59:40.341428 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:59:40.352133 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:59:40.362717 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:59:40.373407 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:59:40.384072 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:59:40.394658 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:59:40.405527 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:59:40.523959 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 03:59:40.743836 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:59:41.070002 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21402): Launched 03:59:41.354451 run iperf3-srv_10.42.42.10(pid=21403): Launched 03:59:41.478362 tst iperf3.py:8: start network... 03:59:41.697714 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:59:42.202859 run create_hlr_db(pid=21404): Launched 03:59:42.330023 bus /gobi_6: Setting Powered False 03:59:43.394116 run create_hlr_db(pid=21404): Terminated: ok {rc=0} 03:59:43.845937 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21406): Launched 03:59:44.173255 run osmo-hlr_10.42.42.2(pid=21407): Launched 03:59:44.297920 run osmo-stp_10.42.42.5: Starting osmo-stp 03:59:44.860932 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21409): Launched 03:59:45.186949 run osmo-stp_10.42.42.5(pid=21410): Launched 03:59:45.311487 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:59:45.897909 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21412): Launched 03:59:46.038509 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:59:46.320115 run patchelf(pid=21413): Launched 03:59:46.517670 run osmo-stp_10.42.42.5(pid=21410): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21410)] 03:59:46.659204 run osmo-stp_10.42.42.5(pid=21410): stdout: | (launched: 2022-12-09_03:59:45.126967) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:59:46.802653 run osmo-stp_10.42.42.5(pid=21410): stderr: | 20221209035945322 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035945322 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035945323 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035945323 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035945324 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035945324 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035945324 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:59:46.946677 run osmo-stp_10.42.42.5(pid=21410): stdout: | (launched: 2022-12-09_03:59:45.126967) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:59:47.084705 run osmo-stp_10.42.42.5(pid=21410): stderr: | 20221209035945322 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035945322 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035945323 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035945323 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035945324 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035945324 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035945324 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:59:47.245877 run patchelf(pid=21413): Terminating (SIGINT) 03:59:47.429689 run patchelf(pid=21413): Terminated: ok {rc=0} 03:59:47.562090 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21410): Process ended prematurely: osmo-stp_10.42.42.5(pid=21410) [trial-2354↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21410)] [trial-2354↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8] 03:59:47.572604 tst iperf3.py:8: Test FAILED (7.9 sec) 03:59:47.602685 run osmo-hlr_10.42.42.2(pid=21407): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21407)] 03:59:47.654092 run osmo-hlr_10.42.42.2(pid=21407): stdout: | (launched: 2022-12-09_03:59:44.113742) 03:59:47.707551 run osmo-hlr_10.42.42.2(pid=21407): stderr: | 20221209035944314 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209035944314 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209035944314 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209035944314 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209035944314 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209035944314 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209035944326 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209035944334 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209035944334 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209035944334 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:59:47.761401 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21402): Terminating (SIGTERM) 03:59:47.803925 run iperf3-srv_10.42.42.10(pid=21403): Terminating (SIGTERM) 03:59:47.846863 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21406): Terminating (SIGTERM) 03:59:47.889851 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21409): Terminating (SIGTERM) 03:59:47.932932 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21412): Terminating (SIGTERM) 03:59:47.976265 --- ParallelTerminationStrategy: PID 21402 died... 03:59:47.996681 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21402): Terminated: ok {rc=0} 03:59:48.044745 --- ParallelTerminationStrategy: PID 21403 died... 03:59:48.065069 run iperf3-srv_10.42.42.10(pid=21403): Terminated {rc=256} 03:59:48.112321 --- ParallelTerminationStrategy: PID 21406 died... 03:59:48.132341 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21406): Terminated: ok {rc=0} 03:59:48.179776 --- ParallelTerminationStrategy: PID 21409 died... 03:59:48.199837 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21409): Terminated: ok {rc=0} 03:59:48.247247 --- ParallelTerminationStrategy: PID 21412 died... 03:59:48.267265 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21412): Terminated: ok {rc=0} 03:59:48.357577 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:trx-b200+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 03:59:49.508014 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:59:49.520412 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 03:59:49.593915 tst iperf3m4.py: using LAC 18918 03:59:49.713574 tst iperf3m4.py: using RAC 48 03:59:49.842709 tst iperf3m4.py: using CellId 18918 03:59:49.975093 tst iperf3m4.py: using BVCI 18919 03:59:50.095622 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:59:50.107048 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:59:50.118586 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:59:50.130264 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:59:50.141656 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:59:50.153080 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:59:50.164589 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:59:50.176000 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:59:50.187525 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:59:50.308041 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:59:50.429255 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:59:50.544762 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:59:50.662114 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 03:59:50.865641 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:59:51.171280 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21414): Launched 03:59:51.437772 run iperf3-srv_10.42.42.10(pid=21415): Launched 03:59:51.551855 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 03:59:51.754110 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:59:52.058372 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21416): Launched 03:59:52.323387 run iperf3-srv_10.42.42.10(pid=21417): Launched 03:59:52.439245 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 03:59:52.640756 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:59:52.944543 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21418): Launched 03:59:53.208579 run iperf3-srv_10.42.42.10(pid=21419): Launched 03:59:53.323573 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 03:59:53.527182 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:59:53.828653 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21420): Launched 03:59:54.091195 run iperf3-srv_10.42.42.10(pid=21421): Launched 03:59:54.204680 tst iperf3m4.py:8: start network... 03:59:54.404932 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:59:54.871318 run create_hlr_db(pid=21422): Launched 03:59:54.995427 bus /gobi_6: Setting Powered False 03:59:56.055445 run create_hlr_db(pid=21422): Terminated: ok {rc=0} 03:59:56.475302 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21424): Launched 03:59:56.777163 run osmo-hlr_10.42.42.2(pid=21425): Launched 03:59:56.892271 run osmo-stp_10.42.42.5: Starting osmo-stp 03:59:57.416263 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21427): Launched 03:59:57.719150 run osmo-stp_10.42.42.5(pid=21428): Launched 03:59:57.834137 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:59:58.353507 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21430): Launched 03:59:58.468918 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:59:58.723267 run patchelf(pid=21431): Launched 03:59:58.891237 run osmo-stp_10.42.42.5(pid=21428): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21428)] 03:59:59.018490 run osmo-stp_10.42.42.5(pid=21428): stdout: | (launched: 2022-12-09_03:59:57.663409) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:59:59.147662 run osmo-stp_10.42.42.5(pid=21428): stderr: | 20221209035957829 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035957829 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035957829 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035957830 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035957830 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035957830 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035957830 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:59:59.276796 run osmo-stp_10.42.42.5(pid=21428): stdout: | (launched: 2022-12-09_03:59:57.663409) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:59:59.401520 run osmo-stp_10.42.42.5(pid=21428): stderr: | 20221209035957829 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209035957829 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209035957829 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209035957830 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209035957830 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209035957830 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209035957830 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:59:59.547646 run patchelf(pid=21431): Terminating (SIGINT) 03:59:59.718453 run patchelf(pid=21431): Terminated: ok {rc=0} 03:59:59.841761 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21428): Process ended prematurely: osmo-stp_10.42.42.5(pid=21428) [trial-2354↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21428)] [trial-2354↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8] 03:59:59.851170 tst iperf3m4.py:8: Test FAILED (10.4 sec) 03:59:59.879024 run osmo-hlr_10.42.42.2(pid=21425): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21425)] 03:59:59.927169 run osmo-hlr_10.42.42.2(pid=21425): stdout: | (launched: 2022-12-09_03:59:56.721520) 03:59:59.977296 run osmo-hlr_10.42.42.2(pid=21425): stderr: | 20221209035956895 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209035956895 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209035956895 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209035956896 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209035956896 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209035956896 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209035956908 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209035956917 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209035956917 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209035956917 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:00:00.027024 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21414): Terminating (SIGTERM) 04:00:00.066855 run iperf3-srv_10.42.42.10(pid=21415): Terminating (SIGTERM) 04:00:00.106585 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21416): Terminating (SIGTERM) 04:00:00.146338 run iperf3-srv_10.42.42.10(pid=21417): Terminating (SIGTERM) 04:00:00.185857 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21418): Terminating (SIGTERM) 04:00:00.225611 run iperf3-srv_10.42.42.10(pid=21419): Terminating (SIGTERM) 04:00:00.265096 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21420): Terminating (SIGTERM) 04:00:00.304695 run iperf3-srv_10.42.42.10(pid=21421): Terminating (SIGTERM) 04:00:00.344677 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21424): Terminating (SIGTERM) 04:00:00.384265 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21427): Terminating (SIGTERM) 04:00:00.423752 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21430): Terminating (SIGTERM) 04:00:00.463548 --- ParallelTerminationStrategy: PID 21414 died... 04:00:00.482770 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21414): Terminated: ok {rc=0} 04:00:00.527100 --- ParallelTerminationStrategy: PID 21415 died... 04:00:00.545755 run iperf3-srv_10.42.42.10(pid=21415): Terminated {rc=256} 04:00:00.589847 --- ParallelTerminationStrategy: PID 21416 died... 04:00:00.608551 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21416): Terminated: ok {rc=0} 04:00:00.652604 --- ParallelTerminationStrategy: PID 21417 died... 04:00:00.671354 run iperf3-srv_10.42.42.10(pid=21417): Terminated {rc=256} 04:00:00.715708 --- ParallelTerminationStrategy: PID 21418 died... 04:00:00.734454 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21418): Terminated: ok {rc=0} 04:00:00.778499 --- ParallelTerminationStrategy: PID 21419 died... 04:00:00.797133 run iperf3-srv_10.42.42.10(pid=21419): Terminated {rc=256} 04:00:00.861733 --- ParallelTerminationStrategy: PID 21420 died... 04:00:00.882976 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21420): Terminated: ok {rc=0} 04:00:00.943233 --- ParallelTerminationStrategy: PID 21421 died... 04:00:00.962628 run iperf3-srv_10.42.42.10(pid=21421): Terminated {rc=256} 04:00:01.007637 --- ParallelTerminationStrategy: PID 21424 died... 04:00:01.026910 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21424): Terminated: ok {rc=0} 04:00:01.071901 --- ParallelTerminationStrategy: PID 21427 died... 04:00:01.091396 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21427): Terminated: ok {rc=0} 04:00:01.136406 --- ParallelTerminationStrategy: PID 21430 died... 04:00:01.157128 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21430): Terminated: ok {rc=0} 04:00:01.252575 bus /gobi_4: Setting Powered False 04:00:02.355517 bus /gobi_4: Setting Powered False 04:00:03.474771 bus /gobi_1: Setting Powered False 04:00:04.573646 bus /gobi_1: Setting Powered False 04:00:05.691896 bus /gobi_0: Setting Powered False 04:00:06.791104 bus /gobi_0: Setting Powered False 04:00:07.910716 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:trx-b200+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 04:00:09.014949 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:00:09.027401 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:00:09.100275 tst ping.py: using LAC 18919 04:00:09.227174 tst ping.py: using RAC 49 04:00:09.345417 tst ping.py: using CellId 18919 04:00:09.462776 tst ping.py: using BVCI 18920 04:00:09.570099 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:00:09.581285 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:00:09.592009 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:00:09.603009 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:00:09.613999 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:00:09.624843 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:00:09.635852 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:00:09.646635 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:00:09.759309 tst ping.py:19: start network... 04:00:09.956774 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:00:10.415079 run create_hlr_db(pid=21436): Launched 04:00:10.536296 bus /gobi_6: Setting Powered False 04:00:11.595902 run create_hlr_db(pid=21436): Terminated: ok {rc=0} 04:00:12.031045 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21438): Launched 04:00:12.332217 run osmo-hlr_10.42.42.2(pid=21439): Launched 04:00:12.445427 run osmo-stp_10.42.42.5: Starting osmo-stp 04:00:12.974982 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21441): Launched 04:00:13.270355 run osmo-stp_10.42.42.5(pid=21442): Launched 04:00:13.382699 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:00:13.891703 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21444): Launched 04:00:14.005255 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:00:14.255027 run patchelf(pid=21445): Launched 04:00:14.419968 run osmo-stp_10.42.42.5(pid=21442): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21442)] 04:00:14.545241 run osmo-stp_10.42.42.5(pid=21442): stdout: | (launched: 2022-12-09_04:00:13.215934) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:00:14.672248 run osmo-stp_10.42.42.5(pid=21442): stderr: | 20221209040013384 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040013384 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040013384 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040013385 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040013385 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040013385 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040013385 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:00:14.799522 run osmo-stp_10.42.42.5(pid=21442): stdout: | (launched: 2022-12-09_04:00:13.215934) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:00:14.920805 run osmo-stp_10.42.42.5(pid=21442): stderr: | 20221209040013384 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040013384 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040013384 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040013385 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040013385 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040013385 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040013385 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:00:15.064700 run patchelf(pid=21445): Terminating (SIGINT) 04:00:15.232507 run patchelf(pid=21445): Terminated: ok {rc=0} 04:00:15.352494 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=21442): Process ended prematurely: osmo-stp_10.42.42.5(pid=21442) [trial-2354↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21442)] [trial-2354↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22] 04:00:15.361415 tst ping.py:22: Test FAILED (6.3 sec) 04:00:15.388533 run osmo-hlr_10.42.42.2(pid=21439): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21439)] 04:00:15.437148 run osmo-hlr_10.42.42.2(pid=21439): stdout: | (launched: 2022-12-09_04:00:12.277793) 04:00:15.487661 run osmo-hlr_10.42.42.2(pid=21439): stderr: | 20221209040012455 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209040012455 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209040012455 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209040012455 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209040012455 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209040012455 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209040012468 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-b200+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209040012477 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209040012477 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209040012477 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:00:15.538202 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21438): Terminating (SIGTERM) 04:00:15.578275 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21441): Terminating (SIGTERM) 04:00:15.618216 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21444): Terminating (SIGTERM) 04:00:15.658553 --- ParallelTerminationStrategy: PID 21438 died... 04:00:15.677894 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21438): Terminated: ok {rc=0} 04:00:15.722500 --- ParallelTerminationStrategy: PID 21441 died... 04:00:15.741589 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21441): Terminated: ok {rc=0} 04:00:15.785800 --- ParallelTerminationStrategy: PID 21444 died... 04:00:15.804582 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21444): Terminated: ok {rc=0} 04:00:15.902618 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:trx-b200+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 04:00:16.998868 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:00:17.015033 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:00:17.109787 tst ping_idle_ping.py: using LAC 18920 04:00:17.258295 tst ping_idle_ping.py: using RAC 50 04:00:17.380078 tst ping_idle_ping.py: using CellId 18920 04:00:17.497308 tst ping_idle_ping.py: using BVCI 18921 04:00:17.605254 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:00:17.616255 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:00:17.627104 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:00:17.637880 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:00:17.648649 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:00:17.659515 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:00:17.670270 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:00:17.680941 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:00:17.795068 tst ping_idle_ping.py:24: start network... 04:00:17.994226 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:00:18.461089 run create_hlr_db(pid=21446): Launched 04:00:18.582448 bus /gobi_6: Setting Powered False 04:00:19.641751 run create_hlr_db(pid=21446): Terminated: ok {rc=0} 04:00:20.074951 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21448): Launched 04:00:20.376786 run osmo-hlr_10.42.42.2(pid=21449): Launched 04:00:20.490989 run osmo-stp_10.42.42.5: Starting osmo-stp 04:00:21.001387 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21451): Launched 04:00:21.297750 run osmo-stp_10.42.42.5(pid=21452): Launched 04:00:21.410780 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:00:21.921240 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21454): Launched 04:00:22.034653 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:00:22.284079 run patchelf(pid=21455): Launched 04:00:22.449344 run osmo-stp_10.42.42.5(pid=21452): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21452)] 04:00:22.574751 run osmo-stp_10.42.42.5(pid=21452): stdout: | (launched: 2022-12-09_04:00:21.243380) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:00:22.701853 run osmo-stp_10.42.42.5(pid=21452): stderr: | 20221209040021411 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040021411 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040021412 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040021412 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040021412 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040021413 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040021413 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:00:22.828909 run osmo-stp_10.42.42.5(pid=21452): stdout: | (launched: 2022-12-09_04:00:21.243380) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:00:22.951182 run osmo-stp_10.42.42.5(pid=21452): stderr: | 20221209040021411 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040021411 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040021412 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040021412 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040021412 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040021413 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040021413 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:00:23.095567 run patchelf(pid=21455): Terminating (SIGINT) 04:00:23.263038 run patchelf(pid=21455): Terminated: ok {rc=0} 04:00:23.383742 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=21452): Process ended prematurely: osmo-stp_10.42.42.5(pid=21452) [trial-2354↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21452)] [trial-2354↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 04:00:23.392860 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 04:00:23.419585 run osmo-hlr_10.42.42.2(pid=21449): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21449)] 04:00:23.467674 run osmo-hlr_10.42.42.2(pid=21449): stdout: | (launched: 2022-12-09_04:00:20.322648) 04:00:23.517616 run osmo-hlr_10.42.42.2(pid=21449): stderr: | 20221209040020497 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209040020497 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209040020497 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209040020497 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209040020497 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209040020497 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209040020509 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-b200+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209040020518 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209040020518 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209040020518 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:00:23.568186 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21448): Terminating (SIGTERM) 04:00:23.608020 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21451): Terminating (SIGTERM) 04:00:23.647818 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21454): Terminating (SIGTERM) 04:00:23.687541 --- ParallelTerminationStrategy: PID 21448 died... 04:00:23.706522 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21448): Terminated: ok {rc=0} 04:00:23.750806 --- ParallelTerminationStrategy: PID 21451 died... 04:00:23.769670 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21451): Terminated: ok {rc=0} 04:00:23.813342 --- ParallelTerminationStrategy: PID 21454 died... 04:00:23.831966 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21454): Terminated: ok {rc=0} 04:00:23.918134 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2354 gprs:trx-b200+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 gprs:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 04:00:25.224478 tst gprs:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:00:25.230514 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 04:00:25.263037 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 04:00:25.300870 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 04:00:25.385464 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 04:00:25.417736 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 04:00:25.455405 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 04:00:26.055496 tst gprs:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2354 gprs:trx-b200+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 04:00:26.109771 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:00:26.121221 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:00:26.192271 tst cs_paging_gprs_active.py: using LAC 18921 04:00:26.320793 tst cs_paging_gprs_active.py: using RAC 51 04:00:26.445747 tst cs_paging_gprs_active.py: using CellId 18921 04:00:26.573231 tst cs_paging_gprs_active.py: using BVCI 18922 04:00:26.692072 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:00:26.703356 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:00:26.714650 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:00:26.726045 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:00:26.737755 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:00:26.749269 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:00:26.760711 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:00:26.772298 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:00:26.783906 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:00:26.903052 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:00:27.023305 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 04:00:27.241764 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:00:27.566238 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21459): Launched 04:00:27.848026 run iperf3-srv_10.42.42.10(pid=21460): Launched 04:00:27.969951 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 04:00:28.188516 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:00:28.513285 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21461): Launched 04:00:28.795321 run iperf3-srv_10.42.42.10(pid=21462): Launched 04:00:28.917566 tst cs_paging_gprs_active.py:38: start network... 04:00:29.135646 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:00:29.637486 run create_hlr_db(pid=21463): Launched 04:00:29.761456 bus /gobi_6: Setting Powered False 04:00:30.825512 run create_hlr_db(pid=21463): Terminated: ok {rc=0} 04:00:31.281609 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21465): Launched 04:00:31.599851 run osmo-hlr_10.42.42.2(pid=21466): Launched 04:00:31.855914 run osmo-stp_10.42.42.5: Starting osmo-stp 04:00:32.581272 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21468): Launched 04:00:32.904763 run osmo-stp_10.42.42.5(pid=21469): Launched 04:00:33.028782 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:00:33.587298 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21471): Launched 04:00:33.711629 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:00:33.985540 run patchelf(pid=21472): Launched 04:00:34.167201 run osmo-stp_10.42.42.5(pid=21469): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21469)] 04:00:34.304531 run osmo-stp_10.42.42.5(pid=21469): stdout: | (launched: 2022-12-09_04:00:32.845955) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:00:34.443746 run osmo-stp_10.42.42.5(pid=21469): stderr: | 20221209040033037 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040033037 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040033037 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040033038 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040033038 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040033038 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040033038 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:00:34.582694 run osmo-stp_10.42.42.5(pid=21469): stdout: | (launched: 2022-12-09_04:00:32.845955) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:00:34.716054 run osmo-stp_10.42.42.5(pid=21469): stderr: | 20221209040033037 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040033037 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040033037 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040033038 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040033038 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040033038 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040033038 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:00:34.874195 run patchelf(pid=21472): Terminating (SIGINT) 04:00:35.057821 run patchelf(pid=21472): Terminated: ok {rc=0} 04:00:35.190253 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=21469): Process ended prematurely: osmo-stp_10.42.42.5(pid=21469) [trial-2354↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21469)] [trial-2354↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 04:00:35.201143 tst cs_paging_gprs_active.py:38: Test FAILED (9.1 sec) 04:00:35.231423 run osmo-hlr_10.42.42.2(pid=21466): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21466)] 04:00:35.282641 run osmo-hlr_10.42.42.2(pid=21466): stdout: | (launched: 2022-12-09_04:00:31.536052) 04:00:35.335757 run osmo-hlr_10.42.42.2(pid=21466): stderr: | 20221209040031900 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209040031900 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209040031900 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209040031900 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209040031900 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209040031900 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209040031927 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-b200+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209040031940 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209040031940 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209040031940 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:00:35.389104 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21459): Terminating (SIGTERM) 04:00:35.431691 run iperf3-srv_10.42.42.10(pid=21460): Terminating (SIGTERM) 04:00:35.474374 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21461): Terminating (SIGTERM) 04:00:35.516900 run iperf3-srv_10.42.42.10(pid=21462): Terminating (SIGTERM) 04:00:35.559275 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21465): Terminating (SIGTERM) 04:00:35.601830 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21468): Terminating (SIGTERM) 04:00:35.644376 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21471): Terminating (SIGTERM) 04:00:35.687235 --- ParallelTerminationStrategy: PID 21459 died... 04:00:35.707446 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21459): Terminated: ok {rc=0} 04:00:35.754821 --- ParallelTerminationStrategy: PID 21460 died... 04:00:35.774380 run iperf3-srv_10.42.42.10(pid=21460): Terminated {rc=256} 04:00:35.821174 --- ParallelTerminationStrategy: PID 21461 died... 04:00:35.840918 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21461): Terminated: ok {rc=0} 04:00:35.887789 --- ParallelTerminationStrategy: PID 21462 died... 04:00:35.907436 run iperf3-srv_10.42.42.10(pid=21462): Terminated {rc=256} 04:00:35.954326 --- ParallelTerminationStrategy: PID 21465 died... 04:00:35.974105 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21465): Terminated: ok {rc=0} 04:00:36.021079 --- ParallelTerminationStrategy: PID 21468 died... 04:00:36.041127 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21468): Terminated: ok {rc=0} 04:00:36.088039 --- ParallelTerminationStrategy: PID 21471 died... 04:00:36.107893 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21471): Terminated: ok {rc=0} 04:00:36.196779 bus /gobi_0: Setting Powered False 04:00:37.295310 bus /gobi_0: Setting Powered False 04:00:38.411378 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:trx-b200+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 04:00:39.559701 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:00:39.571322 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:00:39.644381 tst iperf3.py: using LAC 18922 04:00:39.762684 tst iperf3.py: using RAC 52 04:00:39.881537 tst iperf3.py: using CellId 18922 04:00:40.000326 tst iperf3.py: using BVCI 18923 04:00:40.111030 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:00:40.121825 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:00:40.132332 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:00:40.142962 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:00:40.153443 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:00:40.164022 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:00:40.174710 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:00:40.185339 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:00:40.196007 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:00:40.309925 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 04:00:40.511938 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:00:40.814824 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21473): Launched 04:00:41.077807 run iperf3-srv_10.42.42.10(pid=21474): Launched 04:00:41.191303 tst iperf3.py:8: start network... 04:00:41.391920 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:00:41.859303 run create_hlr_db(pid=21475): Launched 04:00:41.985950 bus /gobi_6: Setting Powered False 04:00:43.050117 run create_hlr_db(pid=21475): Terminated: ok {rc=0} 04:00:43.498902 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21477): Launched 04:00:43.824380 run osmo-hlr_10.42.42.2(pid=21478): Launched 04:00:43.948406 run osmo-stp_10.42.42.5: Starting osmo-stp 04:00:44.509749 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21480): Launched 04:00:44.834025 run osmo-stp_10.42.42.5(pid=21481): Launched 04:00:44.957805 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:00:45.515216 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21483): Launched 04:00:45.639478 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:00:45.951476 run patchelf(pid=21484): Launched 04:00:46.131259 run osmo-stp_10.42.42.5(pid=21481): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21481)] 04:00:46.264524 run osmo-stp_10.42.42.5(pid=21481): stdout: | (launched: 2022-12-09_04:00:44.774780) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:00:46.398561 run osmo-stp_10.42.42.5(pid=21481): stderr: | 20221209040044965 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040044966 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040044966 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040044966 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040044967 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040044967 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040044967 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:00:46.533795 run osmo-stp_10.42.42.5(pid=21481): stdout: | (launched: 2022-12-09_04:00:44.774780) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:00:46.663807 run osmo-stp_10.42.42.5(pid=21481): stderr: | 20221209040044965 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040044966 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040044966 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040044966 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040044967 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040044967 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040044967 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:00:46.817154 run patchelf(pid=21484): Terminating (SIGINT) 04:00:46.994204 run patchelf(pid=21484): Terminated: ok {rc=0} 04:00:47.121513 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21481): Process ended prematurely: osmo-stp_10.42.42.5(pid=21481) [trial-2354↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21481)] [trial-2354↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8] 04:00:47.131948 tst iperf3.py:8: Test FAILED (7.6 sec) 04:00:47.160733 run osmo-hlr_10.42.42.2(pid=21478): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21478)] 04:00:47.209635 run osmo-hlr_10.42.42.2(pid=21478): stdout: | (launched: 2022-12-09_04:00:43.764448) 04:00:47.259974 run osmo-hlr_10.42.42.2(pid=21478): stderr: | 20221209040043962 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209040043962 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209040043962 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209040043962 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209040043962 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209040043962 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209040043978 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209040043987 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209040043988 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209040043988 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:00:47.310888 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21473): Terminating (SIGTERM) 04:00:47.351469 run iperf3-srv_10.42.42.10(pid=21474): Terminating (SIGTERM) 04:00:47.391993 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21477): Terminating (SIGTERM) 04:00:47.432383 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21480): Terminating (SIGTERM) 04:00:47.473158 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21483): Terminating (SIGTERM) 04:00:47.513957 --- ParallelTerminationStrategy: PID 21473 died... 04:00:47.533526 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21473): Terminated: ok {rc=0} 04:00:47.578677 --- ParallelTerminationStrategy: PID 21474 died... 04:00:47.597933 run iperf3-srv_10.42.42.10(pid=21474): Terminated {rc=256} 04:00:47.642276 --- ParallelTerminationStrategy: PID 21477 died... 04:00:47.661248 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21477): Terminated: ok {rc=0} 04:00:47.705859 --- ParallelTerminationStrategy: PID 21480 died... 04:00:47.725022 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21480): Terminated: ok {rc=0} 04:00:47.769727 --- ParallelTerminationStrategy: PID 21483 died... 04:00:47.788498 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21483): Terminated: ok {rc=0} 04:00:47.876330 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:trx-b200+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 04:00:49.026507 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:00:49.038105 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:00:49.110522 tst iperf3m4.py: using LAC 18923 04:00:49.229857 tst iperf3m4.py: using RAC 53 04:00:49.348158 tst iperf3m4.py: using CellId 18923 04:00:49.467696 tst iperf3m4.py: using BVCI 18924 04:00:49.578288 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:00:49.589168 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:00:49.599760 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:00:49.610446 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:00:49.621084 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:00:49.631700 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:00:49.642437 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:00:49.652910 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:00:49.664390 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:00:49.783493 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:00:49.905113 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:00:50.025298 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:00:50.141666 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 04:00:50.362202 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:00:50.687722 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21485): Launched 04:00:50.970426 run iperf3-srv_10.42.42.10(pid=21486): Launched 04:00:51.093319 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 04:00:51.311447 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:00:51.636214 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21487): Launched 04:00:51.919114 run iperf3-srv_10.42.42.10(pid=21488): Launched 04:00:52.041228 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 04:00:52.259921 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:00:52.584788 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21489): Launched 04:00:52.867060 run iperf3-srv_10.42.42.10(pid=21490): Launched 04:00:52.989167 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 04:00:53.207817 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:00:53.532089 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21491): Launched 04:00:53.814299 run iperf3-srv_10.42.42.10(pid=21492): Launched 04:00:53.936332 tst iperf3m4.py:8: start network... 04:00:54.154419 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:00:54.655200 run create_hlr_db(pid=21493): Launched 04:00:54.779320 bus /gobi_6: Setting Powered False 04:00:55.843461 run create_hlr_db(pid=21493): Terminated: ok {rc=0} 04:00:56.275653 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21495): Launched 04:00:56.577781 run osmo-hlr_10.42.42.2(pid=21496): Launched 04:00:56.694409 run osmo-stp_10.42.42.5: Starting osmo-stp 04:00:57.213270 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21498): Launched 04:00:57.514343 run osmo-stp_10.42.42.5(pid=21499): Launched 04:00:57.629037 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:00:58.149117 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21501): Launched 04:00:58.264516 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:00:58.519134 run patchelf(pid=21502): Launched 04:00:58.686962 run osmo-stp_10.42.42.5(pid=21499): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21499)] 04:00:58.814516 run osmo-stp_10.42.42.5(pid=21499): stdout: | (launched: 2022-12-09_04:00:57.458919) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:00:58.943931 run osmo-stp_10.42.42.5(pid=21499): stderr: | 20221209040057627 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040057627 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040057628 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040057628 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040057629 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040057629 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040057629 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:00:59.073373 run osmo-stp_10.42.42.5(pid=21499): stdout: | (launched: 2022-12-09_04:00:57.458919) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:00:59.197137 run osmo-stp_10.42.42.5(pid=21499): stderr: | 20221209040057627 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040057627 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040057628 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040057628 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040057629 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040057629 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040057629 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:00:59.343242 run patchelf(pid=21502): Terminating (SIGINT) 04:00:59.512823 run patchelf(pid=21502): Terminated: ok {rc=0} 04:00:59.635174 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21499): Process ended prematurely: osmo-stp_10.42.42.5(pid=21499) [trial-2354↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21499)] [trial-2354↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8] 04:00:59.644622 tst iperf3m4.py:8: Test FAILED (10.7 sec) 04:00:59.672247 run osmo-hlr_10.42.42.2(pid=21496): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21496)] 04:00:59.720472 run osmo-hlr_10.42.42.2(pid=21496): stdout: | (launched: 2022-12-09_04:00:56.522399) 04:00:59.770366 run osmo-hlr_10.42.42.2(pid=21496): stderr: | 20221209040056698 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209040056698 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209040056698 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209040056698 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209040056698 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209040056698 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209040056711 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209040056720 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209040056720 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209040056720 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:00:59.821145 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21485): Terminating (SIGTERM) 04:00:59.861568 run iperf3-srv_10.42.42.10(pid=21486): Terminating (SIGTERM) 04:00:59.901471 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21487): Terminating (SIGTERM) 04:00:59.941320 run iperf3-srv_10.42.42.10(pid=21488): Terminating (SIGTERM) 04:00:59.982676 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21489): Terminating (SIGTERM) 04:01:00.022952 run iperf3-srv_10.42.42.10(pid=21490): Terminating (SIGTERM) 04:01:00.062795 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21491): Terminating (SIGTERM) 04:01:00.102613 run iperf3-srv_10.42.42.10(pid=21492): Terminating (SIGTERM) 04:01:00.142345 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21495): Terminating (SIGTERM) 04:01:00.182307 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21498): Terminating (SIGTERM) 04:01:00.222535 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21501): Terminating (SIGTERM) 04:01:00.262663 --- ParallelTerminationStrategy: PID 21485 died... 04:01:00.281859 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21485): Terminated: ok {rc=0} 04:01:00.326147 --- ParallelTerminationStrategy: PID 21486 died... 04:01:00.344873 run iperf3-srv_10.42.42.10(pid=21486): Terminated {rc=256} 04:01:00.388829 --- ParallelTerminationStrategy: PID 21487 died... 04:01:00.407918 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21487): Terminated: ok {rc=0} 04:01:00.452057 --- ParallelTerminationStrategy: PID 21488 died... 04:01:00.470959 run iperf3-srv_10.42.42.10(pid=21488): Terminated {rc=256} 04:01:00.514697 --- ParallelTerminationStrategy: PID 21489 died... 04:01:00.533423 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21489): Terminated: ok {rc=0} 04:01:00.577331 --- ParallelTerminationStrategy: PID 21490 died... 04:01:00.595874 run iperf3-srv_10.42.42.10(pid=21490): Terminated {rc=256} 04:01:00.639732 --- ParallelTerminationStrategy: PID 21491 died... 04:01:00.658513 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21491): Terminated: ok {rc=0} 04:01:00.702509 --- ParallelTerminationStrategy: PID 21492 died... 04:01:00.721244 run iperf3-srv_10.42.42.10(pid=21492): Terminated {rc=256} 04:01:00.765291 --- ParallelTerminationStrategy: PID 21495 died... 04:01:00.784030 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21495): Terminated: ok {rc=0} 04:01:00.828502 --- ParallelTerminationStrategy: PID 21498 died... 04:01:00.848117 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21498): Terminated: ok {rc=0} 04:01:00.895208 --- ParallelTerminationStrategy: PID 21501 died... 04:01:00.918827 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21501): Terminated: ok {rc=0} 04:01:01.011795 bus /gobi_4: Setting Powered False 04:01:02.107321 bus /gobi_4: Setting Powered False 04:01:03.220877 bus /gobi_1: Setting Powered False 04:01:04.319202 bus /gobi_1: Setting Powered False 04:01:05.437423 bus /gobi_0: Setting Powered False 04:01:06.537583 bus /gobi_0: Setting Powered False 04:01:07.656324 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:trx-b200+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 04:01:08.760531 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:01:08.772555 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:01:08.845700 tst ping.py: using LAC 18924 04:01:08.962500 tst ping.py: using RAC 54 04:01:09.080939 tst ping.py: using CellId 18924 04:01:09.199796 tst ping.py: using BVCI 18925 04:01:09.308783 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:01:09.319883 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:01:09.330670 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:01:09.341497 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:01:09.352079 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:01:09.362792 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:01:09.373487 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:01:09.384108 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:01:09.501627 tst ping.py:19: start network... 04:01:09.714726 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:01:10.205585 run create_hlr_db(pid=21503): Launched 04:01:10.326992 bus /gobi_6: Setting Powered False 04:01:11.390247 run create_hlr_db(pid=21503): Terminated: ok {rc=0} 04:01:11.814753 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21505): Launched 04:01:12.112893 run osmo-hlr_10.42.42.2(pid=21506): Launched 04:01:12.227328 run osmo-stp_10.42.42.5: Starting osmo-stp 04:01:12.745749 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21508): Launched 04:01:13.042136 run osmo-stp_10.42.42.5(pid=21509): Launched 04:01:13.155010 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:01:13.664781 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21511): Launched 04:01:13.779031 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:01:14.028762 run patchelf(pid=21512): Launched 04:01:14.194048 run osmo-stp_10.42.42.5(pid=21509): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21509)] 04:01:14.319914 run osmo-stp_10.42.42.5(pid=21509): stdout: | (launched: 2022-12-09_04:01:12.987589) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:01:14.446794 run osmo-stp_10.42.42.5(pid=21509): stderr: | 20221209040113157 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040113157 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040113158 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040113158 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040113158 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040113159 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040113159 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:01:14.573771 run osmo-stp_10.42.42.5(pid=21509): stdout: | (launched: 2022-12-09_04:01:12.987589) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:01:14.694948 run osmo-stp_10.42.42.5(pid=21509): stderr: | 20221209040113157 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040113157 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040113158 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040113158 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040113158 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040113159 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040113159 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:01:14.838770 run patchelf(pid=21512): Terminating (SIGINT) 04:01:15.005650 run patchelf(pid=21512): Terminated: ok {rc=0} 04:01:15.125859 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=21509): Process ended prematurely: osmo-stp_10.42.42.5(pid=21509) [trial-2354↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21509)] [trial-2354↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22] 04:01:15.134806 tst ping.py:22: Test FAILED (6.4 sec) 04:01:15.161768 run osmo-hlr_10.42.42.2(pid=21506): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21506)] 04:01:15.209584 run osmo-hlr_10.42.42.2(pid=21506): stdout: | (launched: 2022-12-09_04:01:12.058316) 04:01:15.259276 run osmo-hlr_10.42.42.2(pid=21506): stderr: | 20221209040112232 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209040112232 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209040112232 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209040112232 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209040112232 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209040112232 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209040112244 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-b200+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209040112255 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209040112255 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209040112255 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:01:15.309889 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21505): Terminating (SIGTERM) 04:01:15.349660 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21508): Terminating (SIGTERM) 04:01:15.389362 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21511): Terminating (SIGTERM) 04:01:15.429942 --- ParallelTerminationStrategy: PID 21505 died... 04:01:15.449131 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21505): Terminated: ok {rc=0} 04:01:15.493213 --- ParallelTerminationStrategy: PID 21508 died... 04:01:15.511811 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21508): Terminated: ok {rc=0} 04:01:15.555821 --- ParallelTerminationStrategy: PID 21511 died... 04:01:15.574590 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21511): Terminated: ok {rc=0} 04:01:15.660237 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:trx-b200+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 04:01:16.751611 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:01:16.764030 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:01:16.839208 tst ping_idle_ping.py: using LAC 18925 04:01:16.968627 tst ping_idle_ping.py: using RAC 55 04:01:17.123915 tst ping_idle_ping.py: using CellId 18925 04:01:17.265644 tst ping_idle_ping.py: using BVCI 18926 04:01:17.375370 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:01:17.386219 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:01:17.396772 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:01:17.407528 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:01:17.418034 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:01:17.428608 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:01:17.439325 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:01:17.449910 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:01:17.564804 tst ping_idle_ping.py:24: start network... 04:01:17.764072 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:01:18.227658 run create_hlr_db(pid=21513): Launched 04:01:18.349419 bus /gobi_6: Setting Powered False 04:01:19.409291 run create_hlr_db(pid=21513): Terminated: ok {rc=0} 04:01:19.844210 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21515): Launched 04:01:20.163957 run osmo-hlr_10.42.42.2(pid=21516): Launched 04:01:20.286313 run osmo-stp_10.42.42.5: Starting osmo-stp 04:01:20.834862 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21518): Launched 04:01:21.153376 run osmo-stp_10.42.42.5(pid=21519): Launched 04:01:21.276006 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:01:21.825172 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21521): Launched 04:01:21.940447 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:01:22.192431 run patchelf(pid=21522): Launched 04:01:22.358410 run osmo-stp_10.42.42.5(pid=21519): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21519)] 04:01:22.484205 run osmo-stp_10.42.42.5(pid=21519): stdout: | (launched: 2022-12-09_04:01:21.095150) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:01:22.611799 run osmo-stp_10.42.42.5(pid=21519): stderr: | 20221209040121288 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040121288 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040121288 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040121288 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040121289 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040121289 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040121289 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:01:22.739354 run osmo-stp_10.42.42.5(pid=21519): stdout: | (launched: 2022-12-09_04:01:21.095150) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:01:22.861138 run osmo-stp_10.42.42.5(pid=21519): stderr: | 20221209040121288 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040121288 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040121288 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040121288 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040121289 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040121289 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040121289 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:01:23.005379 run patchelf(pid=21522): Terminating (SIGINT) 04:01:23.173213 run patchelf(pid=21522): Terminated: ok {rc=0} 04:01:23.294016 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=21519): Process ended prematurely: osmo-stp_10.42.42.5(pid=21519) [trial-2354↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21519)] [trial-2354↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 04:01:23.302890 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 04:01:23.330227 run osmo-hlr_10.42.42.2(pid=21516): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21516)] 04:01:23.379356 run osmo-hlr_10.42.42.2(pid=21516): stdout: | (launched: 2022-12-09_04:01:20.105878) 04:01:23.429668 run osmo-hlr_10.42.42.2(pid=21516): stderr: | 20221209040120304 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209040120304 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209040120304 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209040120304 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209040120304 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209040120304 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209040120316 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-b200+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209040120324 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209040120325 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209040120325 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:01:23.480281 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21515): Terminating (SIGTERM) 04:01:23.521008 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21518): Terminating (SIGTERM) 04:01:23.561611 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21521): Terminating (SIGTERM) 04:01:23.602296 --- ParallelTerminationStrategy: PID 21515 died... 04:01:23.621337 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21515): Terminated: ok {rc=0} 04:01:23.666536 --- ParallelTerminationStrategy: PID 21518 died... 04:01:23.685250 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21518): Terminated: ok {rc=0} 04:01:23.730493 --- ParallelTerminationStrategy: PID 21521 died... 04:01:23.749242 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21521): Terminated: ok {rc=0} 04:01:23.837234 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2354 gprs:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 04:01:25.143948 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:01:25.150485 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 04:01:25.184789 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 04:01:25.223732 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 04:01:25.310316 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 04:01:25.343085 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 04:01:25.381293 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 04:01:25.980186 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2354 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 04:01:26.030283 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:01:26.041842 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 04:01:26.094802 tst cs_paging_gprs_active.py: using LAC 18926 04:01:26.215694 tst cs_paging_gprs_active.py: using RAC 56 04:01:26.334828 tst cs_paging_gprs_active.py: using CellId 18926 04:01:26.453674 tst cs_paging_gprs_active.py: using BVCI 18927 04:01:26.563297 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:01:26.574573 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:01:26.585647 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:01:26.596601 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:01:26.607648 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:01:26.618676 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:01:26.629718 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:01:26.640540 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:01:26.651767 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 04:01:26.771624 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 04:01:26.890522 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 04:01:27.111199 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:01:27.438371 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21528): Launched 04:01:27.722276 run iperf3-srv_10.42.42.10(pid=21529): Launched 04:01:27.844861 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 04:01:28.064524 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:01:28.391155 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21530): Launched 04:01:28.674575 run iperf3-srv_10.42.42.10(pid=21531): Launched 04:01:28.797048 tst cs_paging_gprs_active.py:38: start network... 04:01:29.016112 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:01:29.519808 run create_hlr_db(pid=21532): Launched 04:01:29.644767 bus /gobi_6: Setting Powered False 04:01:30.709368 run create_hlr_db(pid=21532): Terminated: ok {rc=0} 04:01:31.151244 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21534): Launched 04:01:31.501736 run osmo-hlr_10.42.42.2(pid=21535): Launched 04:01:31.779545 run osmo-stp_10.42.42.5: Starting osmo-stp 04:01:32.399502 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21537): Launched 04:01:32.703489 run osmo-stp_10.42.42.5(pid=21538): Launched 04:01:32.819180 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:01:33.341021 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21540): Launched 04:01:33.457011 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:01:33.713044 run patchelf(pid=21541): Launched 04:01:33.881822 run osmo-stp_10.42.42.5(pid=21538): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21538)] 04:01:34.010450 run osmo-stp_10.42.42.5(pid=21538): stdout: | (launched: 2022-12-09_04:01:32.647640) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:01:34.140705 run osmo-stp_10.42.42.5(pid=21538): stderr: | 20221209040132819 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040132819 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040132819 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040132819 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040132821 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040132821 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040132821 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:01:34.270137 run osmo-stp_10.42.42.5(pid=21538): stdout: | (launched: 2022-12-09_04:01:32.647640) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:01:34.394378 run osmo-stp_10.42.42.5(pid=21538): stderr: | 20221209040132819 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040132819 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040132819 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040132819 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040132821 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040132821 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040132821 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:01:34.541202 run patchelf(pid=21541): Terminating (SIGINT) 04:01:34.712078 run patchelf(pid=21541): Terminated: ok {rc=0} 04:01:34.835316 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=21538): Process ended prematurely: osmo-stp_10.42.42.5(pid=21538) [trial-2354↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21538)] [trial-2354↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 04:01:34.844724 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 04:01:34.872166 run osmo-hlr_10.42.42.2(pid=21535): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21535)] 04:01:34.920512 run osmo-hlr_10.42.42.2(pid=21535): stdout: | (launched: 2022-12-09_04:01:31.416390) 04:01:34.970402 run osmo-hlr_10.42.42.2(pid=21535): stderr: | 20221209040131699 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209040131699 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209040131699 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209040131699 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209040131699 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209040131699 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209040131713 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209040131723 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209040131723 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209040131723 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:01:35.020825 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21528): Terminating (SIGTERM) 04:01:35.061037 run iperf3-srv_10.42.42.10(pid=21529): Terminating (SIGTERM) 04:01:35.101114 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21530): Terminating (SIGTERM) 04:01:35.141679 run iperf3-srv_10.42.42.10(pid=21531): Terminating (SIGTERM) 04:01:35.181766 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21534): Terminating (SIGTERM) 04:01:35.222407 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21537): Terminating (SIGTERM) 04:01:35.262327 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21540): Terminating (SIGTERM) 04:01:35.302502 --- ParallelTerminationStrategy: PID 21528 died... 04:01:35.321695 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21528): Terminated: ok {rc=0} 04:01:35.366133 --- ParallelTerminationStrategy: PID 21529 died... 04:01:35.384784 run iperf3-srv_10.42.42.10(pid=21529): Terminated {rc=256} 04:01:35.429068 --- ParallelTerminationStrategy: PID 21530 died... 04:01:35.447796 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21530): Terminated: ok {rc=0} 04:01:35.491815 --- ParallelTerminationStrategy: PID 21531 died... 04:01:35.510511 run iperf3-srv_10.42.42.10(pid=21531): Terminated {rc=256} 04:01:35.554216 --- ParallelTerminationStrategy: PID 21534 died... 04:01:35.572825 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21534): Terminated: ok {rc=0} 04:01:35.616646 --- ParallelTerminationStrategy: PID 21537 died... 04:01:35.635461 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21537): Terminated: ok {rc=0} 04:01:35.679450 --- ParallelTerminationStrategy: PID 21540 died... 04:01:35.698234 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21540): Terminated: ok {rc=0} 04:01:35.784459 bus /gobi_0: Setting Powered False 04:01:36.885932 bus /gobi_0: Setting Powered False 04:01:38.002960 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 04:01:39.151691 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:01:39.163465 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 04:01:39.218465 tst iperf3.py: using LAC 18927 04:01:39.337323 tst iperf3.py: using RAC 57 04:01:39.455658 tst iperf3.py: using CellId 18927 04:01:39.576025 tst iperf3.py: using BVCI 18928 04:01:39.685515 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:01:39.696650 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:01:39.707671 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:01:39.718839 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:01:39.729831 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:01:39.740702 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:01:39.751824 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:01:39.762712 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:01:39.773781 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 04:01:39.894634 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 04:01:40.099740 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:01:40.405703 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21542): Launched 04:01:40.669713 run iperf3-srv_10.42.42.10(pid=21543): Launched 04:01:40.783577 tst iperf3.py:8: start network... 04:01:40.985479 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:01:41.452545 run create_hlr_db(pid=21544): Launched 04:01:41.576334 bus /gobi_6: Setting Powered False 04:01:42.637453 run create_hlr_db(pid=21544): Terminated: ok {rc=0} 04:01:43.079211 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21546): Launched 04:01:43.403890 run osmo-hlr_10.42.42.2(pid=21547): Launched 04:01:43.528192 run osmo-stp_10.42.42.5: Starting osmo-stp 04:01:44.088304 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21549): Launched 04:01:44.413021 run osmo-stp_10.42.42.5(pid=21550): Launched 04:01:44.536693 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:01:45.094467 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21552): Launched 04:01:45.215275 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:01:45.470413 run patchelf(pid=21553): Launched 04:01:45.638680 run osmo-stp_10.42.42.5(pid=21550): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21550)] 04:01:45.765787 run osmo-stp_10.42.42.5(pid=21550): stdout: | (launched: 2022-12-09_04:01:44.353992) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:01:45.895792 run osmo-stp_10.42.42.5(pid=21550): stderr: | 20221209040144547 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040144548 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040144548 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040144548 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040144549 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040144549 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040144549 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:01:46.027042 run osmo-stp_10.42.42.5(pid=21550): stdout: | (launched: 2022-12-09_04:01:44.353992) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:01:46.153170 run osmo-stp_10.42.42.5(pid=21550): stderr: | 20221209040144547 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040144548 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040144548 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040144548 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040144549 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040144549 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040144549 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:01:46.304286 run patchelf(pid=21553): Terminating (SIGINT) 04:01:46.478317 run patchelf(pid=21553): Terminated: ok {rc=0} 04:01:46.603540 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21550): Process ended prematurely: osmo-stp_10.42.42.5(pid=21550) [trial-2354↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21550)] [trial-2354↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 04:01:46.613670 tst iperf3.py:8: Test FAILED (7.5 sec) 04:01:46.642291 run osmo-hlr_10.42.42.2(pid=21547): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21547)] 04:01:46.691272 run osmo-hlr_10.42.42.2(pid=21547): stdout: | (launched: 2022-12-09_04:01:43.344862) 04:01:46.742307 run osmo-hlr_10.42.42.2(pid=21547): stderr: | 20221209040143544 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209040143544 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209040143544 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209040143544 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209040143544 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209040143544 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209040143556 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209040143564 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209040143565 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209040143565 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:01:46.793543 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21542): Terminating (SIGTERM) 04:01:46.834185 run iperf3-srv_10.42.42.10(pid=21543): Terminating (SIGTERM) 04:01:46.876037 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21546): Terminating (SIGTERM) 04:01:46.917863 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21549): Terminating (SIGTERM) 04:01:46.960915 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21552): Terminating (SIGTERM) 04:01:47.003854 --- ParallelTerminationStrategy: PID 21542 died... 04:01:47.023468 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21542): Terminated: ok {rc=0} 04:01:47.070134 --- ParallelTerminationStrategy: PID 21543 died... 04:01:47.089275 run iperf3-srv_10.42.42.10(pid=21543): Terminated {rc=256} 04:01:47.134013 --- ParallelTerminationStrategy: PID 21546 died... 04:01:47.153277 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21546): Terminated: ok {rc=0} 04:01:47.197777 --- ParallelTerminationStrategy: PID 21549 died... 04:01:47.216903 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21549): Terminated: ok {rc=0} 04:01:47.261484 --- ParallelTerminationStrategy: PID 21552 died... 04:01:47.280599 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21552): Terminated: ok {rc=0} 04:01:47.364272 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 04:01:48.514356 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:01:48.526826 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 04:01:48.582468 tst iperf3m4.py: using LAC 18928 04:01:48.710270 tst iperf3m4.py: using RAC 58 04:01:48.836573 tst iperf3m4.py: using CellId 18928 04:01:48.963341 tst iperf3m4.py: using BVCI 18929 04:01:49.074715 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:01:49.086679 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:01:49.097953 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:01:49.109192 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:01:49.120504 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:01:49.131702 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:01:49.142899 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:01:49.153980 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:01:49.165294 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 04:01:49.285645 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 04:01:49.406414 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 04:01:49.526938 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 04:01:49.645616 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 04:01:49.848540 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:01:50.152914 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21554): Launched 04:01:50.417660 run iperf3-srv_10.42.42.10(pid=21555): Launched 04:01:50.531223 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 04:01:50.732877 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:01:51.035229 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21556): Launched 04:01:51.299053 run iperf3-srv_10.42.42.10(pid=21557): Launched 04:01:51.413104 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 04:01:51.614328 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:01:51.916782 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21558): Launched 04:01:52.180160 run iperf3-srv_10.42.42.10(pid=21559): Launched 04:01:52.294459 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 04:01:52.495834 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:01:52.798914 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21560): Launched 04:01:53.062749 run iperf3-srv_10.42.42.10(pid=21561): Launched 04:01:53.176535 tst iperf3m4.py:8: start network... 04:01:53.377539 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:01:53.842583 run create_hlr_db(pid=21562): Launched 04:01:53.966111 bus /gobi_6: Setting Powered False 04:01:55.026550 run create_hlr_db(pid=21562): Terminated: ok {rc=0} 04:01:55.468093 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21564): Launched 04:01:55.792412 run osmo-hlr_10.42.42.2(pid=21565): Launched 04:01:55.916187 run osmo-stp_10.42.42.5: Starting osmo-stp 04:01:56.477666 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21567): Launched 04:01:56.801442 run osmo-stp_10.42.42.5(pid=21568): Launched 04:01:56.925180 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:01:57.484226 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21570): Launched 04:01:57.608212 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:01:57.881408 run patchelf(pid=21571): Launched 04:01:58.062025 run osmo-stp_10.42.42.5(pid=21568): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21568)] 04:01:58.199757 run osmo-stp_10.42.42.5(pid=21568): stdout: | (launched: 2022-12-09_04:01:56.742168) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:01:58.338711 run osmo-stp_10.42.42.5(pid=21568): stderr: | 20221209040156932 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040156932 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040156933 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040156933 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040156934 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040156934 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040156934 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:01:58.477500 run osmo-stp_10.42.42.5(pid=21568): stdout: | (launched: 2022-12-09_04:01:56.742168) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:01:58.610596 run osmo-stp_10.42.42.5(pid=21568): stderr: | 20221209040156932 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040156932 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040156933 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040156933 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040156934 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040156934 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040156934 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:01:58.767941 run patchelf(pid=21571): Terminating (SIGINT) 04:01:58.950389 run patchelf(pid=21571): Terminated: ok {rc=0} 04:01:59.082047 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21568): Process ended prematurely: osmo-stp_10.42.42.5(pid=21568) [trial-2354↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21568)] [trial-2354↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 04:01:59.092641 tst iperf3m4.py:8: Test FAILED (10.6 sec) 04:01:59.122936 run osmo-hlr_10.42.42.2(pid=21565): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21565)] 04:01:59.174659 run osmo-hlr_10.42.42.2(pid=21565): stdout: | (launched: 2022-12-09_04:01:55.733353) 04:01:59.228254 run osmo-hlr_10.42.42.2(pid=21565): stderr: | 20221209040155930 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209040155930 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209040155930 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209040155930 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209040155930 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209040155930 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209040155943 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209040155953 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209040155953 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209040155953 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:01:59.281737 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21554): Terminating (SIGTERM) 04:01:59.324375 run iperf3-srv_10.42.42.10(pid=21555): Terminating (SIGTERM) 04:01:59.367095 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21556): Terminating (SIGTERM) 04:01:59.409673 run iperf3-srv_10.42.42.10(pid=21557): Terminating (SIGTERM) 04:01:59.452112 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21558): Terminating (SIGTERM) 04:01:59.494777 run iperf3-srv_10.42.42.10(pid=21559): Terminating (SIGTERM) 04:01:59.538572 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21560): Terminating (SIGTERM) 04:01:59.581336 run iperf3-srv_10.42.42.10(pid=21561): Terminating (SIGTERM) 04:01:59.623392 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21564): Terminating (SIGTERM) 04:01:59.665865 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21567): Terminating (SIGTERM) 04:01:59.708167 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21570): Terminating (SIGTERM) 04:01:59.750878 --- ParallelTerminationStrategy: PID 21554 died... 04:01:59.770966 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21554): Terminated: ok {rc=0} 04:01:59.818055 --- ParallelTerminationStrategy: PID 21555 died... 04:01:59.837743 run iperf3-srv_10.42.42.10(pid=21555): Terminated {rc=256} 04:01:59.884307 --- ParallelTerminationStrategy: PID 21556 died... 04:01:59.904069 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21556): Terminated: ok {rc=0} 04:01:59.951160 --- ParallelTerminationStrategy: PID 21557 died... 04:01:59.970940 run iperf3-srv_10.42.42.10(pid=21557): Terminated {rc=256} 04:02:00.017681 --- ParallelTerminationStrategy: PID 21558 died... 04:02:00.037439 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21558): Terminated: ok {rc=0} 04:02:00.084662 --- ParallelTerminationStrategy: PID 21559 died... 04:02:00.104353 run iperf3-srv_10.42.42.10(pid=21559): Terminated {rc=256} 04:02:00.151363 --- ParallelTerminationStrategy: PID 21560 died... 04:02:00.171070 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21560): Terminated: ok {rc=0} 04:02:00.217895 --- ParallelTerminationStrategy: PID 21561 died... 04:02:00.237711 run iperf3-srv_10.42.42.10(pid=21561): Terminated {rc=256} 04:02:00.284650 --- ParallelTerminationStrategy: PID 21564 died... 04:02:00.304427 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21564): Terminated: ok {rc=0} 04:02:00.351775 --- ParallelTerminationStrategy: PID 21567 died... 04:02:00.371609 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21567): Terminated: ok {rc=0} 04:02:00.418894 --- ParallelTerminationStrategy: PID 21570 died... 04:02:00.438684 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21570): Terminated: ok {rc=0} 04:02:00.527709 bus /gobi_4: Setting Powered False 04:02:01.625517 bus /gobi_4: Setting Powered False 04:02:02.740543 bus /gobi_1: Setting Powered False 04:02:03.837277 bus /gobi_1: Setting Powered False 04:02:04.952362 bus /gobi_0: Setting Powered False 04:02:06.053630 bus /gobi_0: Setting Powered False 04:02:07.171215 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 04:02:08.271284 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:02:08.283053 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 04:02:08.335653 tst ping.py: using LAC 18929 04:02:08.453919 tst ping.py: using RAC 59 04:02:08.577190 tst ping.py: using CellId 18929 04:02:08.702657 tst ping.py: using BVCI 18930 04:02:08.820294 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:02:08.832890 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:02:08.844923 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:02:08.858725 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:02:08.870591 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:02:08.883000 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:02:08.895597 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:02:08.907921 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 04:02:09.024831 tst ping.py:19: start network... 04:02:09.239149 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:02:09.731901 run create_hlr_db(pid=21572): Launched 04:02:09.853410 bus /gobi_6: Setting Powered False 04:02:10.916224 run create_hlr_db(pid=21572): Terminated: ok {rc=0} 04:02:11.342533 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21574): Launched 04:02:11.640016 run osmo-hlr_10.42.42.2(pid=21575): Launched 04:02:11.755018 run osmo-stp_10.42.42.5: Starting osmo-stp 04:02:12.267484 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21577): Launched 04:02:12.564040 run osmo-stp_10.42.42.5(pid=21578): Launched 04:02:12.677518 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:02:13.187752 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21580): Launched 04:02:13.301415 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:02:13.551226 run patchelf(pid=21581): Launched 04:02:13.716162 run osmo-stp_10.42.42.5(pid=21578): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21578)] 04:02:13.842107 run osmo-stp_10.42.42.5(pid=21578): stdout: | (launched: 2022-12-09_04:02:12.509448) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:02:13.969470 run osmo-stp_10.42.42.5(pid=21578): stderr: | 20221209040212678 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040212678 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040212678 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040212679 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040212679 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040212679 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040212679 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:02:14.096515 run osmo-stp_10.42.42.5(pid=21578): stdout: | (launched: 2022-12-09_04:02:12.509448) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:02:14.218537 run osmo-stp_10.42.42.5(pid=21578): stderr: | 20221209040212678 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040212678 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040212678 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040212679 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040212679 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040212679 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040212679 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:02:14.362840 run patchelf(pid=21581): Terminating (SIGINT) 04:02:14.531306 run patchelf(pid=21581): Terminated: ok {rc=0} 04:02:14.651872 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=21578): Process ended prematurely: osmo-stp_10.42.42.5(pid=21578) [trial-2354↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21578)] [trial-2354↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 04:02:14.660880 tst ping.py:22: Test FAILED (6.4 sec) 04:02:14.688068 run osmo-hlr_10.42.42.2(pid=21575): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21575)] 04:02:14.735714 run osmo-hlr_10.42.42.2(pid=21575): stdout: | (launched: 2022-12-09_04:02:11.585361) 04:02:14.785147 run osmo-hlr_10.42.42.2(pid=21575): stderr: | 20221209040211761 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209040211761 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209040211761 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209040211761 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209040211761 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209040211761 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209040211773 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209040211782 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209040211782 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209040211783 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:02:14.834917 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21574): Terminating (SIGTERM) 04:02:14.874798 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21577): Terminating (SIGTERM) 04:02:14.914592 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21580): Terminating (SIGTERM) 04:02:14.954653 --- ParallelTerminationStrategy: PID 21574 died... 04:02:14.973762 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21574): Terminated: ok {rc=0} 04:02:15.018482 --- ParallelTerminationStrategy: PID 21577 died... 04:02:15.037157 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21577): Terminated: ok {rc=0} 04:02:15.081329 --- ParallelTerminationStrategy: PID 21580 died... 04:02:15.100162 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21580): Terminated: ok {rc=0} 04:02:15.186263 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 04:02:16.276659 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:02:16.289794 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 04:02:16.346307 tst ping_idle_ping.py: using LAC 18930 04:02:16.476368 tst ping_idle_ping.py: using RAC 60 04:02:16.607341 tst ping_idle_ping.py: using CellId 18930 04:02:16.755620 tst ping_idle_ping.py: using BVCI 18931 04:02:16.888114 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:02:16.900293 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:02:16.912908 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:02:16.925505 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:02:16.937807 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:02:16.950780 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:02:16.962721 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:02:16.975367 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 04:02:17.092425 tst ping_idle_ping.py:24: start network... 04:02:17.298019 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:02:17.762293 run create_hlr_db(pid=21582): Launched 04:02:17.884006 bus /gobi_6: Setting Powered False 04:02:18.943216 run create_hlr_db(pid=21582): Terminated: ok {rc=0} 04:02:19.356783 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21584): Launched 04:02:19.653155 run osmo-hlr_10.42.42.2(pid=21585): Launched 04:02:19.766912 run osmo-stp_10.42.42.5: Starting osmo-stp 04:02:20.277645 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21587): Launched 04:02:20.575694 run osmo-stp_10.42.42.5(pid=21588): Launched 04:02:20.688708 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:02:21.199468 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21590): Launched 04:02:21.312708 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:02:21.563107 run patchelf(pid=21591): Launched 04:02:21.727737 run osmo-stp_10.42.42.5(pid=21588): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21588)] 04:02:21.853392 run osmo-stp_10.42.42.5(pid=21588): stdout: | (launched: 2022-12-09_04:02:20.520907) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:02:21.980563 run osmo-stp_10.42.42.5(pid=21588): stderr: | 20221209040220691 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040220691 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040220691 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040220692 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040220692 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040220692 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040220692 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:02:22.107689 run osmo-stp_10.42.42.5(pid=21588): stdout: | (launched: 2022-12-09_04:02:20.520907) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:02:22.229357 run osmo-stp_10.42.42.5(pid=21588): stderr: | 20221209040220691 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040220691 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040220691 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040220692 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040220692 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040220692 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040220692 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:02:22.373480 run patchelf(pid=21591): Terminating (SIGINT) 04:02:22.541989 run patchelf(pid=21591): Terminated: ok {rc=0} 04:02:22.662385 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=21588): Process ended prematurely: osmo-stp_10.42.42.5(pid=21588) [trial-2354↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21588)] [trial-2354↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 04:02:22.671473 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 04:02:22.698567 run osmo-hlr_10.42.42.2(pid=21585): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21585)] 04:02:22.746573 run osmo-hlr_10.42.42.2(pid=21585): stdout: | (launched: 2022-12-09_04:02:19.598570) 04:02:22.796617 run osmo-hlr_10.42.42.2(pid=21585): stderr: | 20221209040219775 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209040219775 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209040219775 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209040219775 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209040219775 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209040219775 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209040219787 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209040219796 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209040219796 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209040219796 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:02:22.847248 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21584): Terminating (SIGTERM) 04:02:22.887275 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21587): Terminating (SIGTERM) 04:02:22.927285 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21590): Terminating (SIGTERM) 04:02:22.967559 --- ParallelTerminationStrategy: PID 21584 died... 04:02:22.986855 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21584): Terminated: ok {rc=0} 04:02:23.031440 --- ParallelTerminationStrategy: PID 21587 died... 04:02:23.050391 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21587): Terminated: ok {rc=0} 04:02:23.094497 --- ParallelTerminationStrategy: PID 21590 died... 04:02:23.113297 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21590): Terminated: ok {rc=0} 04:02:23.197408 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2354 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 04:02:24.511624 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:02:24.519430 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 04:02:24.554738 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 04:02:24.590431 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 04:02:24.644635 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 04:02:24.678677 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 04:02:24.713874 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 04:02:25.272800 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2354 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 04:02:25.278326 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:02:25.289989 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 04:02:25.361940 tst switch_tch_pdch.py: using LAC 18931 04:02:25.487287 tst switch_tch_pdch.py: using RAC 61 04:02:25.613333 tst switch_tch_pdch.py: using CellId 18931 04:02:25.737164 tst switch_tch_pdch.py: using BVCI 18932 04:02:25.852686 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:02:25.864363 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:02:25.875956 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:02:25.887649 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:02:25.899278 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:02:25.910840 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:02:25.922684 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:02:25.934299 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:02:26.049846 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:02:26.170623 tst switch_tch_pdch.py:51: start network... 04:02:26.384411 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:02:26.878195 run create_hlr_db(pid=21595): Launched 04:02:26.999127 bus /gobi_6: Setting Powered False 04:02:28.062456 run create_hlr_db(pid=21595): Terminated: ok {rc=0} 04:02:28.488258 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21597): Launched 04:02:28.784937 run osmo-hlr_10.42.42.2(pid=21598): Launched 04:02:28.897862 run osmo-stp_10.42.42.5: Starting osmo-stp 04:02:29.406742 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21600): Launched 04:02:29.702960 run osmo-stp_10.42.42.5(pid=21601): Launched 04:02:29.816030 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:02:30.326311 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21603): Launched 04:02:30.439133 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:02:30.689270 run patchelf(pid=21604): Launched 04:02:30.855096 run osmo-stp_10.42.42.5(pid=21601): ERR: Terminated: ERROR {rc=1} [trial-2354↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21601)] 04:02:30.988585 run osmo-stp_10.42.42.5(pid=21601): stdout: | (launched: 2022-12-09_04:02:29.648500) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:02:31.117998 run osmo-stp_10.42.42.5(pid=21601): stderr: | 20221209040229817 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040229817 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040229818 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040229818 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040229819 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040229819 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040229819 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:02:31.247576 run osmo-stp_10.42.42.5(pid=21601): stdout: | (launched: 2022-12-09_04:02:29.648500) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:02:31.372297 run osmo-stp_10.42.42.5(pid=21601): stderr: | 20221209040229817 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040229817 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040229818 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040229818 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040229819 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040229819 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040229819 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:02:31.519843 run patchelf(pid=21604): Terminating (SIGINT) 04:02:31.690981 run patchelf(pid=21604): Terminated: ok {rc=0} 04:02:31.813856 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=21601): Process ended prematurely: osmo-stp_10.42.42.5(pid=21601) [trial-2354↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21601)] [trial-2354↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 04:02:31.823439 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 04:02:31.851645 run osmo-hlr_10.42.42.2(pid=21598): ERR: Terminated: ERROR {rc=237} [trial-2354↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21598)] 04:02:31.901278 run osmo-hlr_10.42.42.2(pid=21598): stdout: | (launched: 2022-12-09_04:02:28.730811) 04:02:31.952236 run osmo-hlr_10.42.42.2(pid=21598): stderr: | 20221209040228906 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209040228906 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209040228906 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209040228906 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209040228906 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209040228906 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209040228919 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209040228928 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209040228928 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209040228928 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:02:32.003703 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21597): Terminating (SIGTERM) 04:02:32.044520 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21600): Terminating (SIGTERM) 04:02:32.085073 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21603): Terminating (SIGTERM) 04:02:32.127556 --- ParallelTerminationStrategy: PID 21597 died... 04:02:32.147591 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21597): Terminated: ok {rc=0} 04:02:32.192296 --- ParallelTerminationStrategy: PID 21600 died... 04:02:32.211983 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21600): Terminated: ok {rc=0} 04:02:32.257134 --- ParallelTerminationStrategy: PID 21603 died... 04:02:32.275924 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21603): Terminated: ok {rc=0} 04:02:32.360906 bus /gobi_0: Setting Powered False 04:02:33.459872 bus /gobi_0: Setting Powered False 04:02:34.576191 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2354 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 dynts:trx-b200+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 04:02:35.826726 tst dynts:trx-b200+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:02:35.832628 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 04:02:35.865301 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 04:02:35.899375 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 04:02:35.951937 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 04:02:35.984563 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 04:02:36.018416 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 04:02:36.577542 tst dynts:trx-b200+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2354 dynts:trx-b200+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 04:02:36.583142 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:02:36.594767 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 04:02:36.668465 tst switch_tch_pdch.py: using LAC 18932 04:02:36.793242 tst switch_tch_pdch.py: using RAC 62 04:02:36.917195 tst switch_tch_pdch.py: using CellId 18932 04:02:37.043049 tst switch_tch_pdch.py: using BVCI 18933 04:02:37.159137 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:02:37.170509 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:02:37.181719 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:02:37.193138 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:02:37.204495 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:02:37.215899 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:02:37.227530 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:02:37.239018 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 04:02:37.354931 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 04:02:37.470227 tst switch_tch_pdch.py:51: start network... 04:02:37.667826 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:02:38.129828 run create_hlr_db(pid=21614): Launched 04:02:38.251649 bus /gobi_6: Setting Powered False 04:02:39.314626 run create_hlr_db(pid=21614): Terminated: ok {rc=0} 04:02:39.713750 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21616): Launched 04:02:40.010561 run osmo-hlr_10.42.42.2(pid=21617): Launched 04:02:40.123512 run osmo-stp_10.42.42.5: Starting osmo-stp 04:02:40.608574 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21619): Launched 04:02:40.904845 run osmo-stp_10.42.42.5(pid=21620): Launched 04:02:41.017829 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:02:41.502543 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21622): Launched 04:02:41.615444 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:02:41.865117 run patchelf(pid=21623): Launched 04:02:42.029984 run osmo-stp_10.42.42.5(pid=21620): ERR: Terminated: ERROR {rc=1} [trial-2354↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21620)] 04:02:42.154875 run osmo-stp_10.42.42.5(pid=21620): stdout: | (launched: 2022-12-09_04:02:40.850566) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:02:42.281627 run osmo-stp_10.42.42.5(pid=21620): stderr: | 20221209040241020 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040241020 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040241020 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040241021 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040241022 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040241022 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040241022 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:02:42.408290 run osmo-stp_10.42.42.5(pid=21620): stdout: | (launched: 2022-12-09_04:02:40.850566) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:02:42.529649 run osmo-stp_10.42.42.5(pid=21620): stderr: | 20221209040241020 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040241020 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040241020 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040241021 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040241022 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040241022 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040241022 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:02:42.674067 run patchelf(pid=21623): Terminating (SIGINT) 04:02:42.840628 run patchelf(pid=21623): Terminated: ok {rc=0} 04:02:42.960678 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=21620): Process ended prematurely: osmo-stp_10.42.42.5(pid=21620) [trial-2354↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21620)] [trial-2354↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 04:02:42.969661 tst switch_tch_pdch.py:54: Test FAILED (6.4 sec) 04:02:42.996269 run osmo-hlr_10.42.42.2(pid=21617): ERR: Terminated: ERROR {rc=237} [trial-2354↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21617)] 04:02:43.044110 run osmo-hlr_10.42.42.2(pid=21617): stdout: | (launched: 2022-12-09_04:02:39.955841) 04:02:43.093755 run osmo-hlr_10.42.42.2(pid=21617): stderr: | 20221209040240132 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209040240132 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209040240132 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209040240132 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209040240132 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209040240132 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209040240144 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/dynts:trx-b200+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209040240153 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209040240153 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209040240153 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:02:43.143859 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21616): Terminating (SIGTERM) 04:02:43.183540 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21619): Terminating (SIGTERM) 04:02:43.223051 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21622): Terminating (SIGTERM) 04:02:43.262816 --- ParallelTerminationStrategy: PID 21616 died... 04:02:43.281915 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21616): Terminated: ok {rc=0} 04:02:43.325620 --- ParallelTerminationStrategy: PID 21619 died... 04:02:43.344229 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21619): Terminated: ok {rc=0} 04:02:43.387980 --- ParallelTerminationStrategy: PID 21622 died... 04:02:43.406604 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21622): Terminated: ok {rc=0} 04:02:43.492348 bus /gobi_0: Setting Powered False 04:02:44.591903 bus /gobi_0: Setting Powered False 04:02:45.707337 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2354 dynts:trx-b200+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 nitb_sms:trx-sysmocell5000 --------------------------------------------------------------------- 04:02:47.003253 tst nitb_sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:02:47.009424 tst nitb_sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 04:02:47.051741 tst nitb_sms:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 04:02:47.059456 tst nitb_sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 04:02:47.121391 tst nitb_sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 04:02:47.162482 tst nitb_sms:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 04:02:47.169932 tst nitb_sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 04:02:47.697742 tst nitb_sms:trx-sysmocell5000: RESERVED RESOURCES for nitb_sms: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 nitb_sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 04:02:47.702516 tst nitb_sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 04:02:47.713333 tst nitb_sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 04:02:47.761125 tst mo_mt_sms.py: using LAC 18933 04:02:47.876922 tst mo_mt_sms.py: using RAC 63 04:02:48.002472 tst mo_mt_sms.py: using CellId 18933 04:02:48.128166 tst mo_mt_sms.py: using BVCI 18934 04:02:48.243691 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 04:02:48.358399 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 04:02:48.471386 tst mo_mt_sms.py:9: start nitb and bts... 04:02:48.669353 run osmo-nitb_10.42.42.2: Starting osmo-nitb 04:02:49.272510 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=21627): Launched 04:02:49.567606 run osmo-nitb_10.42.42.2(pid=21628): Launched 04:02:49.732343 run osmo-nitb_10.42.42.2(pid=21628): ERR: Terminated: ERROR {rc=2} [trial-2354↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21628)] 04:02:49.864778 run osmo-nitb_10.42.42.2(pid=21628): stdout: | (launched: 2022-12-09_04:02:49.513418) 04:02:49.999012 run osmo-nitb_10.42.42.2(pid=21628): stderr: | (launched: 2022-12-09_04:02:49.557314) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:02:50.133680 run osmo-nitb_10.42.42.2(pid=21628): stdout: | (launched: 2022-12-09_04:02:49.513418) 04:02:50.262643 run osmo-nitb_10.42.42.2(pid=21628): stderr: | (launched: 2022-12-09_04:02:49.557314) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f4d467d3268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=21628): Process ended prematurely: osmo-nitb_10.42.42.2(pid=21628) [trial-2354↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21628)] 04:02:50.679604 tst osmo-nitb_10.42.42.2(pid=21628): stdout: | (launched: 2022-12-09_04:02:49.513418) 04:02:50.799746 tst osmo-nitb_10.42.42.2(pid=21628): stderr: | (launched: 2022-12-09_04:02:49.557314) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:02:50.940216 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=21628): Process ended prematurely: osmo-nitb_10.42.42.2(pid=21628) [trial-2354↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21628)] [trial-2354↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11] 04:02:50.948791 tst mo_mt_sms.py:11: Test FAILED (3.2 sec) 04:02:50.955522 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=21627): Terminating (SIGTERM) 04:02:51.164384 --- ParallelTerminationStrategy: PID 21627 died... 04:02:51.185332 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=21627): Terminated: ok {rc=0} 04:02:51.272424 bus /sierra_3: Setting Powered False 04:02:52.374427 bus /sierra_3: Setting Powered False 04:02:53.492520 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 nitb_sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 sms:trx-sysmocell5000 --------------------------------------------------------------------- 04:02:54.691997 tst sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:02:54.696146 tst sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 04:02:54.730692 tst sms:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 04:02:54.757588 tst sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 04:02:54.813118 tst sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 04:02:54.847368 tst sms:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 04:02:54.873403 tst sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 04:02:55.416125 tst sms:trx-sysmocell5000: RESERVED RESOURCES for sms: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 04:02:55.420870 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:02:55.431861 tst sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 04:02:55.485176 tst mo_mt_sms.py: using LAC 18934 04:02:55.602244 tst mo_mt_sms.py: using RAC 64 04:02:55.719146 tst mo_mt_sms.py: using CellId 18934 04:02:55.839683 tst mo_mt_sms.py: using BVCI 18935 04:02:55.949057 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:02:55.959680 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:02:55.970249 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:02:55.981210 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:02:55.992140 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:02:56.003076 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 04:02:56.121902 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 04:02:56.238885 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:02:56.733530 run create_hlr_db(pid=21632): Launched 04:02:56.856100 bus /sierra_2: Setting Powered False 04:02:57.920074 run create_hlr_db(pid=21632): Terminated: ok {rc=0} 04:02:58.346185 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21634): Launched 04:02:58.642452 run osmo-hlr_10.42.42.2(pid=21635): Launched 04:02:58.755920 run osmo-stp_10.42.42.5: Starting osmo-stp 04:02:59.282702 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21637): Launched 04:02:59.577752 run osmo-stp_10.42.42.5(pid=21638): Launched 04:02:59.691230 run osmo-msc_10.42.42.6: Starting osmo-msc 04:03:00.228914 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21640): Launched 04:03:00.524306 run osmo-msc_10.42.42.6(pid=21641): Launched 04:03:00.690176 run osmo-stp_10.42.42.5(pid=21638): ERR: Terminated: ERROR {rc=1} [trial-2354↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21638)] 04:03:00.816243 run osmo-stp_10.42.42.5(pid=21638): stdout: | (launched: 2022-12-09_04:02:59.523289) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:03:00.967372 run osmo-stp_10.42.42.5(pid=21638): stderr: | 20221209040259691 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040259691 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040259692 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040259692 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040259693 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040259693 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040259693 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:03:01.102453 run osmo-stp_10.42.42.5(pid=21638): stdout: | (launched: 2022-12-09_04:02:59.523289) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:03:01.239509 run osmo-stp_10.42.42.5(pid=21638): stderr: | 20221209040259691 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040259691 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040259692 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040259692 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040259693 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040259693 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040259693 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:03:01.396263 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=21638): Process ended prematurely: osmo-stp_10.42.42.5(pid=21638) [trial-2354↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21638)] [trial-2354↪sms:trx-sysmocell5000↪mo_mt_sms.py:16] 04:03:01.406389 tst mo_mt_sms.py:16: Test FAILED (6.0 sec) 04:03:01.438715 run osmo-hlr_10.42.42.2(pid=21635): ERR: Terminated: ERROR {rc=237} [trial-2354↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21635)] 04:03:01.492654 run osmo-hlr_10.42.42.2(pid=21635): stdout: | (launched: 2022-12-09_04:02:58.588212) 04:03:01.548409 run osmo-hlr_10.42.42.2(pid=21635): stderr: | 20221209040258761 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209040258761 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209040258761 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209040258761 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209040258761 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209040258761 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209040258773 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/sms:trx-sysmocell5000/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209040258782 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209040258782 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209040258782 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:03:01.625848 run osmo-msc_10.42.42.6(pid=21641): ERR: Terminated: ERROR {rc=2} [trial-2354↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21641)] 04:03:01.679678 run osmo-msc_10.42.42.6(pid=21641): stdout: | (launched: 2022-12-09_04:03:00.469950) 04:03:01.735412 run osmo-msc_10.42.42.6(pid=21641): stderr: | 20221209040300739 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209040300740 DLGLOBAL DEBUG validating counter group 0x7f9ee691dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209040300740 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209040300740 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209040300740 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209040300740 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209040300743 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209040300743 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209040300743 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209040300744 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:03:01.792135 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21634): Terminating (SIGTERM) 04:03:01.839167 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21637): Terminating (SIGTERM) 04:03:01.887247 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21640): Terminating (SIGTERM) 04:03:01.933914 --- ParallelTerminationStrategy: PID 21634 died... 04:03:01.955138 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21634): Terminated: ok {rc=0} 04:03:02.007352 --- ParallelTerminationStrategy: PID 21637 died... 04:03:02.029260 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21637): Terminated: ok {rc=0} 04:03:02.079762 --- ParallelTerminationStrategy: PID 21640 died... 04:03:02.100684 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21640): Terminated: ok {rc=0} 04:03:02.195527 bus /sierra_3: Setting Powered False 04:03:03.294103 bus /sierra_3: Setting Powered False 04:03:04.410905 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 nitb_ussd:trx-sysmocell5000 --------------------------------------------------------------------- 04:03:05.649815 tst nitb_ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:03:05.654123 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 04:03:05.689412 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 04:03:05.696418 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 04:03:05.732438 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 04:03:05.766271 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 04:03:05.773141 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 04:03:06.292296 tst nitb_ussd:trx-sysmocell5000: RESERVED RESOURCES for nitb_ussd: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2354 nitb_ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 04:03:06.297562 tst nitb_ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 04:03:06.308370 tst nitb_ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 04:03:06.357165 tst assert_extension.py: using LAC 18935 04:03:06.472719 tst assert_extension.py: using RAC 65 04:03:06.587802 tst assert_extension.py: using CellId 18935 04:03:06.703044 tst assert_extension.py: using BVCI 18936 04:03:06.811672 tst nitb_ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 04:03:06.925150 tst assert_extension.py:10: start nitb and bts... 04:03:07.122951 run osmo-nitb_10.42.42.2: Starting osmo-nitb 04:03:07.730486 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=21647): Launched 04:03:08.027269 run osmo-nitb_10.42.42.2(pid=21648): Launched 04:03:08.192577 run osmo-nitb_10.42.42.2(pid=21648): ERR: Terminated: ERROR {rc=2} [trial-2354↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21648)] 04:03:08.326208 run osmo-nitb_10.42.42.2(pid=21648): stdout: | (launched: 2022-12-09_04:03:07.971898) 04:03:08.461177 run osmo-nitb_10.42.42.2(pid=21648): stderr: | (launched: 2022-12-09_04:03:08.015796) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:03:08.595617 run osmo-nitb_10.42.42.2(pid=21648): stdout: | (launched: 2022-12-09_04:03:07.971898) 04:03:08.724823 run osmo-nitb_10.42.42.2(pid=21648): stderr: | (launched: 2022-12-09_04:03:08.015796) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f4d467d3268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=21648): Process ended prematurely: osmo-nitb_10.42.42.2(pid=21648) [trial-2354↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21648)] 04:03:09.140379 tst osmo-nitb_10.42.42.2(pid=21648): stdout: | (launched: 2022-12-09_04:03:07.971898) 04:03:09.262137 tst osmo-nitb_10.42.42.2(pid=21648): stderr: | (launched: 2022-12-09_04:03:08.015796) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:03:09.403012 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=21648): Process ended prematurely: osmo-nitb_10.42.42.2(pid=21648) [trial-2354↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21648)] [trial-2354↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12] 04:03:09.411573 tst assert_extension.py:12: Test FAILED (3.1 sec) 04:03:09.418293 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=21647): Terminating (SIGTERM) 04:03:09.627443 --- ParallelTerminationStrategy: PID 21647 died... 04:03:09.648451 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=21647): Terminated: ok {rc=0} 04:03:09.735413 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 nitb_ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 ussd:trx-sysmocell5000 --------------------------------------------------------------------- 04:03:10.917948 tst ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:03:10.922869 tst ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 04:03:10.958208 tst ussd:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 04:03:10.985542 tst ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 04:03:11.022220 tst ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 04:03:11.057599 tst ussd:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 04:03:11.085525 tst ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 04:03:11.614079 tst ussd:trx-sysmocell5000: RESERVED RESOURCES for ussd: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2354 ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 04:03:11.619946 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:03:11.631247 tst ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 04:03:11.679497 tst assert_extension.py: using LAC 18936 04:03:11.797783 tst assert_extension.py: using RAC 66 04:03:11.924862 tst assert_extension.py: using CellId 18936 04:03:12.049463 tst assert_extension.py: using BVCI 18937 04:03:12.160429 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:03:12.171323 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:03:12.182096 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:03:12.192894 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:03:12.203692 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:03:12.214502 tst ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 04:03:12.326421 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:03:12.821311 run create_hlr_db(pid=21652): Launched 04:03:12.942900 bus /sierra_2: Setting Powered False 04:03:14.006179 run create_hlr_db(pid=21652): Terminated: ok {rc=0} 04:03:14.432056 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21654): Launched 04:03:14.729729 run osmo-hlr_10.42.42.2(pid=21655): Launched 04:03:14.843132 run osmo-stp_10.42.42.5: Starting osmo-stp 04:03:15.467672 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21657): Launched 04:03:15.758800 run osmo-stp_10.42.42.5(pid=21658): Launched 04:03:15.924666 run osmo-msc_10.42.42.6: Starting osmo-msc 04:03:16.587616 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21660): Launched 04:03:16.922685 run osmo-msc_10.42.42.6(pid=21661): Launched 04:03:17.241970 run osmo-stp_10.42.42.5(pid=21658): ERR: Terminated: ERROR {rc=1} [trial-2354↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21658)] 04:03:17.382826 run osmo-stp_10.42.42.5(pid=21658): stdout: | (launched: 2022-12-09_04:03:15.705544) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:03:17.521601 run osmo-stp_10.42.42.5(pid=21658): stderr: | 20221209040315928 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040315928 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040315928 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040315937 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040315938 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040315938 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040315938 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:03:17.657484 run osmo-stp_10.42.42.5(pid=21658): stdout: | (launched: 2022-12-09_04:03:15.705544) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:03:17.783026 run osmo-stp_10.42.42.5(pid=21658): stderr: | 20221209040315928 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040315928 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040315928 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040315937 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040315938 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040315938 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040315938 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:03:17.932623 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=21658): Process ended prematurely: osmo-stp_10.42.42.5(pid=21658) [trial-2354↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21658)] [trial-2354↪ussd:trx-sysmocell5000↪assert_extension.py:17] 04:03:17.942257 tst assert_extension.py:17: Test FAILED (6.3 sec) 04:03:17.970978 run osmo-hlr_10.42.42.2(pid=21655): ERR: Terminated: ERROR {rc=237} [trial-2354↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21655)] 04:03:18.022474 run osmo-hlr_10.42.42.2(pid=21655): stdout: | (launched: 2022-12-09_04:03:14.675147) 04:03:18.075834 run osmo-hlr_10.42.42.2(pid=21655): stderr: | 20221209040314852 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209040314852 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209040314852 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209040314852 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209040314852 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209040314852 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209040314864 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/ussd:trx-sysmocell5000/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209040314875 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209040314875 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209040314875 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:03:18.149862 run osmo-msc_10.42.42.6(pid=21661): ERR: Terminated: ERROR {rc=2} [trial-2354↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21661)] 04:03:18.201696 run osmo-msc_10.42.42.6(pid=21661): stdout: | (launched: 2022-12-09_04:03:16.863374) 04:03:18.254672 run osmo-msc_10.42.42.6(pid=21661): stderr: | 20221209040317386 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209040317387 DLGLOBAL DEBUG validating counter group 0x7f41c7a71c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209040317387 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209040317387 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209040317387 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209040317387 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209040317389 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209040317389 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209040317389 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209040317389 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:03:18.308543 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21654): Terminating (SIGTERM) 04:03:18.351747 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21657): Terminating (SIGTERM) 04:03:18.394819 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21660): Terminating (SIGTERM) 04:03:18.437845 --- ParallelTerminationStrategy: PID 21654 died... 04:03:18.458227 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21654): Terminated: ok {rc=0} 04:03:18.506007 --- ParallelTerminationStrategy: PID 21657 died... 04:03:18.525958 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21657): Terminated: ok {rc=0} 04:03:18.573722 --- ParallelTerminationStrategy: PID 21660 died... 04:03:18.593608 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21660): Terminated: ok {rc=0} 04:03:18.683029 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 04:03:19.899619 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:03:19.906820 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 04:03:19.942175 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 04:03:19.969810 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 04:03:20.023363 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 04:03:20.058000 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 04:03:20.085304 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 04:03:20.635932 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 04:03:20.688437 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:03:20.700227 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 04:03:20.772385 tst mo_mt_call.py: using LAC 18937 04:03:20.895535 tst mo_mt_call.py: using RAC 67 04:03:21.012749 tst mo_mt_call.py: using CellId 18937 04:03:21.127999 tst mo_mt_call.py: using BVCI 18938 04:03:21.244740 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:03:21.256459 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:03:21.268084 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:03:21.280222 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:03:21.292534 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:03:21.304577 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 04:03:21.425840 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 04:03:21.541812 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:03:22.003631 run create_hlr_db(pid=21666): Launched 04:03:22.126361 bus /sierra_2: Setting Powered False 04:03:23.186493 run create_hlr_db(pid=21666): Terminated: ok {rc=0} 04:03:23.623810 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21668): Launched 04:03:23.943615 run osmo-hlr_10.42.42.2(pid=21669): Launched 04:03:24.066004 run osmo-stp_10.42.42.5: Starting osmo-stp 04:03:24.611492 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21671): Launched 04:03:24.931082 run osmo-stp_10.42.42.5(pid=21672): Launched 04:03:25.053432 run osmo-msc_10.42.42.6: Starting osmo-msc 04:03:25.631271 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21674): Launched 04:03:25.951578 run osmo-msc_10.42.42.6(pid=21675): Launched 04:03:26.130997 run osmo-stp_10.42.42.5(pid=21672): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21672)] 04:03:26.266824 run osmo-stp_10.42.42.5(pid=21672): stdout: | (launched: 2022-12-09_04:03:24.872933) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:03:26.402675 run osmo-stp_10.42.42.5(pid=21672): stderr: | 20221209040325064 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040325064 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040325065 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040325065 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040325065 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040325066 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040325066 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:03:26.537626 run osmo-stp_10.42.42.5(pid=21672): stdout: | (launched: 2022-12-09_04:03:24.872933) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:03:26.665334 run osmo-stp_10.42.42.5(pid=21672): stderr: | 20221209040325064 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040325064 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040325065 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040325065 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040325065 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040325066 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040325066 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:03:26.817765 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21672): Process ended prematurely: osmo-stp_10.42.42.5(pid=21672) [trial-2354↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21672)] [trial-2354↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 04:03:26.827224 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 04:03:26.855352 run osmo-hlr_10.42.42.2(pid=21669): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21669)] 04:03:26.906108 run osmo-hlr_10.42.42.2(pid=21669): stdout: | (launched: 2022-12-09_04:03:23.885807) 04:03:26.958515 run osmo-hlr_10.42.42.2(pid=21669): stderr: | 20221209040324084 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209040324084 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209040324084 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209040324084 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209040324084 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209040324084 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209040324099 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209040324107 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209040324107 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209040324108 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:03:27.031597 run osmo-msc_10.42.42.6(pid=21675): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21675)] 04:03:27.082438 run osmo-msc_10.42.42.6(pid=21675): stdout: | (launched: 2022-12-09_04:03:25.893424) 04:03:27.135065 run osmo-msc_10.42.42.6(pid=21675): stderr: | 20221209040326213 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209040326213 DLGLOBAL DEBUG validating counter group 0x7f8a6555cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209040326213 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209040326213 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209040326213 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209040326214 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209040326215 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209040326216 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209040326216 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209040326216 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:03:27.188172 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21668): Terminating (SIGTERM) 04:03:27.230490 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21671): Terminating (SIGTERM) 04:03:27.272768 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21674): Terminating (SIGTERM) 04:03:27.315793 --- ParallelTerminationStrategy: PID 21668 died... 04:03:27.335867 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21668): Terminated: ok {rc=0} 04:03:27.382741 --- ParallelTerminationStrategy: PID 21671 died... 04:03:27.402448 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21671): Terminated: ok {rc=0} 04:03:27.449200 --- ParallelTerminationStrategy: PID 21674 died... 04:03:27.468655 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21674): Terminated: ok {rc=0} 04:03:27.559060 bus /sierra_3: Setting Powered False 04:03:28.658733 bus /sierra_3: Setting Powered False 04:03:29.777962 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2354 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 04:03:30.955531 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:03:30.968570 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 04:03:31.045434 tst mo_mt_call_osmux.py: using LAC 18938 04:03:31.165186 tst mo_mt_call_osmux.py: using RAC 68 04:03:31.291730 tst mo_mt_call_osmux.py: using CellId 18938 04:03:31.420273 tst mo_mt_call_osmux.py: using BVCI 18939 04:03:31.539825 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:03:31.552460 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:03:31.565343 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:03:31.578867 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:03:31.593670 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:03:31.607404 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 04:03:31.729554 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 04:03:31.867722 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:03:32.377392 run create_hlr_db(pid=21677): Launched 04:03:32.501371 bus /sierra_2: Setting Powered False 04:03:33.565388 run create_hlr_db(pid=21677): Terminated: ok {rc=0} 04:03:33.993602 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21679): Launched 04:03:34.293679 run osmo-hlr_10.42.42.2(pid=21680): Launched 04:03:34.407781 run osmo-stp_10.42.42.5: Starting osmo-stp 04:03:34.921661 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21682): Launched 04:03:35.222128 run osmo-stp_10.42.42.5(pid=21683): Launched 04:03:35.335789 run osmo-msc_10.42.42.6: Starting osmo-msc 04:03:35.874246 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21685): Launched 04:03:36.173210 run osmo-msc_10.42.42.6(pid=21686): Launched 04:03:36.340541 run osmo-stp_10.42.42.5(pid=21683): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21683)] 04:03:36.466751 run osmo-stp_10.42.42.5(pid=21683): stdout: | (launched: 2022-12-09_04:03:35.167290) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:03:36.592896 run osmo-stp_10.42.42.5(pid=21683): stderr: | 20221209040335336 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040335337 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040335337 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040335337 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040335338 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040335338 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040335338 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:03:36.717319 run osmo-stp_10.42.42.5(pid=21683): stdout: | (launched: 2022-12-09_04:03:35.167290) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:03:36.835973 run osmo-stp_10.42.42.5(pid=21683): stderr: | 20221209040335336 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040335337 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040335337 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040335337 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040335338 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040335338 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040335338 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:03:36.978058 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21683): Process ended prematurely: osmo-stp_10.42.42.5(pid=21683) [trial-2354↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21683)] [trial-2354↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 04:03:36.986980 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 04:03:37.013426 run osmo-hlr_10.42.42.2(pid=21680): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21680)] 04:03:37.061226 run osmo-hlr_10.42.42.2(pid=21680): stdout: | (launched: 2022-12-09_04:03:34.238581) 04:03:37.111315 run osmo-hlr_10.42.42.2(pid=21680): stderr: | 20221209040334414 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209040334414 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209040334414 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209040334414 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209040334414 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209040334414 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209040334426 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209040334436 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209040334436 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209040334436 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:03:37.180196 run osmo-msc_10.42.42.6(pid=21686): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21686)] 04:03:37.227516 run osmo-msc_10.42.42.6(pid=21686): stdout: | (launched: 2022-12-09_04:03:36.117916) 04:03:37.276603 run osmo-msc_10.42.42.6(pid=21686): stderr: | 20221209040336388 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209040336388 DLGLOBAL DEBUG validating counter group 0x7f1b1d791c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209040336388 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209040336388 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209040336389 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209040336389 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209040336391 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209040336391 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209040336392 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209040336392 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:03:37.326133 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21679): Terminating (SIGTERM) 04:03:37.365631 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21682): Terminating (SIGTERM) 04:03:37.405172 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21685): Terminating (SIGTERM) 04:03:37.445029 --- ParallelTerminationStrategy: PID 21679 died... 04:03:37.464013 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21679): Terminated: ok {rc=0} 04:03:37.508566 --- ParallelTerminationStrategy: PID 21682 died... 04:03:37.527322 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21682): Terminated: ok {rc=0} 04:03:37.571190 --- ParallelTerminationStrategy: PID 21685 died... 04:03:37.589923 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21685): Terminated: ok {rc=0} 04:03:37.676300 bus /sierra_3: Setting Powered False 04:03:38.777213 bus /sierra_3: Setting Powered False 04:03:39.893076 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 04:03:41.144096 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:03:41.150570 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 04:03:41.183727 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 04:03:41.209905 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 04:03:41.262177 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 04:03:41.295659 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 04:03:41.321910 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 04:03:41.872553 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 04:03:41.920234 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:03:41.931365 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 04:03:42.000785 tst mo_mt_call.py: using LAC 18939 04:03:42.128597 tst mo_mt_call.py: using RAC 69 04:03:42.246251 tst mo_mt_call.py: using CellId 18939 04:03:42.362800 tst mo_mt_call.py: using BVCI 18940 04:03:42.470416 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:03:42.481495 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:03:42.492512 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:03:42.503453 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:03:42.514468 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:03:42.525401 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 04:03:42.640915 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 04:03:42.755243 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:03:43.221701 run create_hlr_db(pid=21691): Launched 04:03:43.344718 bus /sierra_2: Setting Powered False 04:03:44.403468 run create_hlr_db(pid=21691): Terminated: ok {rc=0} 04:03:44.840517 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21693): Launched 04:03:45.141396 run osmo-hlr_10.42.42.2(pid=21694): Launched 04:03:45.255622 run osmo-stp_10.42.42.5: Starting osmo-stp 04:03:45.769595 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21696): Launched 04:03:46.129945 run osmo-stp_10.42.42.5(pid=21697): Launched 04:03:46.379143 run osmo-msc_10.42.42.6: Starting osmo-msc 04:03:47.046467 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21699): Launched 04:03:47.379590 run osmo-msc_10.42.42.6(pid=21700): Launched 04:03:47.561370 run osmo-stp_10.42.42.5(pid=21697): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21697)] 04:03:47.698474 run osmo-stp_10.42.42.5(pid=21697): stdout: | (launched: 2022-12-09_04:03:46.067354) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:03:47.836669 run osmo-stp_10.42.42.5(pid=21697): stderr: | 20221209040346360 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040346360 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040346360 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040346369 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040346370 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040346370 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040346370 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:03:47.972279 run osmo-stp_10.42.42.5(pid=21697): stdout: | (launched: 2022-12-09_04:03:46.067354) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:03:48.100699 run osmo-stp_10.42.42.5(pid=21697): stderr: | 20221209040346360 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040346360 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040346360 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040346369 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040346370 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040346370 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040346370 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:03:48.255011 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21697): Process ended prematurely: osmo-stp_10.42.42.5(pid=21697) [trial-2354↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21697)] [trial-2354↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 04:03:48.264909 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 04:03:48.293505 run osmo-hlr_10.42.42.2(pid=21694): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21694)] 04:03:48.344811 run osmo-hlr_10.42.42.2(pid=21694): stdout: | (launched: 2022-12-09_04:03:45.085626) 04:03:48.397505 run osmo-hlr_10.42.42.2(pid=21694): stderr: | 20221209040345263 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209040345263 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209040345263 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209040345263 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209040345263 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209040345263 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209040345275 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209040345286 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209040345286 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209040345287 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:03:48.470603 run osmo-msc_10.42.42.6(pid=21700): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21700)] 04:03:48.521177 run osmo-msc_10.42.42.6(pid=21700): stdout: | (launched: 2022-12-09_04:03:47.321025) 04:03:48.573514 run osmo-msc_10.42.42.6(pid=21700): stderr: | 20221209040347640 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209040347640 DLGLOBAL DEBUG validating counter group 0x7f0b84e24c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209040347640 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209040347640 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209040347641 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209040347641 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209040347643 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209040347643 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209040347643 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209040347643 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:03:48.626357 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21693): Terminating (SIGTERM) 04:03:48.668733 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21696): Terminating (SIGTERM) 04:03:48.711214 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21699): Terminating (SIGTERM) 04:03:48.753686 --- ParallelTerminationStrategy: PID 21693 died... 04:03:48.773638 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21693): Terminated: ok {rc=0} 04:03:48.820707 --- ParallelTerminationStrategy: PID 21696 died... 04:03:48.840740 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21696): Terminated: ok {rc=0} 04:03:48.887487 --- ParallelTerminationStrategy: PID 21699 died... 04:03:48.907160 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21699): Terminated: ok {rc=0} 04:03:48.995486 bus /sierra_3: Setting Powered False 04:03:50.095389 bus /sierra_3: Setting Powered False 04:03:51.213599 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2354 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 04:03:52.363461 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:03:52.375681 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 04:03:52.447301 tst mo_mt_call_osmux.py: using LAC 18940 04:03:52.573943 tst mo_mt_call_osmux.py: using RAC 70 04:03:52.702253 tst mo_mt_call_osmux.py: using CellId 18940 04:03:52.829368 tst mo_mt_call_osmux.py: using BVCI 18941 04:03:52.945723 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:03:52.957556 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:03:52.968849 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:03:52.980581 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:03:52.992405 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:03:53.004278 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 04:03:53.123851 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 04:03:53.239896 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:03:53.736741 run create_hlr_db(pid=21702): Launched 04:03:53.858904 bus /sierra_2: Setting Powered False 04:03:54.922843 run create_hlr_db(pid=21702): Terminated: ok {rc=0} 04:03:55.369216 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21704): Launched 04:03:55.689105 run osmo-hlr_10.42.42.2(pid=21705): Launched 04:03:55.811578 run osmo-stp_10.42.42.5: Starting osmo-stp 04:03:56.367279 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21707): Launched 04:03:56.689269 run osmo-stp_10.42.42.5(pid=21708): Launched 04:03:56.812327 run osmo-msc_10.42.42.6: Starting osmo-msc 04:03:57.392924 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21710): Launched 04:03:57.714516 run osmo-msc_10.42.42.6(pid=21711): Launched 04:03:57.893713 run osmo-stp_10.42.42.5(pid=21708): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21708)] 04:03:58.029256 run osmo-stp_10.42.42.5(pid=21708): stdout: | (launched: 2022-12-09_04:03:56.630628) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:03:58.166237 run osmo-stp_10.42.42.5(pid=21708): stderr: | 20221209040356821 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040356821 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040356822 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040356822 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040356822 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040356822 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040356823 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:03:58.302042 run osmo-stp_10.42.42.5(pid=21708): stdout: | (launched: 2022-12-09_04:03:56.630628) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:03:58.430644 run osmo-stp_10.42.42.5(pid=21708): stderr: | 20221209040356821 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040356821 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040356822 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040356822 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040356822 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040356822 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040356823 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:03:58.584111 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21708): Process ended prematurely: osmo-stp_10.42.42.5(pid=21708) [trial-2354↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21708)] [trial-2354↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 04:03:58.593963 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 04:03:58.622089 run osmo-hlr_10.42.42.2(pid=21705): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21705)] 04:03:58.673207 run osmo-hlr_10.42.42.2(pid=21705): stdout: | (launched: 2022-12-09_04:03:55.630713) 04:03:58.725707 run osmo-hlr_10.42.42.2(pid=21705): stderr: | 20221209040355827 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209040355827 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209040355827 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209040355827 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209040355828 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209040355828 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209040355845 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209040355853 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209040355853 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209040355853 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:03:58.798608 run osmo-msc_10.42.42.6(pid=21711): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21711)] 04:03:58.849181 run osmo-msc_10.42.42.6(pid=21711): stdout: | (launched: 2022-12-09_04:03:57.656190) 04:03:58.901388 run osmo-msc_10.42.42.6(pid=21711): stderr: | 20221209040357976 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209040357976 DLGLOBAL DEBUG validating counter group 0x7f5d2f325c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209040357977 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209040357977 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209040357977 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209040357977 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209040357979 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209040357979 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209040357979 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209040357979 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:03:58.954082 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21704): Terminating (SIGTERM) 04:03:58.996208 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21707): Terminating (SIGTERM) 04:03:59.038484 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21710): Terminating (SIGTERM) 04:03:59.080667 --- ParallelTerminationStrategy: PID 21704 died... 04:03:59.100672 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21704): Terminated: ok {rc=0} 04:03:59.147704 --- ParallelTerminationStrategy: PID 21707 died... 04:03:59.167338 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21707): Terminated: ok {rc=0} 04:03:59.214002 --- ParallelTerminationStrategy: PID 21710 died... 04:03:59.233523 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21710): Terminated: ok {rc=0} 04:03:59.321688 bus /sierra_3: Setting Powered False 04:04:00.419183 bus /sierra_3: Setting Powered False 04:04:01.533325 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 04:04:02.788206 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:04:02.795867 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 04:04:02.831307 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 04:04:02.860151 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 04:04:02.911280 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 04:04:02.944732 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 04:04:02.971144 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 04:04:03.523633 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 04:04:03.571888 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:04:03.583324 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 04:04:03.653752 tst mo_mt_call.py: using LAC 18941 04:04:03.772758 tst mo_mt_call.py: using RAC 71 04:04:03.890511 tst mo_mt_call.py: using CellId 18941 04:04:04.009446 tst mo_mt_call.py: using BVCI 18942 04:04:04.117562 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:04:04.128571 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:04:04.139514 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:04:04.150597 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:04:04.161869 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:04:04.172936 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 04:04:04.287826 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 04:04:04.402808 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:04:04.866723 run create_hlr_db(pid=21716): Launched 04:04:04.990410 bus /sierra_2: Setting Powered False 04:04:06.050413 run create_hlr_db(pid=21716): Terminated: ok {rc=0} 04:04:06.488850 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21718): Launched 04:04:06.809689 run osmo-hlr_10.42.42.2(pid=21719): Launched 04:04:06.931895 run osmo-stp_10.42.42.5: Starting osmo-stp 04:04:07.482652 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21721): Launched 04:04:07.803135 run osmo-stp_10.42.42.5(pid=21722): Launched 04:04:07.926080 run osmo-msc_10.42.42.6: Starting osmo-msc 04:04:08.505502 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21724): Launched 04:04:08.827305 run osmo-msc_10.42.42.6(pid=21725): Launched 04:04:09.006748 run osmo-stp_10.42.42.5(pid=21722): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21722)] 04:04:09.142470 run osmo-stp_10.42.42.5(pid=21722): stdout: | (launched: 2022-12-09_04:04:07.744865) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:04:09.279195 run osmo-stp_10.42.42.5(pid=21722): stderr: | 20221209040407937 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040407937 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040407937 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040407937 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040407938 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040407938 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040407938 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:04:09.415474 run osmo-stp_10.42.42.5(pid=21722): stdout: | (launched: 2022-12-09_04:04:07.744865) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:04:09.543808 run osmo-stp_10.42.42.5(pid=21722): stderr: | 20221209040407937 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040407937 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040407937 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040407937 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040407938 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040407938 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040407938 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:04:09.697184 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21722): Process ended prematurely: osmo-stp_10.42.42.5(pid=21722) [trial-2354↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21722)] [trial-2354↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 04:04:09.706825 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 04:04:09.735255 run osmo-hlr_10.42.42.2(pid=21719): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21719)] 04:04:09.785828 run osmo-hlr_10.42.42.2(pid=21719): stdout: | (launched: 2022-12-09_04:04:06.751147) 04:04:09.838633 run osmo-hlr_10.42.42.2(pid=21719): stderr: | 20221209040406949 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209040406949 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209040406949 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209040406949 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209040406949 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209040406949 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209040406960 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209040406968 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209040406969 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209040406969 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:04:09.911833 run osmo-msc_10.42.42.6(pid=21725): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21725)] 04:04:09.962371 run osmo-msc_10.42.42.6(pid=21725): stdout: | (launched: 2022-12-09_04:04:08.768563) 04:04:10.014683 run osmo-msc_10.42.42.6(pid=21725): stderr: | 20221209040409089 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209040409089 DLGLOBAL DEBUG validating counter group 0x7f9afc9c9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209040409089 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209040409089 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209040409089 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209040409090 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209040409091 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209040409092 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209040409092 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209040409092 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:04:10.067793 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21718): Terminating (SIGTERM) 04:04:10.110179 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21721): Terminating (SIGTERM) 04:04:10.152577 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21724): Terminating (SIGTERM) 04:04:10.195547 --- ParallelTerminationStrategy: PID 21718 died... 04:04:10.215811 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21718): Terminated: ok {rc=0} 04:04:10.262601 --- ParallelTerminationStrategy: PID 21721 died... 04:04:10.282088 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21721): Terminated: ok {rc=0} 04:04:10.328599 --- ParallelTerminationStrategy: PID 21724 died... 04:04:10.348528 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21724): Terminated: ok {rc=0} 04:04:10.437231 bus /sierra_3: Setting Powered False 04:04:11.536571 bus /sierra_3: Setting Powered False 04:04:12.651142 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2354 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 04:04:13.795695 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:04:13.807594 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 04:04:13.877602 tst mo_mt_call_osmux.py: using LAC 18942 04:04:13.995786 tst mo_mt_call_osmux.py: using RAC 72 04:04:14.115910 tst mo_mt_call_osmux.py: using CellId 18942 04:04:14.235913 tst mo_mt_call_osmux.py: using BVCI 18943 04:04:14.346295 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:04:14.357746 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:04:14.368711 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:04:14.379856 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:04:14.391354 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:04:14.402557 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 04:04:14.515749 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 04:04:14.635419 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:04:15.134481 run create_hlr_db(pid=21727): Launched 04:04:15.259364 bus /sierra_2: Setting Powered False 04:04:16.335105 run create_hlr_db(pid=21727): Terminated: ok {rc=0} 04:04:16.858424 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21729): Launched 04:04:17.201184 run osmo-hlr_10.42.42.2(pid=21730): Launched 04:04:17.326920 run osmo-stp_10.42.42.5: Starting osmo-stp 04:04:17.878667 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21732): Launched 04:04:18.199492 run osmo-stp_10.42.42.5(pid=21733): Launched 04:04:18.322402 run osmo-msc_10.42.42.6: Starting osmo-msc 04:04:18.902635 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21735): Launched 04:04:19.224757 run osmo-msc_10.42.42.6(pid=21736): Launched 04:04:19.404494 run osmo-stp_10.42.42.5(pid=21733): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21733)] 04:04:19.540264 run osmo-stp_10.42.42.5(pid=21733): stdout: | (launched: 2022-12-09_04:04:18.140595) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:04:19.677107 run osmo-stp_10.42.42.5(pid=21733): stderr: | 20221209040418332 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040418332 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040418332 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040418333 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040418333 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040418333 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040418333 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:04:19.813124 run osmo-stp_10.42.42.5(pid=21733): stdout: | (launched: 2022-12-09_04:04:18.140595) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:04:19.941698 run osmo-stp_10.42.42.5(pid=21733): stderr: | 20221209040418332 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040418332 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040418332 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040418333 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040418333 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040418333 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040418333 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:04:20.095116 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21733): Process ended prematurely: osmo-stp_10.42.42.5(pid=21733) [trial-2354↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21733)] [trial-2354↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 04:04:20.104663 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 04:04:20.133240 run osmo-hlr_10.42.42.2(pid=21730): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21730)] 04:04:20.184487 run osmo-hlr_10.42.42.2(pid=21730): stdout: | (launched: 2022-12-09_04:04:17.137264) 04:04:20.237435 run osmo-hlr_10.42.42.2(pid=21730): stderr: | 20221209040417336 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209040417336 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209040417336 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209040417336 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209040417336 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209040417336 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209040417348 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209040417356 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209040417357 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209040417357 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:04:20.311116 run osmo-msc_10.42.42.6(pid=21736): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21736)] 04:04:20.362438 run osmo-msc_10.42.42.6(pid=21736): stdout: | (launched: 2022-12-09_04:04:19.165860) 04:04:20.415034 run osmo-msc_10.42.42.6(pid=21736): stderr: | 20221209040419489 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209040419490 DLGLOBAL DEBUG validating counter group 0x7f5dad6fcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209040419490 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209040419490 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209040419490 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209040419490 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209040419492 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209040419492 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209040419492 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209040419492 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:04:20.467978 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21729): Terminating (SIGTERM) 04:04:20.510468 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21732): Terminating (SIGTERM) 04:04:20.552861 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21735): Terminating (SIGTERM) 04:04:20.595346 --- ParallelTerminationStrategy: PID 21729 died... 04:04:20.615543 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21729): Terminated: ok {rc=0} 04:04:20.662565 --- ParallelTerminationStrategy: PID 21732 died... 04:04:20.682748 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21732): Terminated: ok {rc=0} 04:04:20.729810 --- ParallelTerminationStrategy: PID 21735 died... 04:04:20.749548 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21735): Terminated: ok {rc=0} 04:04:20.838209 bus /sierra_3: Setting Powered False 04:04:21.938493 bus /sierra_3: Setting Powered False 04:04:23.056831 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 04:04:24.316818 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:04:24.324101 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 04:04:24.359355 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 04:04:24.386859 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 04:04:24.439640 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 04:04:24.473981 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 04:04:24.501219 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 04:04:25.058752 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 04:04:25.110632 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:04:25.122400 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 04:04:25.194972 tst mo_mt_call.py: using LAC 18943 04:04:25.322056 tst mo_mt_call.py: using RAC 73 04:04:25.448674 tst mo_mt_call.py: using CellId 18943 04:04:25.574195 tst mo_mt_call.py: using BVCI 18944 04:04:25.690039 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:04:25.701621 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:04:25.713027 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:04:25.724555 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:04:25.736573 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:04:25.748363 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 04:04:25.864138 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 04:04:25.979129 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:04:26.443460 run create_hlr_db(pid=21741): Launched 04:04:26.567139 bus /sierra_2: Setting Powered False 04:04:27.627213 run create_hlr_db(pid=21741): Terminated: ok {rc=0} 04:04:28.064061 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21743): Launched 04:04:28.386393 run osmo-hlr_10.42.42.2(pid=21744): Launched 04:04:28.508718 run osmo-stp_10.42.42.5: Starting osmo-stp 04:04:29.058556 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21746): Launched 04:04:29.379417 run osmo-stp_10.42.42.5(pid=21747): Launched 04:04:29.502602 run osmo-msc_10.42.42.6: Starting osmo-msc 04:04:30.081972 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21749): Launched 04:04:30.403331 run osmo-msc_10.42.42.6(pid=21750): Launched 04:04:30.583377 run osmo-stp_10.42.42.5(pid=21747): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21747)] 04:04:30.718769 run osmo-stp_10.42.42.5(pid=21747): stdout: | (launched: 2022-12-09_04:04:29.320810) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:04:30.862175 run osmo-stp_10.42.42.5(pid=21747): stderr: | 20221209040429512 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040429512 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040429512 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040429512 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040429513 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040429513 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040429513 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:04:31.060556 run osmo-stp_10.42.42.5(pid=21747): stdout: | (launched: 2022-12-09_04:04:29.320810) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:04:31.220535 run osmo-stp_10.42.42.5(pid=21747): stderr: | 20221209040429512 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040429512 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040429512 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040429512 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040429513 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040429513 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040429513 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:04:31.369208 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21747): Process ended prematurely: osmo-stp_10.42.42.5(pid=21747) [trial-2354↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21747)] [trial-2354↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 04:04:31.378705 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 04:04:31.407087 run osmo-hlr_10.42.42.2(pid=21744): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21744)] 04:04:31.457548 run osmo-hlr_10.42.42.2(pid=21744): stdout: | (launched: 2022-12-09_04:04:28.327660) 04:04:31.508567 run osmo-hlr_10.42.42.2(pid=21744): stderr: | 20221209040428524 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209040428524 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209040428525 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209040428525 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209040428525 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209040428525 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209040428537 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209040428545 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209040428545 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209040428545 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:04:31.579131 run osmo-msc_10.42.42.6(pid=21750): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21750)] 04:04:31.628799 run osmo-msc_10.42.42.6(pid=21750): stdout: | (launched: 2022-12-09_04:04:30.344827) 04:04:31.681095 run osmo-msc_10.42.42.6(pid=21750): stderr: | 20221209040430665 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209040430665 DLGLOBAL DEBUG validating counter group 0x7f5f1cd5ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209040430665 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209040430665 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209040430666 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209040430666 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209040430667 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209040430668 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209040430668 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209040430668 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:04:31.732354 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21743): Terminating (SIGTERM) 04:04:31.774214 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21746): Terminating (SIGTERM) 04:04:31.817607 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21749): Terminating (SIGTERM) 04:04:31.863611 --- ParallelTerminationStrategy: PID 21743 died... 04:04:31.883479 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21743): Terminated: ok {rc=0} 04:04:31.931451 --- ParallelTerminationStrategy: PID 21746 died... 04:04:31.950716 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21746): Terminated: ok {rc=0} 04:04:31.996107 --- ParallelTerminationStrategy: PID 21749 died... 04:04:32.015773 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21749): Terminated: ok {rc=0} 04:04:32.101568 bus /sierra_3: Setting Powered False 04:04:33.212074 bus /sierra_3: Setting Powered False 04:04:34.328162 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2354 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 04:04:35.478961 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:04:35.491353 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 04:04:35.564100 tst mo_mt_call_osmux.py: using LAC 18944 04:04:35.690824 tst mo_mt_call_osmux.py: using RAC 74 04:04:35.818371 tst mo_mt_call_osmux.py: using CellId 18944 04:04:35.945978 tst mo_mt_call_osmux.py: using BVCI 18945 04:04:36.062657 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:04:36.074577 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:04:36.086139 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:04:36.098070 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:04:36.109988 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:04:36.121627 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 04:04:36.241579 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 04:04:36.361232 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:04:36.859057 run create_hlr_db(pid=21752): Launched 04:04:36.982082 bus /sierra_2: Setting Powered False 04:04:38.046194 run create_hlr_db(pid=21752): Terminated: ok {rc=0} 04:04:38.493976 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21754): Launched 04:04:38.815365 run osmo-hlr_10.42.42.2(pid=21755): Launched 04:04:38.938400 run osmo-stp_10.42.42.5: Starting osmo-stp 04:04:39.493067 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21757): Launched 04:04:39.815358 run osmo-stp_10.42.42.5(pid=21758): Launched 04:04:39.938461 run osmo-msc_10.42.42.6: Starting osmo-msc 04:04:40.520268 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21760): Launched 04:04:40.841411 run osmo-msc_10.42.42.6(pid=21761): Launched 04:04:41.021127 run osmo-stp_10.42.42.5(pid=21758): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21758)] 04:04:41.158196 run osmo-stp_10.42.42.5(pid=21758): stdout: | (launched: 2022-12-09_04:04:39.756496) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:04:41.296595 run osmo-stp_10.42.42.5(pid=21758): stderr: | 20221209040439949 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040439949 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040439949 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040439950 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040439950 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040439950 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040439950 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:04:41.432414 run osmo-stp_10.42.42.5(pid=21758): stdout: | (launched: 2022-12-09_04:04:39.756496) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:04:41.561061 run osmo-stp_10.42.42.5(pid=21758): stderr: | 20221209040439949 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040439949 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040439949 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040439950 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040439950 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040439950 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040439950 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:04:41.714661 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21758): Process ended prematurely: osmo-stp_10.42.42.5(pid=21758) [trial-2354↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21758)] [trial-2354↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 04:04:41.724423 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 04:04:41.753208 run osmo-hlr_10.42.42.2(pid=21755): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21755)] 04:04:41.803796 run osmo-hlr_10.42.42.2(pid=21755): stdout: | (launched: 2022-12-09_04:04:38.756812) 04:04:41.856261 run osmo-hlr_10.42.42.2(pid=21755): stderr: | 20221209040438956 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209040438956 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209040438956 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209040438956 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209040438956 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209040438956 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209040438968 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209040438976 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209040438976 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209040438977 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:04:41.929215 run osmo-msc_10.42.42.6(pid=21761): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21761)] 04:04:41.979621 run osmo-msc_10.42.42.6(pid=21761): stdout: | (launched: 2022-12-09_04:04:40.782746) 04:04:42.031747 run osmo-msc_10.42.42.6(pid=21761): stderr: | 20221209040441104 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209040441104 DLGLOBAL DEBUG validating counter group 0x7ff1c6e58c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209040441104 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209040441104 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209040441104 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209040441105 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209040441106 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209040441107 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209040441107 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209040441107 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:04:42.084281 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21754): Terminating (SIGTERM) 04:04:42.126733 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21757): Terminating (SIGTERM) 04:04:42.169236 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21760): Terminating (SIGTERM) 04:04:42.211761 --- ParallelTerminationStrategy: PID 21754 died... 04:04:42.231782 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21754): Terminated: ok {rc=0} 04:04:42.278982 --- ParallelTerminationStrategy: PID 21757 died... 04:04:42.298712 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21757): Terminated: ok {rc=0} 04:04:42.345435 --- ParallelTerminationStrategy: PID 21760 died... 04:04:42.365072 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21760): Terminated: ok {rc=0} 04:04:42.453715 bus /sierra_3: Setting Powered False 04:04:43.552405 bus /sierra_3: Setting Powered False 04:04:44.668862 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 04:04:45.936128 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:04:45.943206 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 04:04:45.977458 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 04:04:46.004256 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 04:04:46.058042 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 04:04:46.100609 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 04:04:46.134573 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 04:04:46.691051 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 04:04:46.741959 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:04:46.753747 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 04:04:46.822980 tst mo_mt_call.py: using LAC 18945 04:04:46.943482 tst mo_mt_call.py: using RAC 75 04:04:47.062410 tst mo_mt_call.py: using CellId 18945 04:04:47.234247 tst mo_mt_call.py: using BVCI 18946 04:04:47.356025 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:04:47.368513 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:04:47.380775 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:04:47.394835 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:04:47.408095 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:04:47.419693 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 04:04:47.535826 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 04:04:47.650347 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:04:48.115093 run create_hlr_db(pid=21767): Launched 04:04:48.238262 bus /sierra_2: Setting Powered False 04:04:49.298471 run create_hlr_db(pid=21767): Terminated: ok {rc=0} 04:04:49.738281 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21769): Launched 04:04:50.059785 run osmo-hlr_10.42.42.2(pid=21770): Launched 04:04:50.184649 run osmo-stp_10.42.42.5: Starting osmo-stp 04:04:50.740367 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21772): Launched 04:04:51.061315 run osmo-stp_10.42.42.5(pid=21773): Launched 04:04:51.183961 run osmo-msc_10.42.42.6: Starting osmo-msc 04:04:51.765384 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21775): Launched 04:04:52.086960 run osmo-msc_10.42.42.6(pid=21776): Launched 04:04:52.266644 run osmo-stp_10.42.42.5(pid=21773): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21773)] 04:04:52.402247 run osmo-stp_10.42.42.5(pid=21773): stdout: | (launched: 2022-12-09_04:04:51.002754) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:04:52.538621 run osmo-stp_10.42.42.5(pid=21773): stderr: | 20221209040451194 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040451194 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040451194 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040451195 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040451195 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040451195 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040451195 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:04:52.674920 run osmo-stp_10.42.42.5(pid=21773): stdout: | (launched: 2022-12-09_04:04:51.002754) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:04:52.803885 run osmo-stp_10.42.42.5(pid=21773): stderr: | 20221209040451194 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040451194 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040451194 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040451195 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040451195 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040451195 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040451195 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:04:52.958267 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21773): Process ended prematurely: osmo-stp_10.42.42.5(pid=21773) [trial-2354↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21773)] [trial-2354↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 04:04:52.967944 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 04:04:52.996520 run osmo-hlr_10.42.42.2(pid=21770): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21770)] 04:04:53.047130 run osmo-hlr_10.42.42.2(pid=21770): stdout: | (launched: 2022-12-09_04:04:50.001254) 04:04:53.099560 run osmo-hlr_10.42.42.2(pid=21770): stderr: | 20221209040450199 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209040450199 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209040450199 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209040450199 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209040450199 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209040450199 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209040450212 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209040450221 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209040450221 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209040450221 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:04:53.172712 run osmo-msc_10.42.42.6(pid=21776): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21776)] 04:04:53.223490 run osmo-msc_10.42.42.6(pid=21776): stdout: | (launched: 2022-12-09_04:04:52.028220) 04:04:53.275771 run osmo-msc_10.42.42.6(pid=21776): stderr: | 20221209040452351 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209040452351 DLGLOBAL DEBUG validating counter group 0x7fc863ca9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209040452351 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209040452351 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209040452351 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209040452351 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209040452353 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209040452353 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209040452354 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209040452354 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:04:53.328498 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21769): Terminating (SIGTERM) 04:04:53.370952 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21772): Terminating (SIGTERM) 04:04:53.413412 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21775): Terminating (SIGTERM) 04:04:53.455981 --- ParallelTerminationStrategy: PID 21769 died... 04:04:53.476142 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21769): Terminated: ok {rc=0} 04:04:53.523236 --- ParallelTerminationStrategy: PID 21772 died... 04:04:53.543061 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21772): Terminated: ok {rc=0} 04:04:53.589944 --- ParallelTerminationStrategy: PID 21775 died... 04:04:53.609682 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21775): Terminated: ok {rc=0} 04:04:53.699069 bus /sierra_3: Setting Powered False 04:04:54.798302 bus /sierra_3: Setting Powered False 04:04:55.916876 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2354 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 04:04:57.065664 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:04:57.078135 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 04:04:57.149593 tst mo_mt_call_osmux.py: using LAC 18946 04:04:57.277254 tst mo_mt_call_osmux.py: using RAC 76 04:04:57.402658 tst mo_mt_call_osmux.py: using CellId 18946 04:04:57.530704 tst mo_mt_call_osmux.py: using BVCI 18947 04:04:57.647263 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:04:57.659057 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:04:57.670503 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:04:57.682296 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:04:57.694049 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:04:57.705753 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 04:04:57.822751 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 04:04:57.941959 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:04:58.441448 run create_hlr_db(pid=21778): Launched 04:04:58.564611 bus /sierra_2: Setting Powered False 04:04:59.627585 run create_hlr_db(pid=21778): Terminated: ok {rc=0} 04:05:00.075245 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21780): Launched 04:05:00.397571 run osmo-hlr_10.42.42.2(pid=21781): Launched 04:05:00.521215 run osmo-stp_10.42.42.5: Starting osmo-stp 04:05:01.093805 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21783): Launched 04:05:01.461837 run osmo-stp_10.42.42.5(pid=21784): Launched 04:05:01.652483 run osmo-msc_10.42.42.6: Starting osmo-msc 04:05:02.333027 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21789): Launched 04:05:02.669425 run osmo-msc_10.42.42.6(pid=21790): Launched 04:05:02.849582 run osmo-stp_10.42.42.5(pid=21784): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21784)] 04:05:02.985696 run osmo-stp_10.42.42.5(pid=21784): stdout: | (launched: 2022-12-09_04:05:01.393621) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:05:03.122983 run osmo-stp_10.42.42.5(pid=21784): stderr: | 20221209040501674 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040501674 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040501674 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040501675 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040501675 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040501675 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040501675 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:05:03.259930 run osmo-stp_10.42.42.5(pid=21784): stdout: | (launched: 2022-12-09_04:05:01.393621) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:05:03.388911 run osmo-stp_10.42.42.5(pid=21784): stderr: | 20221209040501674 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040501674 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040501674 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040501675 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040501675 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040501675 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040501675 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:05:03.543418 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21784): Process ended prematurely: osmo-stp_10.42.42.5(pid=21784) [trial-2354↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21784)] [trial-2354↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 04:05:03.553135 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 04:05:03.581620 run osmo-hlr_10.42.42.2(pid=21781): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21781)] 04:05:03.632458 run osmo-hlr_10.42.42.2(pid=21781): stdout: | (launched: 2022-12-09_04:05:00.338849) 04:05:03.685419 run osmo-hlr_10.42.42.2(pid=21781): stderr: | 20221209040500537 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209040500537 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209040500537 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209040500537 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209040500537 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209040500537 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209040500548 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209040500557 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209040500557 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209040500557 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:05:03.758778 run osmo-msc_10.42.42.6(pid=21790): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21790)] 04:05:03.809740 run osmo-msc_10.42.42.6(pid=21790): stdout: | (launched: 2022-12-09_04:05:02.610109) 04:05:03.862135 run osmo-msc_10.42.42.6(pid=21790): stderr: | 20221209040502932 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209040502932 DLGLOBAL DEBUG validating counter group 0x7fd61085bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209040502932 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209040502932 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209040502933 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209040502933 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209040502935 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209040502935 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209040502935 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209040502935 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:05:03.914964 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21780): Terminating (SIGTERM) 04:05:03.957063 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21783): Terminating (SIGTERM) 04:05:03.999273 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21789): Terminating (SIGTERM) 04:05:04.041979 --- ParallelTerminationStrategy: PID 21780 died... 04:05:04.062007 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21780): Terminated: ok {rc=0} 04:05:04.108720 --- ParallelTerminationStrategy: PID 21783 died... 04:05:04.128377 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21783): Terminated: ok {rc=0} 04:05:04.175095 --- ParallelTerminationStrategy: PID 21789 died... 04:05:04.194601 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21789): Terminated: ok {rc=0} 04:05:04.283683 bus /sierra_3: Setting Powered False 04:05:05.383620 bus /sierra_3: Setting Powered False 04:05:06.499621 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 04:05:07.759183 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:05:07.766239 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 04:05:07.800694 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 04:05:07.827880 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 04:05:07.882261 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 04:05:07.917047 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 04:05:07.944052 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 04:05:08.496356 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 04:05:08.548472 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:05:08.560239 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 04:05:08.632871 tst mo_mt_call.py: using LAC 18947 04:05:08.757993 tst mo_mt_call.py: using RAC 77 04:05:08.886034 tst mo_mt_call.py: using CellId 18947 04:05:09.002832 tst mo_mt_call.py: using BVCI 18948 04:05:09.111234 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:05:09.122690 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:05:09.133867 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:05:09.144902 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:05:09.156065 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:05:09.167249 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:05:09.285652 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:05:09.402804 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:05:09.868091 run create_hlr_db(pid=21795): Launched 04:05:09.991187 bus /sierra_2: Setting Powered False 04:05:11.051667 run create_hlr_db(pid=21795): Terminated: ok {rc=0} 04:05:11.491349 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21797): Launched 04:05:11.813500 run osmo-hlr_10.42.42.2(pid=21798): Launched 04:05:11.937174 run osmo-stp_10.42.42.5: Starting osmo-stp 04:05:12.493587 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21800): Launched 04:05:12.814783 run osmo-stp_10.42.42.5(pid=21801): Launched 04:05:12.938124 run osmo-msc_10.42.42.6: Starting osmo-msc 04:05:13.519389 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21803): Launched 04:05:13.841316 run osmo-msc_10.42.42.6(pid=21805): Launched 04:05:14.021096 run osmo-stp_10.42.42.5(pid=21801): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21801)] 04:05:14.156664 run osmo-stp_10.42.42.5(pid=21801): stdout: | (launched: 2022-12-09_04:05:12.756134) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:05:14.294008 run osmo-stp_10.42.42.5(pid=21801): stderr: | 20221209040512949 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040512949 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040512950 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040512950 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040512951 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040512951 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040512951 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:05:14.430001 run osmo-stp_10.42.42.5(pid=21801): stdout: | (launched: 2022-12-09_04:05:12.756134) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:05:14.558758 run osmo-stp_10.42.42.5(pid=21801): stderr: | 20221209040512949 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040512949 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040512950 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040512950 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040512951 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040512951 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040512951 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:05:14.712848 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21801): Process ended prematurely: osmo-stp_10.42.42.5(pid=21801) [trial-2354↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21801)] [trial-2354↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 04:05:14.722849 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 04:05:14.751250 run osmo-hlr_10.42.42.2(pid=21798): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21798)] 04:05:14.802019 run osmo-hlr_10.42.42.2(pid=21798): stdout: | (launched: 2022-12-09_04:05:11.754871) 04:05:14.854608 run osmo-hlr_10.42.42.2(pid=21798): stderr: | 20221209040511954 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209040511954 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209040511954 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209040511954 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209040511954 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209040511954 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209040511967 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209040511975 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209040511976 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209040511976 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:05:14.927988 run osmo-msc_10.42.42.6(pid=21805): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21805)] 04:05:14.978619 run osmo-msc_10.42.42.6(pid=21805): stdout: | (launched: 2022-12-09_04:05:13.782593) 04:05:15.031324 run osmo-msc_10.42.42.6(pid=21805): stderr: | 20221209040514105 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209040514106 DLGLOBAL DEBUG validating counter group 0x7f119811fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209040514106 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209040514106 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209040514106 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209040514106 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209040514108 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209040514108 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209040514108 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209040514108 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:05:15.084464 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21797): Terminating (SIGTERM) 04:05:15.126956 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21800): Terminating (SIGTERM) 04:05:15.169556 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21803): Terminating (SIGTERM) 04:05:15.212492 --- ParallelTerminationStrategy: PID 21797 died... 04:05:15.232858 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21797): Terminated: ok {rc=0} 04:05:15.279730 --- ParallelTerminationStrategy: PID 21800 died... 04:05:15.299522 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21800): Terminated: ok {rc=0} 04:05:15.346481 --- ParallelTerminationStrategy: PID 21803 died... 04:05:15.366367 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21803): Terminated: ok {rc=0} 04:05:15.457488 bus /sierra_3: Setting Powered False 04:05:16.555050 bus /sierra_3: Setting Powered False 04:05:17.674198 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2354 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 04:05:18.820485 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:05:18.832397 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 04:05:18.902188 tst mo_mt_call_osmux.py: using LAC 18948 04:05:19.019608 tst mo_mt_call_osmux.py: using RAC 78 04:05:19.138910 tst mo_mt_call_osmux.py: using CellId 18948 04:05:19.258224 tst mo_mt_call_osmux.py: using BVCI 18949 04:05:19.368353 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:05:19.379521 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:05:19.390455 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:05:19.401542 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:05:19.412579 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:05:19.423512 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:05:19.538499 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:05:19.659164 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:05:20.159526 run create_hlr_db(pid=21807): Launched 04:05:20.284041 bus /sierra_2: Setting Powered False 04:05:21.348493 run create_hlr_db(pid=21807): Terminated: ok {rc=0} 04:05:21.778982 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21809): Launched 04:05:22.080661 run osmo-hlr_10.42.42.2(pid=21810): Launched 04:05:22.195650 run osmo-stp_10.42.42.5: Starting osmo-stp 04:05:22.725059 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21812): Launched 04:05:23.025605 run osmo-stp_10.42.42.5(pid=21813): Launched 04:05:23.141268 run osmo-msc_10.42.42.6: Starting osmo-msc 04:05:23.685025 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21815): Launched 04:05:23.986312 run osmo-msc_10.42.42.6(pid=21816): Launched 04:05:24.154547 run osmo-stp_10.42.42.5(pid=21813): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21813)] 04:05:24.281344 run osmo-stp_10.42.42.5(pid=21813): stdout: | (launched: 2022-12-09_04:05:22.969958) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:05:24.408134 run osmo-stp_10.42.42.5(pid=21813): stderr: | 20221209040523141 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040523141 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040523141 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040523142 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040523142 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040523142 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040523142 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:05:24.533200 run osmo-stp_10.42.42.5(pid=21813): stdout: | (launched: 2022-12-09_04:05:22.969958) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:05:24.652527 run osmo-stp_10.42.42.5(pid=21813): stderr: | 20221209040523141 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040523141 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040523141 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040523142 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040523142 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040523142 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040523142 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:05:24.795755 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21813): Process ended prematurely: osmo-stp_10.42.42.5(pid=21813) [trial-2354↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21813)] [trial-2354↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 04:05:24.804653 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 04:05:24.831129 run osmo-hlr_10.42.42.2(pid=21810): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21810)] 04:05:24.878701 run osmo-hlr_10.42.42.2(pid=21810): stdout: | (launched: 2022-12-09_04:05:22.025697) 04:05:24.928191 run osmo-hlr_10.42.42.2(pid=21810): stderr: | 20221209040522201 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209040522201 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209040522201 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209040522201 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209040522201 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209040522201 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209040522213 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209040522222 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209040522223 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209040522223 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:05:24.997221 run osmo-msc_10.42.42.6(pid=21816): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21816)] 04:05:25.044943 run osmo-msc_10.42.42.6(pid=21816): stdout: | (launched: 2022-12-09_04:05:23.930722) 04:05:25.094305 run osmo-msc_10.42.42.6(pid=21816): stderr: | 20221209040524200 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209040524200 DLGLOBAL DEBUG validating counter group 0x7f95e6cfec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209040524201 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209040524201 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209040524201 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209040524201 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209040524203 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209040524203 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209040524203 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209040524203 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:05:25.143842 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21809): Terminating (SIGTERM) 04:05:25.183526 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21812): Terminating (SIGTERM) 04:05:25.223014 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21815): Terminating (SIGTERM) 04:05:25.263022 --- ParallelTerminationStrategy: PID 21809 died... 04:05:25.282189 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21809): Terminated: ok {rc=0} 04:05:25.325900 --- ParallelTerminationStrategy: PID 21812 died... 04:05:25.344358 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21812): Terminated: ok {rc=0} 04:05:25.387937 --- ParallelTerminationStrategy: PID 21815 died... 04:05:25.406350 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21815): Terminated: ok {rc=0} 04:05:25.491767 bus /sierra_3: Setting Powered False 04:05:26.592136 bus /sierra_3: Setting Powered False 04:05:27.708146 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 voice:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 04:05:28.964377 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:05:28.970657 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 04:05:29.005825 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 04:05:29.033353 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 04:05:29.085534 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 04:05:29.120157 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 04:05:29.147529 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 04:05:29.698592 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 04:05:29.750748 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:05:29.762371 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:05:29.833962 tst mo_mt_call.py: using LAC 18949 04:05:29.959336 tst mo_mt_call.py: using RAC 79 04:05:30.084661 tst mo_mt_call.py: using CellId 18949 04:05:30.210720 tst mo_mt_call.py: using BVCI 18950 04:05:30.327742 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:05:30.339233 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:05:30.350633 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:05:30.362246 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:05:30.373841 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:05:30.385320 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 04:05:30.502873 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 04:05:30.618498 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:05:31.115398 run create_hlr_db(pid=21821): Launched 04:05:31.282134 bus /sierra_2: Setting Powered False 04:05:32.354638 run create_hlr_db(pid=21821): Terminated: ok {rc=0} 04:05:32.844813 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21823): Launched 04:05:33.145440 run osmo-hlr_10.42.42.2(pid=21824): Launched 04:05:33.259501 run osmo-stp_10.42.42.5: Starting osmo-stp 04:05:33.779183 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21826): Launched 04:05:34.079538 run osmo-stp_10.42.42.5(pid=21827): Launched 04:05:34.193814 run osmo-msc_10.42.42.6: Starting osmo-msc 04:05:34.736867 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21829): Launched 04:05:35.037197 run osmo-msc_10.42.42.6(pid=21830): Launched 04:05:35.206165 run osmo-stp_10.42.42.5(pid=21827): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21827)] 04:05:35.333679 run osmo-stp_10.42.42.5(pid=21827): stdout: | (launched: 2022-12-09_04:05:34.024166) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:05:35.461096 run osmo-stp_10.42.42.5(pid=21827): stderr: | 20221209040534194 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040534195 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040534195 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040534196 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040534196 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040534196 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040534196 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:05:35.586149 run osmo-stp_10.42.42.5(pid=21827): stdout: | (launched: 2022-12-09_04:05:34.024166) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:05:35.705928 run osmo-stp_10.42.42.5(pid=21827): stderr: | 20221209040534194 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040534195 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040534195 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040534196 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040534196 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040534196 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040534196 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:05:35.849118 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21827): Process ended prematurely: osmo-stp_10.42.42.5(pid=21827) [trial-2354↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21827)] [trial-2354↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 04:05:35.858028 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 04:05:35.884443 run osmo-hlr_10.42.42.2(pid=21824): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21824)] 04:05:35.932037 run osmo-hlr_10.42.42.2(pid=21824): stdout: | (launched: 2022-12-09_04:05:33.090285) 04:05:35.981488 run osmo-hlr_10.42.42.2(pid=21824): stderr: | 20221209040533264 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209040533264 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209040533264 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209040533264 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209040533264 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209040533264 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209040533276 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209040533285 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209040533286 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209040533286 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:05:36.051351 run osmo-msc_10.42.42.6(pid=21830): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21830)] 04:05:36.098960 run osmo-msc_10.42.42.6(pid=21830): stdout: | (launched: 2022-12-09_04:05:34.981984) 04:05:36.148682 run osmo-msc_10.42.42.6(pid=21830): stderr: | 20221209040535255 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209040535255 DLGLOBAL DEBUG validating counter group 0x7f49ee2e0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209040535255 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209040535256 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209040535256 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209040535257 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209040535258 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209040535259 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209040535259 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209040535259 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:05:36.198704 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21823): Terminating (SIGTERM) 04:05:36.238345 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21826): Terminating (SIGTERM) 04:05:36.277966 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21829): Terminating (SIGTERM) 04:05:36.317775 --- ParallelTerminationStrategy: PID 21823 died... 04:05:36.336844 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21823): Terminated: ok {rc=0} 04:05:36.381331 --- ParallelTerminationStrategy: PID 21826 died... 04:05:36.400009 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21826): Terminated: ok {rc=0} 04:05:36.443901 --- ParallelTerminationStrategy: PID 21829 died... 04:05:36.463008 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21829): Terminated: ok {rc=0} 04:05:36.549408 bus /sierra_3: Setting Powered False 04:05:37.649470 bus /sierra_3: Setting Powered False 04:05:38.764758 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2354 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 04:05:39.914134 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:05:39.926407 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:05:40.000108 tst mo_mt_call_osmux.py: using LAC 18950 04:05:40.127834 tst mo_mt_call_osmux.py: using RAC 80 04:05:40.257664 tst mo_mt_call_osmux.py: using CellId 18950 04:05:40.378374 tst mo_mt_call_osmux.py: using BVCI 18951 04:05:40.488246 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:05:40.499171 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:05:40.510053 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:05:40.520797 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:05:40.533076 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:05:40.543742 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 04:05:40.663398 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 04:05:40.783117 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:05:41.247934 run create_hlr_db(pid=21832): Launched 04:05:41.370556 bus /sierra_2: Setting Powered False 04:05:42.434837 run create_hlr_db(pid=21832): Terminated: ok {rc=0} 04:05:42.881417 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21834): Launched 04:05:43.203295 run osmo-hlr_10.42.42.2(pid=21835): Launched 04:05:43.326350 run osmo-stp_10.42.42.5: Starting osmo-stp 04:05:43.882194 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21837): Launched 04:05:44.204253 run osmo-stp_10.42.42.5(pid=21838): Launched 04:05:44.327581 run osmo-msc_10.42.42.6: Starting osmo-msc 04:05:44.909123 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21840): Launched 04:05:45.231582 run osmo-msc_10.42.42.6(pid=21841): Launched 04:05:45.412465 run osmo-stp_10.42.42.5(pid=21838): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21838)] 04:05:45.548906 run osmo-stp_10.42.42.5(pid=21838): stdout: | (launched: 2022-12-09_04:05:44.145508) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:05:45.687492 run osmo-stp_10.42.42.5(pid=21838): stderr: | 20221209040544336 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040544336 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040544336 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040544336 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040544337 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040544337 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040544337 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:05:45.823818 run osmo-stp_10.42.42.5(pid=21838): stdout: | (launched: 2022-12-09_04:05:44.145508) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:05:45.971749 run osmo-stp_10.42.42.5(pid=21838): stderr: | 20221209040544336 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040544336 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040544336 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040544336 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040544337 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040544337 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040544337 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:05:46.129740 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21838): Process ended prematurely: osmo-stp_10.42.42.5(pid=21838) [trial-2354↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21838)] [trial-2354↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 04:05:46.140315 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 04:05:46.171973 run osmo-hlr_10.42.42.2(pid=21835): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21835)] 04:05:46.225414 run osmo-hlr_10.42.42.2(pid=21835): stdout: | (launched: 2022-12-09_04:05:43.144515) 04:05:46.280463 run osmo-hlr_10.42.42.2(pid=21835): stderr: | 20221209040543343 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209040543343 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209040543343 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209040543343 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209040543343 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209040543343 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209040543355 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209040543363 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209040543363 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209040543363 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:05:46.357037 run osmo-msc_10.42.42.6(pid=21841): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21841)] 04:05:46.410028 run osmo-msc_10.42.42.6(pid=21841): stdout: | (launched: 2022-12-09_04:05:45.172307) 04:05:46.464518 run osmo-msc_10.42.42.6(pid=21841): stderr: | 20221209040545492 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209040545492 DLGLOBAL DEBUG validating counter group 0x7fce08feec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209040545492 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209040545492 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209040545493 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209040545493 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209040545494 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209040545495 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209040545495 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209040545495 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:05:46.519698 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21834): Terminating (SIGTERM) 04:05:46.564729 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21837): Terminating (SIGTERM) 04:05:46.610766 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21840): Terminating (SIGTERM) 04:05:46.655736 --- ParallelTerminationStrategy: PID 21834 died... 04:05:46.676565 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21834): Terminated: ok {rc=0} 04:05:46.727621 --- ParallelTerminationStrategy: PID 21837 died... 04:05:46.748204 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21837): Terminated: ok {rc=0} 04:05:46.798156 --- ParallelTerminationStrategy: PID 21840 died... 04:05:46.818829 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21840): Terminated: ok {rc=0} 04:05:46.910532 bus /sierra_3: Setting Powered False 04:05:48.009863 bus /sierra_3: Setting Powered False 04:05:49.124599 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 voice:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 emergency:trx-sysmocell5000 --------------------------------------------------------------------- 04:05:50.373667 tst emergency:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:05:50.377814 tst emergency:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 04:05:50.410678 tst emergency:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 04:05:50.436755 tst emergency:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 04:05:50.519962 tst emergency:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 04:05:50.553100 tst emergency:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 04:05:50.579085 tst emergency:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 04:05:51.164075 tst emergency:trx-sysmocell5000: RESERVED RESOURCES for emergency: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2354 emergency:trx-sysmocell5000 emergency_mo_mt_call.py ---------------------------------------------- 04:05:51.168917 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:05:51.179977 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 04:05:51.229380 tst emergency_mo_mt_call.py: using LAC 18951 04:05:51.344495 tst emergency_mo_mt_call.py: using RAC 81 04:05:51.459621 tst emergency_mo_mt_call.py: using CellId 18951 04:05:51.574268 tst emergency_mo_mt_call.py: using BVCI 18952 04:05:51.682659 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:05:51.693588 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:05:51.704011 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:05:51.714569 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:05:51.725066 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:05:51.735565 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 04:05:51.852684 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 04:05:51.968335 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:05:52.427375 run create_hlr_db(pid=21847): Launched 04:05:52.549336 bus /sierra_2: Setting Powered False 04:05:53.608491 run create_hlr_db(pid=21847): Terminated: ok {rc=0} 04:05:54.040760 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21849): Launched 04:05:54.357809 run osmo-hlr_10.42.42.2(pid=21850): Launched 04:05:54.478921 run osmo-stp_10.42.42.5: Starting osmo-stp 04:05:55.026791 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21852): Launched 04:05:55.344434 run osmo-stp_10.42.42.5(pid=21853): Launched 04:05:55.475157 tst emergency_mo_mt_call.py: using MSISDN 7018 04:05:55.636915 run osmo-msc_10.42.42.6: Starting osmo-msc 04:05:56.205092 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21855): Launched 04:05:56.520757 run osmo-msc_10.42.42.6(pid=21856): Launched 04:05:56.697939 run osmo-stp_10.42.42.5(pid=21853): ERR: Terminated: ERROR {rc=1} [trial-2354↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21853)] 04:05:56.831810 run osmo-stp_10.42.42.5(pid=21853): stdout: | (launched: 2022-12-09_04:05:55.286547) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:05:56.966792 run osmo-stp_10.42.42.5(pid=21853): stderr: | 20221209040555478 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040555478 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040555479 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040555479 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040555479 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040555480 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040555480 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:05:57.100613 run osmo-stp_10.42.42.5(pid=21853): stdout: | (launched: 2022-12-09_04:05:55.286547) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:05:57.226757 run osmo-stp_10.42.42.5(pid=21853): stderr: | 20221209040555478 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040555478 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040555479 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040555479 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040555479 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040555480 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040555480 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:05:57.376868 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=21853): Process ended prematurely: osmo-stp_10.42.42.5(pid=21853) [trial-2354↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21853)] [trial-2354↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19] 04:05:57.386161 tst emergency_mo_mt_call.py:19: Test FAILED (6.2 sec) 04:05:57.414229 run osmo-hlr_10.42.42.2(pid=21850): ERR: Terminated: ERROR {rc=237} [trial-2354↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21850)] 04:05:57.465149 run osmo-hlr_10.42.42.2(pid=21850): stdout: | (launched: 2022-12-09_04:05:54.299681) 04:05:57.517644 run osmo-hlr_10.42.42.2(pid=21850): stderr: | 20221209040554497 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209040554497 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209040554497 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209040554497 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209040554497 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209040554497 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209040554509 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/emergency:trx-sysmocell5000/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209040554518 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209040554518 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209040554518 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:05:57.591003 run osmo-msc_10.42.42.6(pid=21856): ERR: Terminated: ERROR {rc=2} [trial-2354↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21856)] 04:05:57.641722 run osmo-msc_10.42.42.6(pid=21856): stdout: | (launched: 2022-12-09_04:05:56.462964) 04:05:57.694203 run osmo-msc_10.42.42.6(pid=21856): stderr: | 20221209040556781 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209040556781 DLGLOBAL DEBUG validating counter group 0x7f45951fcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209040556781 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209040556782 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209040556782 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209040556782 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209040556784 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209040556784 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209040556784 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209040556784 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:05:57.747115 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21849): Terminating (SIGTERM) 04:05:57.789536 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21852): Terminating (SIGTERM) 04:05:57.832181 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21855): Terminating (SIGTERM) 04:05:57.874930 --- ParallelTerminationStrategy: PID 21849 died... 04:05:57.894957 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21849): Terminated: ok {rc=0} 04:05:57.942009 --- ParallelTerminationStrategy: PID 21852 died... 04:05:57.961742 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21852): Terminated: ok {rc=0} 04:05:58.008643 --- ParallelTerminationStrategy: PID 21855 died... 04:05:58.028356 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21855): Terminated: ok {rc=0} 04:05:58.117258 bus /sierra_3: Setting Powered False 04:05:59.216124 bus /sierra_3: Setting Powered False 04:06:00.332723 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2354 emergency:trx-sysmocell5000 emergency_preemptive_call.py ---------------------------------------------- 04:06:01.422344 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:06:01.436562 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 04:06:01.490809 tst emergency_preemptive_call.py: using LAC 18952 04:06:01.644425 tst emergency_preemptive_call.py: using RAC 82 04:06:01.777917 tst emergency_preemptive_call.py: using CellId 18952 04:06:01.904431 tst emergency_preemptive_call.py: using BVCI 18953 04:06:02.055921 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:06:02.068602 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:06:02.080502 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:06:02.093361 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:06:02.105990 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:06:02.118661 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 04:06:02.240104 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 04:06:02.369665 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 04:06:02.488061 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 04:06:02.605385 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:06:03.094986 run create_hlr_db(pid=21858): Launched 04:06:03.215492 bus /sierra_2: Setting Powered False 04:06:04.278836 run create_hlr_db(pid=21858): Terminated: ok {rc=0} 04:06:04.701767 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21860): Launched 04:06:04.997044 run osmo-hlr_10.42.42.2(pid=21861): Launched 04:06:05.110239 run osmo-stp_10.42.42.5: Starting osmo-stp 04:06:05.632086 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21863): Launched 04:06:05.927250 run osmo-stp_10.42.42.5(pid=21864): Launched 04:06:06.049294 tst emergency_preemptive_call.py: using MSISDN 7019 04:06:06.201151 run osmo-msc_10.42.42.6: Starting osmo-msc 04:06:06.731238 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21866): Launched 04:06:07.025060 run osmo-msc_10.42.42.6(pid=21867): Launched 04:06:07.190819 run osmo-stp_10.42.42.5(pid=21864): ERR: Terminated: ERROR {rc=1} [trial-2354↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21864)] 04:06:07.316256 run osmo-stp_10.42.42.5(pid=21864): stdout: | (launched: 2022-12-09_04:06:05.872271) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:06:07.441941 run osmo-stp_10.42.42.5(pid=21864): stderr: | 20221209040606041 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040606041 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040606041 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040606042 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040606043 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040606043 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040606043 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:06:07.565503 run osmo-stp_10.42.42.5(pid=21864): stdout: | (launched: 2022-12-09_04:06:05.872271) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:06:07.682768 run osmo-stp_10.42.42.5(pid=21864): stderr: | 20221209040606041 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040606041 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040606041 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040606042 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040606043 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040606043 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040606043 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:06:07.822850 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=21864): Process ended prematurely: osmo-stp_10.42.42.5(pid=21864) [trial-2354↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21864)] [trial-2354↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32] 04:06:07.831702 tst emergency_preemptive_call.py:32: Test FAILED (6.4 sec) 04:06:07.858017 run osmo-hlr_10.42.42.2(pid=21861): ERR: Terminated: ERROR {rc=237} [trial-2354↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21861)] 04:06:07.906019 run osmo-hlr_10.42.42.2(pid=21861): stdout: | (launched: 2022-12-09_04:06:04.942930) 04:06:07.956013 run osmo-hlr_10.42.42.2(pid=21861): stderr: | 20221209040605119 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209040605120 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209040605120 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209040605120 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209040605120 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209040605120 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209040605134 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/emergency:trx-sysmocell5000/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209040605142 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209040605142 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209040605142 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:06:08.025958 run osmo-msc_10.42.42.6(pid=21867): ERR: Terminated: ERROR {rc=2} [trial-2354↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21867)] 04:06:08.074159 run osmo-msc_10.42.42.6(pid=21867): stdout: | (launched: 2022-12-09_04:06:06.970791) 04:06:08.124120 run osmo-msc_10.42.42.6(pid=21867): stderr: | 20221209040607242 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209040607242 DLGLOBAL DEBUG validating counter group 0x7f684540fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209040607242 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209040607242 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209040607242 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209040607243 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209040607245 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209040607246 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209040607246 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209040607246 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:06:08.174210 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21860): Terminating (SIGTERM) 04:06:08.214098 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21863): Terminating (SIGTERM) 04:06:08.253806 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21866): Terminating (SIGTERM) 04:06:08.294212 --- ParallelTerminationStrategy: PID 21860 died... 04:06:08.313492 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21860): Terminated: ok {rc=0} 04:06:08.357577 --- ParallelTerminationStrategy: PID 21863 died... 04:06:08.376193 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21863): Terminated: ok {rc=0} 04:06:08.420596 --- ParallelTerminationStrategy: PID 21866 died... 04:06:08.439349 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21866): Terminated: ok {rc=0} 04:06:08.526266 bus /sierra_9: Setting Powered False 04:06:09.627796 bus /sierra_9: Setting Powered False 04:06:10.744683 bus /sierra_8: Setting Powered False 04:06:11.844027 bus /sierra_8: Setting Powered False 04:06:12.959592 bus /sierra_3: Setting Powered False 04:06:14.058838 bus /sierra_3: Setting Powered False 04:06:15.173191 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 emergency:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 gprs:trx-sysmocell5000 --------------------------------------------------------------------- 04:06:16.491548 tst gprs:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:06:16.497562 tst gprs:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 04:06:16.538498 tst gprs:trx-sysmocell5000: Verifying 9 x ip_address (candidates: 9) 04:06:16.584365 tst gprs:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 04:06:16.684273 tst gprs:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 04:06:16.725010 tst gprs:trx-sysmocell5000: Reserving 9 x ip_address (candidates: 9) 04:06:16.771382 tst gprs:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 04:06:17.355773 tst gprs:trx-sysmocell5000: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2354 gprs:trx-sysmocell5000 cs_paging_gprs_active.py ---------------------------------------------- 04:06:17.410404 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:06:17.421762 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 04:06:17.478050 tst cs_paging_gprs_active.py: using LAC 18953 04:06:17.604834 tst cs_paging_gprs_active.py: using RAC 83 04:06:17.734102 tst cs_paging_gprs_active.py: using CellId 18953 04:06:17.864010 tst cs_paging_gprs_active.py: using BVCI 18954 04:06:17.983321 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:06:17.994736 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:06:18.005713 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:06:18.017549 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:06:18.028322 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:06:18.039352 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:06:18.050431 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:06:18.062739 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:06:18.074802 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 04:06:18.195801 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 04:06:18.316432 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 04:06:18.538034 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:06:18.861961 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21876): Launched 04:06:19.143255 run iperf3-srv_10.42.42.10(pid=21877): Launched 04:06:19.265564 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 04:06:19.483130 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:06:19.807553 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21878): Launched 04:06:20.089581 run iperf3-srv_10.42.42.10(pid=21879): Launched 04:06:20.211620 tst cs_paging_gprs_active.py:38: start network... 04:06:20.429299 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:06:20.930858 run create_hlr_db(pid=21880): Launched 04:06:21.053867 bus /sierra_2: Setting Powered False 04:06:22.117214 run create_hlr_db(pid=21880): Terminated: ok {rc=0} 04:06:22.568055 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21882): Launched 04:06:22.891362 run osmo-hlr_10.42.42.2(pid=21883): Launched 04:06:23.015291 run osmo-stp_10.42.42.5: Starting osmo-stp 04:06:23.573397 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21885): Launched 04:06:23.896026 run osmo-stp_10.42.42.5(pid=21886): Launched 04:06:24.020002 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:06:24.577649 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21888): Launched 04:06:24.701889 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:06:24.975021 run patchelf(pid=21889): Launched 04:06:25.155440 run osmo-stp_10.42.42.5(pid=21886): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21886)] 04:06:25.293210 run osmo-stp_10.42.42.5(pid=21886): stdout: | (launched: 2022-12-09_04:06:23.837307) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:06:25.431688 run osmo-stp_10.42.42.5(pid=21886): stderr: | 20221209040624030 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040624030 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040624031 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040624031 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040624031 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040624031 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040624031 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:06:25.570265 run osmo-stp_10.42.42.5(pid=21886): stdout: | (launched: 2022-12-09_04:06:23.837307) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:06:25.703023 run osmo-stp_10.42.42.5(pid=21886): stderr: | 20221209040624030 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040624030 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040624031 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040624031 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040624031 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040624031 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040624031 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:06:25.860255 run patchelf(pid=21889): Terminating (SIGINT) 04:06:26.042884 run patchelf(pid=21889): Terminated: ok {rc=0} 04:06:26.174289 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=21886): Process ended prematurely: osmo-stp_10.42.42.5(pid=21886) [trial-2354↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21886)] [trial-2354↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38] 04:06:26.184517 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 04:06:26.214139 run osmo-hlr_10.42.42.2(pid=21883): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21883)] 04:06:26.265167 run osmo-hlr_10.42.42.2(pid=21883): stdout: | (launched: 2022-12-09_04:06:22.832349) 04:06:26.317909 run osmo-hlr_10.42.42.2(pid=21883): stderr: | 20221209040623029 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209040623029 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209040623029 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209040623029 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209040623029 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209040623029 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209040623042 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-sysmocell5000/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209040623051 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209040623051 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209040623051 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:06:26.370812 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21876): Terminating (SIGTERM) 04:06:26.413438 run iperf3-srv_10.42.42.10(pid=21877): Terminating (SIGTERM) 04:06:26.456093 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21878): Terminating (SIGTERM) 04:06:26.498676 run iperf3-srv_10.42.42.10(pid=21879): Terminating (SIGTERM) 04:06:26.541132 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21882): Terminating (SIGTERM) 04:06:26.583627 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21885): Terminating (SIGTERM) 04:06:26.626079 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21888): Terminating (SIGTERM) 04:06:26.668835 --- ParallelTerminationStrategy: PID 21876 died... 04:06:26.688930 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21876): Terminated: ok {rc=0} 04:06:26.735964 --- ParallelTerminationStrategy: PID 21877 died... 04:06:26.755510 run iperf3-srv_10.42.42.10(pid=21877): Terminated {rc=256} 04:06:26.802141 --- ParallelTerminationStrategy: PID 21878 died... 04:06:26.821810 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21878): Terminated: ok {rc=0} 04:06:26.868485 --- ParallelTerminationStrategy: PID 21879 died... 04:06:26.888041 run iperf3-srv_10.42.42.10(pid=21879): Terminated {rc=256} 04:06:26.934715 --- ParallelTerminationStrategy: PID 21882 died... 04:06:26.954353 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21882): Terminated: ok {rc=0} 04:06:27.001218 --- ParallelTerminationStrategy: PID 21885 died... 04:06:27.020816 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21885): Terminated: ok {rc=0} 04:06:27.067941 --- ParallelTerminationStrategy: PID 21888 died... 04:06:27.087692 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21888): Terminated: ok {rc=0} 04:06:27.176125 bus /gobi_0: Setting Powered False 04:06:28.277983 bus /gobi_0: Setting Powered False 04:06:29.394859 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:trx-sysmocell5000 iperf3.py ---------------------------------------------- 04:06:30.542436 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:06:30.553679 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 04:06:30.605652 tst iperf3.py: using LAC 18954 04:06:30.733191 tst iperf3.py: using RAC 84 04:06:30.863280 tst iperf3.py: using CellId 18954 04:06:31.011178 tst iperf3.py: using BVCI 18955 04:06:31.140147 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:06:31.151731 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:06:31.162997 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:06:31.174463 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:06:31.185851 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:06:31.196890 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:06:31.208294 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:06:31.219584 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:06:31.230929 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 04:06:31.364248 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 04:06:31.605476 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:06:31.942709 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21890): Launched 04:06:32.234860 run iperf3-srv_10.42.42.10(pid=21891): Launched 04:06:32.356604 tst iperf3.py:8: start network... 04:06:32.568271 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:06:33.035431 run create_hlr_db(pid=21892): Launched 04:06:33.159710 bus /gobi_6: Setting Powered False 04:06:34.219992 run create_hlr_db(pid=21892): Terminated: ok {rc=0} 04:06:34.640928 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21894): Launched 04:06:34.941834 run osmo-hlr_10.42.42.2(pid=21895): Launched 04:06:35.056268 run osmo-stp_10.42.42.5: Starting osmo-stp 04:06:35.588482 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21897): Launched 04:06:35.889383 run osmo-stp_10.42.42.5(pid=21898): Launched 04:06:36.004028 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:06:36.524762 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21900): Launched 04:06:36.640076 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:06:36.894577 run patchelf(pid=21901): Launched 04:06:37.062384 run osmo-stp_10.42.42.5(pid=21898): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21898)] 04:06:37.189767 run osmo-stp_10.42.42.5(pid=21898): stdout: | (launched: 2022-12-09_04:06:35.833885) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:06:37.318816 run osmo-stp_10.42.42.5(pid=21898): stderr: | 20221209040636005 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040636005 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040636005 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040636005 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040636006 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040636006 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040636006 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:06:37.447981 run osmo-stp_10.42.42.5(pid=21898): stdout: | (launched: 2022-12-09_04:06:35.833885) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:06:37.571603 run osmo-stp_10.42.42.5(pid=21898): stderr: | 20221209040636005 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040636005 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040636005 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040636005 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040636006 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040636006 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040636006 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:06:37.717721 run patchelf(pid=21901): Terminating (SIGINT) 04:06:37.887287 run patchelf(pid=21901): Terminated: ok {rc=0} 04:06:38.009724 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21898): Process ended prematurely: osmo-stp_10.42.42.5(pid=21898) [trial-2354↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21898)] [trial-2354↪gprs:trx-sysmocell5000↪iperf3.py:8] 04:06:38.019237 tst iperf3.py:8: Test FAILED (7.5 sec) 04:06:38.046723 run osmo-hlr_10.42.42.2(pid=21895): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-sysmocell5000↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21895)] 04:06:38.095065 run osmo-hlr_10.42.42.2(pid=21895): stdout: | (launched: 2022-12-09_04:06:34.886861) 04:06:38.145488 run osmo-hlr_10.42.42.2(pid=21895): stderr: | 20221209040635062 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209040635062 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209040635062 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209040635062 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209040635063 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209040635063 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209040635075 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-sysmocell5000/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209040635084 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209040635084 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209040635084 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:06:38.195809 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21890): Terminating (SIGTERM) 04:06:38.235887 run iperf3-srv_10.42.42.10(pid=21891): Terminating (SIGTERM) 04:06:38.275657 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21894): Terminating (SIGTERM) 04:06:38.315604 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21897): Terminating (SIGTERM) 04:06:38.355526 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21900): Terminating (SIGTERM) 04:06:38.395644 --- ParallelTerminationStrategy: PID 21890 died... 04:06:38.414917 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21890): Terminated: ok {rc=0} 04:06:38.459373 --- ParallelTerminationStrategy: PID 21891 died... 04:06:38.478062 run iperf3-srv_10.42.42.10(pid=21891): Terminated {rc=256} 04:06:38.523551 --- ParallelTerminationStrategy: PID 21894 died... 04:06:38.542634 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21894): Terminated: ok {rc=0} 04:06:38.586942 --- ParallelTerminationStrategy: PID 21897 died... 04:06:38.605881 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21897): Terminated: ok {rc=0} 04:06:38.650176 --- ParallelTerminationStrategy: PID 21900 died... 04:06:38.668918 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21900): Terminated: ok {rc=0} 04:06:38.756105 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:trx-sysmocell5000 iperf3m4.py ---------------------------------------------- 04:06:39.904139 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:06:39.915537 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 04:06:39.965886 tst iperf3m4.py: using LAC 18955 04:06:40.085034 tst iperf3m4.py: using RAC 85 04:06:40.203985 tst iperf3m4.py: using CellId 18955 04:06:40.323180 tst iperf3m4.py: using BVCI 18956 04:06:40.432642 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:06:40.443413 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:06:40.454039 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:06:40.464434 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:06:40.474816 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:06:40.485158 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:06:40.495709 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:06:40.506172 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:06:40.516595 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 04:06:40.636366 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 04:06:40.759838 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 04:06:40.879838 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 04:06:40.999138 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 04:06:41.216039 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:06:41.540174 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21902): Launched 04:06:41.820916 run iperf3-srv_10.42.42.10(pid=21903): Launched 04:06:41.942264 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 04:06:42.159118 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:06:42.483344 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21904): Launched 04:06:42.764214 run iperf3-srv_10.42.42.10(pid=21905): Launched 04:06:42.885503 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 04:06:43.102296 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:06:43.426758 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21906): Launched 04:06:43.707085 run iperf3-srv_10.42.42.10(pid=21907): Launched 04:06:43.828383 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 04:06:44.044817 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:06:44.369144 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21908): Launched 04:06:44.650116 run iperf3-srv_10.42.42.10(pid=21909): Launched 04:06:44.771135 tst iperf3m4.py:8: start network... 04:06:44.987576 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:06:45.488579 run create_hlr_db(pid=21910): Launched 04:06:45.611621 bus /gobi_6: Setting Powered False 04:06:46.674514 run create_hlr_db(pid=21910): Terminated: ok {rc=0} 04:06:47.172510 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21912): Launched 04:06:47.507392 run osmo-hlr_10.42.42.2(pid=21913): Launched 04:06:47.631427 run osmo-stp_10.42.42.5: Starting osmo-stp 04:06:48.191810 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21915): Launched 04:06:48.515391 run osmo-stp_10.42.42.5(pid=21916): Launched 04:06:48.638170 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:06:49.192685 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21918): Launched 04:06:49.316588 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:06:49.589276 run patchelf(pid=21919): Launched 04:06:49.769080 run osmo-stp_10.42.42.5(pid=21916): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21916)] 04:06:49.905615 run osmo-stp_10.42.42.5(pid=21916): stdout: | (launched: 2022-12-09_04:06:48.456259) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:06:50.044395 run osmo-stp_10.42.42.5(pid=21916): stderr: | 20221209040648645 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040648645 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040648646 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040648646 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040648646 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040648646 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040648647 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:06:50.183273 run osmo-stp_10.42.42.5(pid=21916): stdout: | (launched: 2022-12-09_04:06:48.456259) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:06:50.316652 run osmo-stp_10.42.42.5(pid=21916): stderr: | 20221209040648645 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040648645 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040648646 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040648646 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040648646 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040648646 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040648647 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:06:50.473841 run patchelf(pid=21919): Terminating (SIGINT) 04:06:50.655817 run patchelf(pid=21919): Terminated: ok {rc=0} 04:06:50.786797 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21916): Process ended prematurely: osmo-stp_10.42.42.5(pid=21916) [trial-2354↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21916)] [trial-2354↪gprs:trx-sysmocell5000↪iperf3m4.py:8] 04:06:50.797104 tst iperf3m4.py:8: Test FAILED (10.9 sec) 04:06:50.826717 run osmo-hlr_10.42.42.2(pid=21913): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-sysmocell5000↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21913)] 04:06:50.877421 run osmo-hlr_10.42.42.2(pid=21913): stdout: | (launched: 2022-12-09_04:06:47.447976) 04:06:50.929940 run osmo-hlr_10.42.42.2(pid=21913): stderr: | 20221209040647644 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209040647644 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209040647644 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209040647644 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209040647644 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209040647644 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209040647657 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-sysmocell5000/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209040647666 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209040647666 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209040647666 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:06:50.983001 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21902): Terminating (SIGTERM) 04:06:51.025260 run iperf3-srv_10.42.42.10(pid=21903): Terminating (SIGTERM) 04:06:51.067493 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21904): Terminating (SIGTERM) 04:06:51.109852 run iperf3-srv_10.42.42.10(pid=21905): Terminating (SIGTERM) 04:06:51.152062 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21906): Terminating (SIGTERM) 04:06:51.194259 run iperf3-srv_10.42.42.10(pid=21907): Terminating (SIGTERM) 04:06:51.236748 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21908): Terminating (SIGTERM) 04:06:51.279149 run iperf3-srv_10.42.42.10(pid=21909): Terminating (SIGTERM) 04:06:51.321217 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21912): Terminating (SIGTERM) 04:06:51.363427 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21915): Terminating (SIGTERM) 04:06:51.405722 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21918): Terminating (SIGTERM) 04:06:51.448161 --- ParallelTerminationStrategy: PID 21902 died... 04:06:51.468302 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21902): Terminated: ok {rc=0} 04:06:51.515255 --- ParallelTerminationStrategy: PID 21903 died... 04:06:51.534962 run iperf3-srv_10.42.42.10(pid=21903): Terminated {rc=256} 04:06:51.581594 --- ParallelTerminationStrategy: PID 21904 died... 04:06:51.601182 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21904): Terminated: ok {rc=0} 04:06:51.648022 --- ParallelTerminationStrategy: PID 21905 died... 04:06:51.667604 run iperf3-srv_10.42.42.10(pid=21905): Terminated {rc=256} 04:06:51.714298 --- ParallelTerminationStrategy: PID 21906 died... 04:06:51.733852 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21906): Terminated: ok {rc=0} 04:06:51.780250 --- ParallelTerminationStrategy: PID 21907 died... 04:06:51.799940 run iperf3-srv_10.42.42.10(pid=21907): Terminated {rc=256} 04:06:51.846811 --- ParallelTerminationStrategy: PID 21908 died... 04:06:51.866581 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21908): Terminated: ok {rc=0} 04:06:51.913285 --- ParallelTerminationStrategy: PID 21909 died... 04:06:51.932898 run iperf3-srv_10.42.42.10(pid=21909): Terminated {rc=256} 04:06:51.979619 --- ParallelTerminationStrategy: PID 21912 died... 04:06:51.999281 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21912): Terminated: ok {rc=0} 04:06:52.046518 --- ParallelTerminationStrategy: PID 21915 died... 04:06:52.066276 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21915): Terminated: ok {rc=0} 04:06:52.113359 --- ParallelTerminationStrategy: PID 21918 died... 04:06:52.133072 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21918): Terminated: ok {rc=0} 04:06:52.222053 bus /gobi_4: Setting Powered False 04:06:53.321616 bus /gobi_4: Setting Powered False 04:06:54.437276 bus /gobi_1: Setting Powered False 04:06:55.535896 bus /gobi_1: Setting Powered False 04:06:56.655627 bus /gobi_0: Setting Powered False 04:06:57.755356 bus /gobi_0: Setting Powered False 04:06:58.872909 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:trx-sysmocell5000 ping.py ---------------------------------------------- 04:06:59.976840 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:06:59.988280 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 04:07:00.041079 tst ping.py: using LAC 18956 04:07:00.156883 tst ping.py: using RAC 86 04:07:00.271377 tst ping.py: using CellId 18956 04:07:00.385985 tst ping.py: using BVCI 18957 04:07:00.494853 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:07:00.505570 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:07:00.516191 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:07:00.526772 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:07:00.537279 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:07:00.547669 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:07:00.558285 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:07:00.568781 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 04:07:00.682580 tst ping.py:19: start network... 04:07:00.886134 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:07:01.368617 run create_hlr_db(pid=21920): Launched 04:07:01.513782 bus /gobi_6: Setting Powered False 04:07:02.576101 run create_hlr_db(pid=21920): Terminated: ok {rc=0} 04:07:03.044894 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21922): Launched 04:07:03.340239 run osmo-hlr_10.42.42.2(pid=21923): Launched 04:07:03.452346 run osmo-stp_10.42.42.5: Starting osmo-stp 04:07:03.962876 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21926): Launched 04:07:04.257795 run osmo-stp_10.42.42.5(pid=21927): Launched 04:07:04.382451 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:07:04.932588 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21929): Launched 04:07:05.055081 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:07:05.322982 run patchelf(pid=21930): Launched 04:07:05.499507 run osmo-stp_10.42.42.5(pid=21927): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21927)] 04:07:05.634328 run osmo-stp_10.42.42.5(pid=21927): stdout: | (launched: 2022-12-09_04:07:04.202658) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:07:05.770793 run osmo-stp_10.42.42.5(pid=21927): stderr: | 20221209040704387 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040704387 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040704388 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040704388 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040704389 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040704389 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040704389 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:07:05.907322 run osmo-stp_10.42.42.5(pid=21927): stdout: | (launched: 2022-12-09_04:07:04.202658) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:07:06.037616 run osmo-stp_10.42.42.5(pid=21927): stderr: | 20221209040704387 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040704387 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040704388 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040704388 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040704389 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040704389 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040704389 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:07:06.191988 run patchelf(pid=21930): Terminating (SIGINT) 04:07:06.371198 run patchelf(pid=21930): Terminated: ok {rc=0} 04:07:06.500066 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=21927): Process ended prematurely: osmo-stp_10.42.42.5(pid=21927) [trial-2354↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21927)] [trial-2354↪gprs:trx-sysmocell5000↪ping.py:22] 04:07:06.509760 tst ping.py:22: Test FAILED (6.5 sec) 04:07:06.538973 run osmo-hlr_10.42.42.2(pid=21923): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-sysmocell5000↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21923)] 04:07:06.590256 run osmo-hlr_10.42.42.2(pid=21923): stdout: | (launched: 2022-12-09_04:07:03.285966) 04:07:06.643136 run osmo-hlr_10.42.42.2(pid=21923): stderr: | 20221209040703461 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209040703461 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209040703461 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209040703461 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209040703461 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209040703461 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209040703472 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-sysmocell5000/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209040703483 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209040703483 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209040703483 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:07:06.696717 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21922): Terminating (SIGTERM) 04:07:06.739616 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21926): Terminating (SIGTERM) 04:07:06.782655 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21929): Terminating (SIGTERM) 04:07:06.825770 --- ParallelTerminationStrategy: PID 21922 died... 04:07:06.846272 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21922): Terminated: ok {rc=0} 04:07:06.893972 --- ParallelTerminationStrategy: PID 21926 died... 04:07:06.914073 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21926): Terminated: ok {rc=0} 04:07:06.961588 --- ParallelTerminationStrategy: PID 21929 died... 04:07:06.981600 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21929): Terminated: ok {rc=0} 04:07:07.070694 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:trx-sysmocell5000 ping_idle_ping.py ---------------------------------------------- 04:07:08.160569 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:07:08.172042 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 04:07:08.223766 tst ping_idle_ping.py: using LAC 18957 04:07:08.342524 tst ping_idle_ping.py: using RAC 87 04:07:08.461721 tst ping_idle_ping.py: using CellId 18957 04:07:08.588487 tst ping_idle_ping.py: using BVCI 18958 04:07:08.698249 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:07:08.709193 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:07:08.719731 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:07:08.730794 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:07:08.741910 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:07:08.753393 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:07:08.765921 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:07:08.778566 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 04:07:08.898916 tst ping_idle_ping.py:24: start network... 04:07:09.112425 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:07:09.608761 run create_hlr_db(pid=21931): Launched 04:07:09.730315 bus /gobi_6: Setting Powered False 04:07:10.794357 run create_hlr_db(pid=21931): Terminated: ok {rc=0} 04:07:11.221521 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21933): Launched 04:07:11.519431 run osmo-hlr_10.42.42.2(pid=21934): Launched 04:07:11.634626 run osmo-stp_10.42.42.5: Starting osmo-stp 04:07:12.144424 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21936): Launched 04:07:12.439742 run osmo-stp_10.42.42.5(pid=21937): Launched 04:07:12.553415 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:07:13.064736 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21939): Launched 04:07:13.177644 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:07:13.426976 run patchelf(pid=21940): Launched 04:07:13.591776 run osmo-stp_10.42.42.5(pid=21937): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21937)] 04:07:13.716654 run osmo-stp_10.42.42.5(pid=21937): stdout: | (launched: 2022-12-09_04:07:12.385396) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:07:13.843188 run osmo-stp_10.42.42.5(pid=21937): stderr: | 20221209040712554 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040712554 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040712555 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040712555 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040712556 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040712556 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040712556 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:07:13.970506 run osmo-stp_10.42.42.5(pid=21937): stdout: | (launched: 2022-12-09_04:07:12.385396) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:07:14.091763 run osmo-stp_10.42.42.5(pid=21937): stderr: | 20221209040712554 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040712554 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040712555 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040712555 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040712556 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040712556 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040712556 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:07:14.235152 run patchelf(pid=21940): Terminating (SIGINT) 04:07:14.402121 run patchelf(pid=21940): Terminated: ok {rc=0} 04:07:14.522225 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=21937): Process ended prematurely: osmo-stp_10.42.42.5(pid=21937) [trial-2354↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21937)] [trial-2354↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27] 04:07:14.531075 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 04:07:14.557909 run osmo-hlr_10.42.42.2(pid=21934): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-sysmocell5000↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21934)] 04:07:14.605941 run osmo-hlr_10.42.42.2(pid=21934): stdout: | (launched: 2022-12-09_04:07:11.464750) 04:07:14.655732 run osmo-hlr_10.42.42.2(pid=21934): stderr: | 20221209040711637 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209040711637 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209040711637 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209040711637 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209040711637 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209040711637 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209040711649 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-sysmocell5000/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209040711659 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209040711660 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209040711660 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:07:14.705912 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21933): Terminating (SIGTERM) 04:07:14.745855 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21936): Terminating (SIGTERM) 04:07:14.785670 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21939): Terminating (SIGTERM) 04:07:14.826160 --- ParallelTerminationStrategy: PID 21933 died... 04:07:14.845486 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21933): Terminated: ok {rc=0} 04:07:14.890206 --- ParallelTerminationStrategy: PID 21936 died... 04:07:14.909087 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21936): Terminated: ok {rc=0} 04:07:14.953376 --- ParallelTerminationStrategy: PID 21939 died... 04:07:14.972346 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21939): Terminated: ok {rc=0} 04:07:15.056245 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2354 gprs:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 gprs:trx-sysmocell5000+mod-bts0-egprs --------------------------------------------------------------------- 04:07:16.367920 tst gprs:trx-sysmocell5000+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:07:16.374684 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 04:07:16.413899 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 04:07:16.457138 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 04:07:16.548652 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 04:07:16.601963 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 04:07:16.644216 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 04:07:17.226401 tst gprs:trx-sysmocell5000+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2354 gprs:trx-sysmocell5000+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 04:07:17.275500 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:07:17.286585 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:07:17.335485 tst cs_paging_gprs_active.py: using LAC 18958 04:07:17.452336 tst cs_paging_gprs_active.py: using RAC 88 04:07:17.569332 tst cs_paging_gprs_active.py: using CellId 18958 04:07:17.687989 tst cs_paging_gprs_active.py: using BVCI 18959 04:07:17.797310 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:07:17.809549 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:07:17.820120 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:07:17.830921 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:07:17.841743 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:07:17.852527 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:07:17.863398 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:07:17.874227 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:07:17.885112 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:07:18.005214 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:07:18.126375 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 04:07:18.346217 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:07:18.673942 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21944): Launched 04:07:18.956528 run iperf3-srv_10.42.42.10(pid=21945): Launched 04:07:19.078990 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 04:07:19.297545 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:07:19.622623 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21946): Launched 04:07:19.905220 run iperf3-srv_10.42.42.10(pid=21947): Launched 04:07:20.027232 tst cs_paging_gprs_active.py:38: start network... 04:07:20.246005 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:07:20.748551 run create_hlr_db(pid=21948): Launched 04:07:20.873903 bus /gobi_6: Setting Powered False 04:07:21.938488 run create_hlr_db(pid=21948): Terminated: ok {rc=0} 04:07:22.390540 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21950): Launched 04:07:22.715442 run osmo-hlr_10.42.42.2(pid=21951): Launched 04:07:22.840152 run osmo-stp_10.42.42.5: Starting osmo-stp 04:07:23.400716 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21953): Launched 04:07:23.724551 run osmo-stp_10.42.42.5(pid=21954): Launched 04:07:23.849242 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:07:24.410234 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21956): Launched 04:07:24.534241 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:07:24.807577 run patchelf(pid=21957): Launched 04:07:24.987726 run osmo-stp_10.42.42.5(pid=21954): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21954)] 04:07:25.125526 run osmo-stp_10.42.42.5(pid=21954): stdout: | (launched: 2022-12-09_04:07:23.665685) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:07:25.264729 run osmo-stp_10.42.42.5(pid=21954): stderr: | 20221209040723857 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040723857 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040723858 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040723858 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040723859 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040723859 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040723859 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:07:25.403883 run osmo-stp_10.42.42.5(pid=21954): stdout: | (launched: 2022-12-09_04:07:23.665685) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:07:25.537409 run osmo-stp_10.42.42.5(pid=21954): stderr: | 20221209040723857 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040723857 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040723858 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040723858 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040723859 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040723859 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040723859 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:07:25.695550 run patchelf(pid=21957): Terminating (SIGINT) 04:07:25.878492 run patchelf(pid=21957): Terminated: ok {rc=0} 04:07:26.010528 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=21954): Process ended prematurely: osmo-stp_10.42.42.5(pid=21954) [trial-2354↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21954)] [trial-2354↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 04:07:26.020708 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 04:07:26.050303 run osmo-hlr_10.42.42.2(pid=21951): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21951)] 04:07:26.101905 run osmo-hlr_10.42.42.2(pid=21951): stdout: | (launched: 2022-12-09_04:07:22.656325) 04:07:26.155085 run osmo-hlr_10.42.42.2(pid=21951): stderr: | 20221209040722853 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209040722853 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209040722853 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209040722853 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209040722853 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209040722853 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209040722866 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-sysmocell5000+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209040722874 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209040722875 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209040722875 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:07:26.208807 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21944): Terminating (SIGTERM) 04:07:26.252234 run iperf3-srv_10.42.42.10(pid=21945): Terminating (SIGTERM) 04:07:26.295264 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21946): Terminating (SIGTERM) 04:07:26.338601 run iperf3-srv_10.42.42.10(pid=21947): Terminating (SIGTERM) 04:07:26.381553 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21950): Terminating (SIGTERM) 04:07:26.424580 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21953): Terminating (SIGTERM) 04:07:26.468186 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21956): Terminating (SIGTERM) 04:07:26.511566 --- ParallelTerminationStrategy: PID 21944 died... 04:07:26.531954 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21944): Terminated: ok {rc=0} 04:07:26.579442 --- ParallelTerminationStrategy: PID 21945 died... 04:07:26.599491 run iperf3-srv_10.42.42.10(pid=21945): Terminated {rc=256} 04:07:26.646882 --- ParallelTerminationStrategy: PID 21946 died... 04:07:26.666892 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21946): Terminated: ok {rc=0} 04:07:26.714260 --- ParallelTerminationStrategy: PID 21947 died... 04:07:26.734250 run iperf3-srv_10.42.42.10(pid=21947): Terminated {rc=256} 04:07:26.781651 --- ParallelTerminationStrategy: PID 21950 died... 04:07:26.801709 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21950): Terminated: ok {rc=0} 04:07:26.849267 --- ParallelTerminationStrategy: PID 21953 died... 04:07:26.869391 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21953): Terminated: ok {rc=0} 04:07:26.917246 --- ParallelTerminationStrategy: PID 21956 died... 04:07:26.937317 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21956): Terminated: ok {rc=0} 04:07:27.027325 bus /gobi_0: Setting Powered False 04:07:28.128688 bus /gobi_0: Setting Powered False 04:07:29.250468 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3.py ---------------------------------------------- 04:07:30.399437 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:07:30.411041 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:07:30.464557 tst iperf3.py: using LAC 18959 04:07:30.582236 tst iperf3.py: using RAC 89 04:07:30.699643 tst iperf3.py: using CellId 18959 04:07:30.828871 tst iperf3.py: using BVCI 18960 04:07:30.980160 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:07:30.997121 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:07:31.013345 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:07:31.025948 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:07:31.037827 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:07:31.050368 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:07:31.064793 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:07:31.076460 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:07:31.089250 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:07:31.234107 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 04:07:31.459303 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:07:31.797744 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21958): Launched 04:07:32.091937 run iperf3-srv_10.42.42.10(pid=21959): Launched 04:07:32.217488 tst iperf3.py:8: start network... 04:07:32.436187 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:07:32.938307 run create_hlr_db(pid=21960): Launched 04:07:33.062046 bus /gobi_6: Setting Powered False 04:07:34.126420 run create_hlr_db(pid=21960): Terminated: ok {rc=0} 04:07:34.577722 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21962): Launched 04:07:34.901597 run osmo-hlr_10.42.42.2(pid=21963): Launched 04:07:35.025475 run osmo-stp_10.42.42.5: Starting osmo-stp 04:07:35.585451 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21965): Launched 04:07:35.905847 run osmo-stp_10.42.42.5(pid=21968): Launched 04:07:36.023227 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:07:36.542734 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21970): Launched 04:07:36.658210 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:07:36.912403 run patchelf(pid=21971): Launched 04:07:37.080473 run osmo-stp_10.42.42.5(pid=21968): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21968)] 04:07:37.207595 run osmo-stp_10.42.42.5(pid=21968): stdout: | (launched: 2022-12-09_04:07:35.850582) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:07:37.336754 run osmo-stp_10.42.42.5(pid=21968): stderr: | 20221209040736019 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040736019 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040736019 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040736019 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040736020 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040736020 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040736020 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:07:37.465708 run osmo-stp_10.42.42.5(pid=21968): stdout: | (launched: 2022-12-09_04:07:35.850582) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:07:37.589076 run osmo-stp_10.42.42.5(pid=21968): stderr: | 20221209040736019 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040736019 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040736019 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040736019 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040736020 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040736020 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040736020 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:07:37.734827 run patchelf(pid=21971): Terminating (SIGINT) 04:07:37.904055 run patchelf(pid=21971): Terminated: ok {rc=0} 04:07:38.026049 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21968): Process ended prematurely: osmo-stp_10.42.42.5(pid=21968) [trial-2354↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21968)] [trial-2354↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8] 04:07:38.035572 tst iperf3.py:8: Test FAILED (7.7 sec) 04:07:38.062743 run osmo-hlr_10.42.42.2(pid=21963): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21963)] 04:07:38.110528 run osmo-hlr_10.42.42.2(pid=21963): stdout: | (launched: 2022-12-09_04:07:34.842571) 04:07:38.159794 run osmo-hlr_10.42.42.2(pid=21963): stderr: | 20221209040735043 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209040735043 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209040735043 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209040735043 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209040735044 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209040735044 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209040735057 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209040735065 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209040735065 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209040735065 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:07:38.209668 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21958): Terminating (SIGTERM) 04:07:38.249619 run iperf3-srv_10.42.42.10(pid=21959): Terminating (SIGTERM) 04:07:38.290008 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21962): Terminating (SIGTERM) 04:07:38.330008 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21965): Terminating (SIGTERM) 04:07:38.370119 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21970): Terminating (SIGTERM) 04:07:38.410440 --- ParallelTerminationStrategy: PID 21958 died... 04:07:38.429605 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21958): Terminated: ok {rc=0} 04:07:38.473911 --- ParallelTerminationStrategy: PID 21959 died... 04:07:38.492608 run iperf3-srv_10.42.42.10(pid=21959): Terminated {rc=256} 04:07:38.536534 --- ParallelTerminationStrategy: PID 21962 died... 04:07:38.555292 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21962): Terminated: ok {rc=0} 04:07:38.599525 --- ParallelTerminationStrategy: PID 21965 died... 04:07:38.618420 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21965): Terminated: ok {rc=0} 04:07:38.662321 --- ParallelTerminationStrategy: PID 21970 died... 04:07:38.681133 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21970): Terminated: ok {rc=0} 04:07:38.765645 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 04:07:39.908406 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:07:39.919950 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:07:39.972282 tst iperf3m4.py: using LAC 18960 04:07:40.091810 tst iperf3m4.py: using RAC 90 04:07:40.211527 tst iperf3m4.py: using CellId 18960 04:07:40.331644 tst iperf3m4.py: using BVCI 18961 04:07:40.451324 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:07:40.462942 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:07:40.474558 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:07:40.486471 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:07:40.498148 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:07:40.510478 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:07:40.522813 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:07:40.534554 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:07:40.546786 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:07:40.663934 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:07:40.784318 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:07:40.905441 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:07:41.024660 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 04:07:41.226868 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:07:41.529510 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21972): Launched 04:07:41.792150 run iperf3-srv_10.42.42.10(pid=21973): Launched 04:07:41.905850 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 04:07:42.107209 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:07:42.409187 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21974): Launched 04:07:42.671692 run iperf3-srv_10.42.42.10(pid=21975): Launched 04:07:42.784465 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 04:07:42.984826 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:07:43.287430 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21976): Launched 04:07:43.549849 run iperf3-srv_10.42.42.10(pid=21977): Launched 04:07:43.662985 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 04:07:43.863277 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:07:44.165321 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21978): Launched 04:07:44.428062 run iperf3-srv_10.42.42.10(pid=21979): Launched 04:07:44.541203 tst iperf3m4.py:8: start network... 04:07:44.741677 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:07:45.208024 run create_hlr_db(pid=21980): Launched 04:07:45.333094 bus /gobi_6: Setting Powered False 04:07:46.396340 run create_hlr_db(pid=21980): Terminated: ok {rc=0} 04:07:46.872444 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21982): Launched 04:07:47.211659 run osmo-hlr_10.42.42.2(pid=21983): Launched 04:07:47.338281 run osmo-stp_10.42.42.5: Starting osmo-stp 04:07:47.902450 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21985): Launched 04:07:48.226599 run osmo-stp_10.42.42.5(pid=21986): Launched 04:07:48.350842 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:07:48.908431 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21988): Launched 04:07:49.032131 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:07:49.305773 run patchelf(pid=21989): Launched 04:07:49.485985 run osmo-stp_10.42.42.5(pid=21986): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21986)] 04:07:49.622393 run osmo-stp_10.42.42.5(pid=21986): stdout: | (launched: 2022-12-09_04:07:48.167518) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:07:49.761219 run osmo-stp_10.42.42.5(pid=21986): stderr: | 20221209040748358 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040748358 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040748358 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040748358 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040748359 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040748359 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040748359 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:07:49.899761 run osmo-stp_10.42.42.5(pid=21986): stdout: | (launched: 2022-12-09_04:07:48.167518) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:07:50.032358 run osmo-stp_10.42.42.5(pid=21986): stderr: | 20221209040748358 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040748358 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040748358 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040748358 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040748359 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040748359 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040748359 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:07:50.189528 run patchelf(pid=21989): Terminating (SIGINT) 04:07:50.371552 run patchelf(pid=21989): Terminated: ok {rc=0} 04:07:50.502565 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21986): Process ended prematurely: osmo-stp_10.42.42.5(pid=21986) [trial-2354↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21986)] [trial-2354↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8] 04:07:50.512735 tst iperf3m4.py:8: Test FAILED (10.6 sec) 04:07:50.542703 run osmo-hlr_10.42.42.2(pid=21983): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21983)] 04:07:50.593953 run osmo-hlr_10.42.42.2(pid=21983): stdout: | (launched: 2022-12-09_04:07:47.151643) 04:07:50.647216 run osmo-hlr_10.42.42.2(pid=21983): stderr: | 20221209040747347 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209040747347 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209040747347 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209040747347 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209040747347 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209040747347 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209040747359 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209040747369 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209040747370 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209040747370 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:07:50.700733 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21972): Terminating (SIGTERM) 04:07:50.743412 run iperf3-srv_10.42.42.10(pid=21973): Terminating (SIGTERM) 04:07:50.785873 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21974): Terminating (SIGTERM) 04:07:50.828689 run iperf3-srv_10.42.42.10(pid=21975): Terminating (SIGTERM) 04:07:50.871361 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21976): Terminating (SIGTERM) 04:07:50.913989 run iperf3-srv_10.42.42.10(pid=21977): Terminating (SIGTERM) 04:07:50.956499 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21978): Terminating (SIGTERM) 04:07:50.999190 run iperf3-srv_10.42.42.10(pid=21979): Terminating (SIGTERM) 04:07:51.041687 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21982): Terminating (SIGTERM) 04:07:51.084407 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21985): Terminating (SIGTERM) 04:07:51.127199 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21988): Terminating (SIGTERM) 04:07:51.170159 --- ParallelTerminationStrategy: PID 21972 died... 04:07:51.190169 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21972): Terminated: ok {rc=0} 04:07:51.237575 --- ParallelTerminationStrategy: PID 21973 died... 04:07:51.257675 run iperf3-srv_10.42.42.10(pid=21973): Terminated {rc=256} 04:07:51.304767 --- ParallelTerminationStrategy: PID 21974 died... 04:07:51.324594 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21974): Terminated: ok {rc=0} 04:07:51.371757 --- ParallelTerminationStrategy: PID 21975 died... 04:07:51.391524 run iperf3-srv_10.42.42.10(pid=21975): Terminated {rc=256} 04:07:51.438448 --- ParallelTerminationStrategy: PID 21976 died... 04:07:51.458242 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21976): Terminated: ok {rc=0} 04:07:51.505340 --- ParallelTerminationStrategy: PID 21977 died... 04:07:51.525099 run iperf3-srv_10.42.42.10(pid=21977): Terminated {rc=256} 04:07:51.572101 --- ParallelTerminationStrategy: PID 21978 died... 04:07:51.592049 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21978): Terminated: ok {rc=0} 04:07:51.639146 --- ParallelTerminationStrategy: PID 21979 died... 04:07:51.658958 run iperf3-srv_10.42.42.10(pid=21979): Terminated {rc=256} 04:07:51.706090 --- ParallelTerminationStrategy: PID 21982 died... 04:07:51.725914 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21982): Terminated: ok {rc=0} 04:07:51.773243 --- ParallelTerminationStrategy: PID 21985 died... 04:07:51.793255 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21985): Terminated: ok {rc=0} 04:07:51.840633 --- ParallelTerminationStrategy: PID 21988 died... 04:07:51.860689 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21988): Terminated: ok {rc=0} 04:07:51.950084 bus /gobi_4: Setting Powered False 04:07:53.050887 bus /gobi_4: Setting Powered False 04:07:54.169379 bus /gobi_1: Setting Powered False 04:07:55.272719 bus /gobi_1: Setting Powered False 04:07:56.389989 bus /gobi_0: Setting Powered False 04:07:57.489103 bus /gobi_0: Setting Powered False 04:07:58.607392 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:trx-sysmocell5000+mod-bts0-egprs ping.py ---------------------------------------------- 04:07:59.707168 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:07:59.718837 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:07:59.770354 tst ping.py: using LAC 18961 04:07:59.889172 tst ping.py: using RAC 91 04:08:00.015300 tst ping.py: using CellId 18961 04:08:00.141250 tst ping.py: using BVCI 18962 04:08:00.257131 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:08:00.268928 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:08:00.280409 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:08:00.292067 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:08:00.303401 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:08:00.314863 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:08:00.326480 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:08:00.338152 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:08:00.452512 tst ping.py:19: start network... 04:08:00.650666 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:08:01.135577 run create_hlr_db(pid=21990): Launched 04:08:01.302925 bus /gobi_6: Setting Powered False 04:08:02.380642 run create_hlr_db(pid=21990): Terminated: ok {rc=0} 04:08:02.952005 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22155): Launched 04:08:03.355462 run osmo-hlr_10.42.42.2(pid=22204): Launched 04:08:03.620783 run osmo-stp_10.42.42.5: Starting osmo-stp 04:08:04.333856 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22265): Launched 04:08:04.664721 run osmo-stp_10.42.42.5(pid=22266): Launched 04:08:04.910999 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:08:05.557317 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22268): Launched 04:08:05.693460 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:08:05.971310 run patchelf(pid=22269): Launched 04:08:06.165412 run osmo-stp_10.42.42.5(pid=22266): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22266)] 04:08:06.303937 run osmo-stp_10.42.42.5(pid=22266): stdout: | (launched: 2022-12-09_04:08:04.602338) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:08:06.443480 run osmo-stp_10.42.42.5(pid=22266): stderr: | 20221209040804897 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040804897 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040804898 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040804898 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040804898 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040804899 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040804899 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:08:06.584675 run osmo-stp_10.42.42.5(pid=22266): stdout: | (launched: 2022-12-09_04:08:04.602338) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:08:06.719921 run osmo-stp_10.42.42.5(pid=22266): stderr: | 20221209040804897 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040804897 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040804898 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040804898 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040804898 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040804899 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040804899 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:08:06.882180 run patchelf(pid=22269): Terminating (SIGINT) 04:08:07.066595 run patchelf(pid=22269): Terminated: ok {rc=0} 04:08:07.198273 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=22266): Process ended prematurely: osmo-stp_10.42.42.5(pid=22266) [trial-2354↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22266)] [trial-2354↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22] 04:08:07.208393 tst ping.py:22: Test FAILED (7.5 sec) 04:08:07.240009 run osmo-hlr_10.42.42.2(pid=22204): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22204)] 04:08:07.294140 run osmo-hlr_10.42.42.2(pid=22204): stdout: | (launched: 2022-12-09_04:08:03.294183) 04:08:07.349329 run osmo-hlr_10.42.42.2(pid=22204): stderr: | 20221209040803599 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209040803599 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209040803599 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209040803599 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209040803599 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209040803599 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209040803623 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-sysmocell5000+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209040803632 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209040803632 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209040803632 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:08:07.404804 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22155): Terminating (SIGTERM) 04:08:07.450462 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22265): Terminating (SIGTERM) 04:08:07.498223 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22268): Terminating (SIGTERM) 04:08:07.545439 --- ParallelTerminationStrategy: PID 22155 died... 04:08:07.566800 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22155): Terminated: ok {rc=0} 04:08:07.619161 --- ParallelTerminationStrategy: PID 22265 died... 04:08:07.640067 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22265): Terminated: ok {rc=0} 04:08:07.691667 --- ParallelTerminationStrategy: PID 22268 died... 04:08:07.712714 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22268): Terminated: ok {rc=0} 04:08:07.805999 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:trx-sysmocell5000+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 04:08:08.900155 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:08:08.913663 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:08:08.970056 tst ping_idle_ping.py: using LAC 18962 04:08:09.099774 tst ping_idle_ping.py: using RAC 92 04:08:09.229506 tst ping_idle_ping.py: using CellId 18962 04:08:09.361254 tst ping_idle_ping.py: using BVCI 18963 04:08:09.482446 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:08:09.495387 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:08:09.508902 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:08:09.522500 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:08:09.534691 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:08:09.547640 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:08:09.562498 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:08:09.575900 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:08:09.702639 tst ping_idle_ping.py:24: start network... 04:08:09.925182 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:08:10.444381 run create_hlr_db(pid=22272): Launched 04:08:10.610605 bus /gobi_6: Setting Powered False 04:08:11.677546 run create_hlr_db(pid=22272): Terminated: ok {rc=0} 04:08:12.142388 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22274): Launched 04:08:12.484993 run osmo-hlr_10.42.42.2(pid=22275): Launched 04:08:12.735398 run osmo-stp_10.42.42.5: Starting osmo-stp 04:08:13.399189 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22277): Launched 04:08:13.740647 run osmo-stp_10.42.42.5(pid=22278): Launched 04:08:13.987502 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:08:14.640621 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22280): Launched 04:08:14.779882 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:08:15.062649 run patchelf(pid=22281): Launched 04:08:15.261229 run osmo-stp_10.42.42.5(pid=22278): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22278)] 04:08:15.402252 run osmo-stp_10.42.42.5(pid=22278): stdout: | (launched: 2022-12-09_04:08:13.679663) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:08:15.545437 run osmo-stp_10.42.42.5(pid=22278): stderr: | 20221209040813975 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040813975 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040813976 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040813976 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040813976 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040813981 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040813981 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:08:15.689745 run osmo-stp_10.42.42.5(pid=22278): stdout: | (launched: 2022-12-09_04:08:13.679663) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:08:15.826608 run osmo-stp_10.42.42.5(pid=22278): stderr: | 20221209040813975 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040813975 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040813976 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040813976 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040813976 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040813981 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040813981 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:08:16.006373 run patchelf(pid=22281): Terminating (SIGINT) 04:08:16.194046 run patchelf(pid=22281): Terminated: ok {rc=0} 04:08:16.328757 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=22278): Process ended prematurely: osmo-stp_10.42.42.5(pid=22278) [trial-2354↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22278)] [trial-2354↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27] 04:08:16.339705 tst ping_idle_ping.py:27: Test FAILED (7.4 sec) 04:08:16.372563 run osmo-hlr_10.42.42.2(pid=22275): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22275)] 04:08:16.427018 run osmo-hlr_10.42.42.2(pid=22275): stdout: | (launched: 2022-12-09_04:08:12.423315) 04:08:16.484308 run osmo-hlr_10.42.42.2(pid=22275): stderr: | 20221209040812729 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209040812729 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209040812729 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209040812729 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209040812729 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209040812729 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209040812752 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-sysmocell5000+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209040812769 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209040812769 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209040812769 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:08:16.540745 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22274): Terminating (SIGTERM) 04:08:16.587790 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22277): Terminating (SIGTERM) 04:08:16.635094 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22280): Terminating (SIGTERM) 04:08:16.684427 --- ParallelTerminationStrategy: PID 22274 died... 04:08:16.705941 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22274): Terminated: ok {rc=0} 04:08:16.758101 --- ParallelTerminationStrategy: PID 22277 died... 04:08:16.779355 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22277): Terminated: ok {rc=0} 04:08:16.830708 --- ParallelTerminationStrategy: PID 22280 died... 04:08:16.851785 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22280): Terminated: ok {rc=0} 04:08:16.948283 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2354 gprs:trx-sysmocell5000+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa --------------------------------------------------------------------- 04:08:18.274057 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:08:18.280197 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 04:08:18.314181 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 04:08:18.353640 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 04:08:18.439996 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 04:08:18.476230 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 04:08:18.515624 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 04:08:19.112430 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2354 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 04:08:19.163988 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:08:19.175970 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:08:19.249678 tst cs_paging_gprs_active.py: using LAC 18963 04:08:19.372731 tst cs_paging_gprs_active.py: using RAC 93 04:08:19.495429 tst cs_paging_gprs_active.py: using CellId 18963 04:08:19.620726 tst cs_paging_gprs_active.py: using BVCI 18964 04:08:19.736805 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:08:19.749605 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:08:19.761486 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:08:19.773626 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:08:19.786227 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:08:19.798026 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:08:19.810325 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:08:19.822816 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:08:19.835549 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:08:19.957090 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:08:20.078980 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 04:08:20.288088 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:08:20.605918 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22285): Launched 04:08:20.894608 run iperf3-srv_10.42.42.10(pid=22286): Launched 04:08:21.029318 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 04:08:21.237506 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:08:21.560283 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22287): Launched 04:08:21.848682 run iperf3-srv_10.42.42.10(pid=22288): Launched 04:08:21.983136 tst cs_paging_gprs_active.py:38: start network... 04:08:22.192337 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:08:22.681247 run create_hlr_db(pid=22289): Launched 04:08:22.845217 bus /gobi_6: Setting Powered False 04:08:23.905817 run create_hlr_db(pid=22289): Terminated: ok {rc=0} 04:08:24.349071 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22291): Launched 04:08:24.688349 run osmo-hlr_10.42.42.2(pid=22292): Launched 04:08:24.812270 run osmo-stp_10.42.42.5: Starting osmo-stp 04:08:25.372256 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22294): Launched 04:08:25.696138 run osmo-stp_10.42.42.5(pid=22295): Launched 04:08:25.819322 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:08:26.376178 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22297): Launched 04:08:26.500072 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:08:26.773654 run patchelf(pid=22298): Launched 04:08:26.953993 run osmo-stp_10.42.42.5(pid=22295): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22295)] 04:08:27.091700 run osmo-stp_10.42.42.5(pid=22295): stdout: | (launched: 2022-12-09_04:08:25.637479) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:08:27.230777 run osmo-stp_10.42.42.5(pid=22295): stderr: | 20221209040825829 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040825830 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040825830 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040825830 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040825831 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040825831 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040825831 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:08:27.371035 run osmo-stp_10.42.42.5(pid=22295): stdout: | (launched: 2022-12-09_04:08:25.637479) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:08:27.504410 run osmo-stp_10.42.42.5(pid=22295): stderr: | 20221209040825829 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040825830 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040825830 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040825830 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040825831 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040825831 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040825831 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:08:27.662419 run patchelf(pid=22298): Terminating (SIGINT) 04:08:27.844710 run patchelf(pid=22298): Terminated: ok {rc=0} 04:08:27.975961 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=22295): Process ended prematurely: osmo-stp_10.42.42.5(pid=22295) [trial-2354↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22295)] [trial-2354↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 04:08:27.986648 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 04:08:28.016612 run osmo-hlr_10.42.42.2(pid=22292): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22292)] 04:08:28.068230 run osmo-hlr_10.42.42.2(pid=22292): stdout: | (launched: 2022-12-09_04:08:24.629457) 04:08:28.121854 run osmo-hlr_10.42.42.2(pid=22292): stderr: | 20221209040824829 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209040824829 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209040824829 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209040824829 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209040824829 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209040824829 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209040824842 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209040824853 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209040824853 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209040824853 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:08:28.175577 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22285): Terminating (SIGTERM) 04:08:28.218426 run iperf3-srv_10.42.42.10(pid=22286): Terminating (SIGTERM) 04:08:28.261287 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22287): Terminating (SIGTERM) 04:08:28.304524 run iperf3-srv_10.42.42.10(pid=22288): Terminating (SIGTERM) 04:08:28.347533 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22291): Terminating (SIGTERM) 04:08:28.390563 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22294): Terminating (SIGTERM) 04:08:28.433430 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22297): Terminating (SIGTERM) 04:08:28.476507 --- ParallelTerminationStrategy: PID 22285 died... 04:08:28.496729 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22285): Terminated: ok {rc=0} 04:08:28.544248 --- ParallelTerminationStrategy: PID 22286 died... 04:08:28.564088 run iperf3-srv_10.42.42.10(pid=22286): Terminated {rc=256} 04:08:28.611400 --- ParallelTerminationStrategy: PID 22287 died... 04:08:28.631186 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22287): Terminated: ok {rc=0} 04:08:28.678358 --- ParallelTerminationStrategy: PID 22288 died... 04:08:28.698112 run iperf3-srv_10.42.42.10(pid=22288): Terminated {rc=256} 04:08:28.745280 --- ParallelTerminationStrategy: PID 22291 died... 04:08:28.765214 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22291): Terminated: ok {rc=0} 04:08:28.812379 --- ParallelTerminationStrategy: PID 22294 died... 04:08:28.832376 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22294): Terminated: ok {rc=0} 04:08:28.879668 --- ParallelTerminationStrategy: PID 22297 died... 04:08:28.899521 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22297): Terminated: ok {rc=0} 04:08:28.988305 bus /gobi_0: Setting Powered False 04:08:30.089015 bus /gobi_0: Setting Powered False 04:08:31.206014 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 04:08:32.360719 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:08:32.372916 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:08:32.449510 tst iperf3.py: using LAC 18964 04:08:32.570443 tst iperf3.py: using RAC 94 04:08:32.688851 tst iperf3.py: using CellId 18964 04:08:32.817315 tst iperf3.py: using BVCI 18965 04:08:32.935264 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:08:32.946766 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:08:32.958082 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:08:32.970176 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:08:32.982417 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:08:32.994560 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:08:33.007571 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:08:33.018889 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:08:33.031084 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:08:33.152019 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 04:08:33.371257 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:08:33.694762 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22299): Launched 04:08:33.976693 run iperf3-srv_10.42.42.10(pid=22300): Launched 04:08:34.098511 tst iperf3.py:8: start network... 04:08:34.316331 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:08:34.816808 run create_hlr_db(pid=22301): Launched 04:08:34.940217 bus /gobi_6: Setting Powered False 04:08:36.004456 run create_hlr_db(pid=22301): Terminated: ok {rc=0} 04:08:36.456214 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22303): Launched 04:08:36.779353 run osmo-hlr_10.42.42.2(pid=22304): Launched 04:08:36.902603 run osmo-stp_10.42.42.5: Starting osmo-stp 04:08:37.462978 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22306): Launched 04:08:37.786453 run osmo-stp_10.42.42.5(pid=22307): Launched 04:08:37.909776 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:08:38.466773 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22309): Launched 04:08:38.590565 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:08:38.864737 run patchelf(pid=22310): Launched 04:08:39.046539 run osmo-stp_10.42.42.5(pid=22307): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22307)] 04:08:39.183754 run osmo-stp_10.42.42.5(pid=22307): stdout: | (launched: 2022-12-09_04:08:37.727810) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:08:39.323099 run osmo-stp_10.42.42.5(pid=22307): stderr: | 20221209040837921 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040837921 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040837921 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040837922 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040837922 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040837922 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040837922 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:08:39.462260 run osmo-stp_10.42.42.5(pid=22307): stdout: | (launched: 2022-12-09_04:08:37.727810) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:08:39.595565 run osmo-stp_10.42.42.5(pid=22307): stderr: | 20221209040837921 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040837921 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040837921 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040837922 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040837922 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040837922 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040837922 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:08:39.753038 run patchelf(pid=22310): Terminating (SIGINT) 04:08:39.935367 run patchelf(pid=22310): Terminated: ok {rc=0} 04:08:40.066881 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22307): Process ended prematurely: osmo-stp_10.42.42.5(pid=22307) [trial-2354↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22307)] [trial-2354↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8] 04:08:40.077300 tst iperf3.py:8: Test FAILED (7.8 sec) 04:08:40.106985 run osmo-hlr_10.42.42.2(pid=22304): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22304)] 04:08:40.158300 run osmo-hlr_10.42.42.2(pid=22304): stdout: | (launched: 2022-12-09_04:08:36.720461) 04:08:40.211545 run osmo-hlr_10.42.42.2(pid=22304): stderr: | 20221209040836919 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209040836919 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209040836919 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209040836919 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209040836919 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209040836919 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209040836930 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209040836939 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209040836939 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209040836939 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:08:40.265361 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22299): Terminating (SIGTERM) 04:08:40.308568 run iperf3-srv_10.42.42.10(pid=22300): Terminating (SIGTERM) 04:08:40.351520 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22303): Terminating (SIGTERM) 04:08:40.394336 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22306): Terminating (SIGTERM) 04:08:40.437186 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22309): Terminating (SIGTERM) 04:08:40.480267 --- ParallelTerminationStrategy: PID 22299 died... 04:08:40.500609 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22299): Terminated: ok {rc=0} 04:08:40.548119 --- ParallelTerminationStrategy: PID 22300 died... 04:08:40.567956 run iperf3-srv_10.42.42.10(pid=22300): Terminated {rc=256} 04:08:40.615054 --- ParallelTerminationStrategy: PID 22303 died... 04:08:40.635081 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22303): Terminated: ok {rc=0} 04:08:40.682405 --- ParallelTerminationStrategy: PID 22306 died... 04:08:40.702482 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22306): Terminated: ok {rc=0} 04:08:40.749605 --- ParallelTerminationStrategy: PID 22309 died... 04:08:40.769578 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22309): Terminated: ok {rc=0} 04:08:40.859072 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 04:08:42.010583 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:08:42.022932 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:08:42.095539 tst iperf3m4.py: using LAC 18965 04:08:42.217317 tst iperf3m4.py: using RAC 95 04:08:42.337672 tst iperf3m4.py: using CellId 18965 04:08:42.458836 tst iperf3m4.py: using BVCI 18966 04:08:42.568422 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:08:42.579739 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:08:42.590688 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:08:42.602113 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:08:42.613589 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:08:42.625228 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:08:42.636699 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:08:42.648005 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:08:42.659796 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:08:42.775490 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:08:42.898435 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:08:43.015567 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:08:43.133688 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 04:08:43.336592 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:08:43.640625 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22311): Launched 04:08:43.905063 run iperf3-srv_10.42.42.10(pid=22312): Launched 04:08:44.018886 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 04:08:44.220378 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:08:44.522340 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22313): Launched 04:08:44.784835 run iperf3-srv_10.42.42.10(pid=22314): Launched 04:08:44.898808 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 04:08:45.099543 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:08:45.402070 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22315): Launched 04:08:45.665635 run iperf3-srv_10.42.42.10(pid=22316): Launched 04:08:45.779353 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 04:08:45.999917 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:08:46.316431 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22317): Launched 04:08:46.598337 run iperf3-srv_10.42.42.10(pid=22318): Launched 04:08:46.727736 tst iperf3m4.py:8: start network... 04:08:46.933135 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:08:47.404315 run create_hlr_db(pid=22319): Launched 04:08:47.527338 bus /gobi_6: Setting Powered False 04:08:48.586543 run create_hlr_db(pid=22319): Terminated: ok {rc=0} 04:08:49.027521 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22321): Launched 04:08:49.352380 run osmo-hlr_10.42.42.2(pid=22322): Launched 04:08:49.475318 run osmo-stp_10.42.42.5: Starting osmo-stp 04:08:50.035636 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22324): Launched 04:08:50.359300 run osmo-stp_10.42.42.5(pid=22325): Launched 04:08:50.482185 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:08:51.040213 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22327): Launched 04:08:51.163848 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:08:51.437415 run patchelf(pid=22328): Launched 04:08:51.617586 run osmo-stp_10.42.42.5(pid=22325): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22325)] 04:08:51.754358 run osmo-stp_10.42.42.5(pid=22325): stdout: | (launched: 2022-12-09_04:08:50.300096) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:08:51.893587 run osmo-stp_10.42.42.5(pid=22325): stderr: | 20221209040850490 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040850490 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040850490 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040850491 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040850491 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040850491 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040850491 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:08:52.032444 run osmo-stp_10.42.42.5(pid=22325): stdout: | (launched: 2022-12-09_04:08:50.300096) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:08:52.165686 run osmo-stp_10.42.42.5(pid=22325): stderr: | 20221209040850490 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040850490 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040850490 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040850491 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040850491 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040850491 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040850491 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:08:52.323206 run patchelf(pid=22328): Terminating (SIGINT) 04:08:52.504904 run patchelf(pid=22328): Terminated: ok {rc=0} 04:08:52.636101 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22325): Process ended prematurely: osmo-stp_10.42.42.5(pid=22325) [trial-2354↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22325)] [trial-2354↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8] 04:08:52.646691 tst iperf3m4.py:8: Test FAILED (10.7 sec) 04:08:52.676554 run osmo-hlr_10.42.42.2(pid=22322): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22322)] 04:08:52.727905 run osmo-hlr_10.42.42.2(pid=22322): stdout: | (launched: 2022-12-09_04:08:49.292793) 04:08:52.781240 run osmo-hlr_10.42.42.2(pid=22322): stderr: | 20221209040849491 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209040849491 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209040849491 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209040849491 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209040849491 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209040849491 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209040849503 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209040849511 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209040849511 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209040849511 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:08:52.834781 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22311): Terminating (SIGTERM) 04:08:52.877770 run iperf3-srv_10.42.42.10(pid=22312): Terminating (SIGTERM) 04:08:52.920753 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22313): Terminating (SIGTERM) 04:08:52.963846 run iperf3-srv_10.42.42.10(pid=22314): Terminating (SIGTERM) 04:08:53.006720 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22315): Terminating (SIGTERM) 04:08:53.049770 run iperf3-srv_10.42.42.10(pid=22316): Terminating (SIGTERM) 04:08:53.092488 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22317): Terminating (SIGTERM) 04:08:53.135817 run iperf3-srv_10.42.42.10(pid=22318): Terminating (SIGTERM) 04:08:53.179091 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22321): Terminating (SIGTERM) 04:08:53.222005 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22324): Terminating (SIGTERM) 04:08:53.265037 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22327): Terminating (SIGTERM) 04:08:53.308332 --- ParallelTerminationStrategy: PID 22311 died... 04:08:53.328782 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22311): Terminated: ok {rc=0} 04:08:53.376098 --- ParallelTerminationStrategy: PID 22312 died... 04:08:53.395767 run iperf3-srv_10.42.42.10(pid=22312): Terminated {rc=256} 04:08:53.442577 --- ParallelTerminationStrategy: PID 22313 died... 04:08:53.462279 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22313): Terminated: ok {rc=0} 04:08:53.509483 --- ParallelTerminationStrategy: PID 22314 died... 04:08:53.529206 run iperf3-srv_10.42.42.10(pid=22314): Terminated {rc=256} 04:08:53.575763 --- ParallelTerminationStrategy: PID 22315 died... 04:08:53.595656 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22315): Terminated: ok {rc=0} 04:08:53.642815 --- ParallelTerminationStrategy: PID 22316 died... 04:08:53.662761 run iperf3-srv_10.42.42.10(pid=22316): Terminated {rc=256} 04:08:53.709445 --- ParallelTerminationStrategy: PID 22317 died... 04:08:53.729236 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22317): Terminated: ok {rc=0} 04:08:53.776220 --- ParallelTerminationStrategy: PID 22318 died... 04:08:53.795945 run iperf3-srv_10.42.42.10(pid=22318): Terminated {rc=256} 04:08:53.843859 --- ParallelTerminationStrategy: PID 22321 died... 04:08:53.863588 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22321): Terminated: ok {rc=0} 04:08:53.910921 --- ParallelTerminationStrategy: PID 22324 died... 04:08:53.930650 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22324): Terminated: ok {rc=0} 04:08:53.977748 --- ParallelTerminationStrategy: PID 22327 died... 04:08:53.997572 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22327): Terminated: ok {rc=0} 04:08:54.085942 bus /gobi_4: Setting Powered False 04:08:55.186462 bus /gobi_4: Setting Powered False 04:08:56.307007 bus /gobi_1: Setting Powered False 04:08:57.407013 bus /gobi_1: Setting Powered False 04:08:58.524763 bus /gobi_0: Setting Powered False 04:08:59.624840 bus /gobi_0: Setting Powered False 04:09:00.742501 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 04:09:01.845067 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:09:01.858259 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:09:01.938239 tst ping.py: using LAC 18966 04:09:02.059113 tst ping.py: using RAC 96 04:09:02.198561 tst ping.py: using CellId 18966 04:09:02.325636 tst ping.py: using BVCI 18967 04:09:02.433375 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:09:02.444239 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:09:02.455028 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:09:02.466862 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:09:02.477526 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:09:02.488135 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:09:02.498855 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:09:02.509522 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:09:02.627753 tst ping.py:19: start network... 04:09:02.839535 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:09:03.329050 run create_hlr_db(pid=22330): Launched 04:09:03.450414 bus /gobi_6: Setting Powered False 04:09:04.513609 run create_hlr_db(pid=22330): Terminated: ok {rc=0} 04:09:04.954514 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22332): Launched 04:09:05.270653 run osmo-hlr_10.42.42.2(pid=22333): Launched 04:09:05.392609 run osmo-stp_10.42.42.5: Starting osmo-stp 04:09:05.943673 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22335): Launched 04:09:06.260155 run osmo-stp_10.42.42.5(pid=22336): Launched 04:09:06.382153 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:09:06.928935 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22338): Launched 04:09:07.050365 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:09:07.318129 run patchelf(pid=22339): Launched 04:09:07.495199 run osmo-stp_10.42.42.5(pid=22336): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22336)] 04:09:07.629596 run osmo-stp_10.42.42.5(pid=22336): stdout: | (launched: 2022-12-09_04:09:06.202426) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:09:07.766018 run osmo-stp_10.42.42.5(pid=22336): stderr: | 20221209040906394 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040906394 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040906394 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040906395 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040906395 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040906395 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040906395 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:09:07.901918 run osmo-stp_10.42.42.5(pid=22336): stdout: | (launched: 2022-12-09_04:09:06.202426) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:09:08.032076 run osmo-stp_10.42.42.5(pid=22336): stderr: | 20221209040906394 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040906394 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040906394 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040906395 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040906395 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040906395 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040906395 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:09:08.186359 run patchelf(pid=22339): Terminating (SIGINT) 04:09:08.365202 run patchelf(pid=22339): Terminated: ok {rc=0} 04:09:08.493721 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=22336): Process ended prematurely: osmo-stp_10.42.42.5(pid=22336) [trial-2354↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22336)] [trial-2354↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22] 04:09:08.503197 tst ping.py:22: Test FAILED (6.7 sec) 04:09:08.532031 run osmo-hlr_10.42.42.2(pid=22333): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22333)] 04:09:08.582845 run osmo-hlr_10.42.42.2(pid=22333): stdout: | (launched: 2022-12-09_04:09:05.213156) 04:09:08.635260 run osmo-hlr_10.42.42.2(pid=22333): stderr: | 20221209040905409 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209040905409 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209040905409 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209040905409 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209040905409 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209040905409 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209040905421 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209040905430 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209040905430 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209040905430 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:09:08.687926 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22332): Terminating (SIGTERM) 04:09:08.730364 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22335): Terminating (SIGTERM) 04:09:08.772828 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22338): Terminating (SIGTERM) 04:09:08.815509 --- ParallelTerminationStrategy: PID 22332 died... 04:09:08.835568 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22332): Terminated: ok {rc=0} 04:09:08.882490 --- ParallelTerminationStrategy: PID 22335 died... 04:09:08.902215 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22335): Terminated: ok {rc=0} 04:09:08.949774 --- ParallelTerminationStrategy: PID 22338 died... 04:09:08.969520 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22338): Terminated: ok {rc=0} 04:09:09.059072 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 04:09:10.144700 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:09:10.156918 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:09:10.228612 tst ping_idle_ping.py: using LAC 18967 04:09:10.344576 tst ping_idle_ping.py: using RAC 97 04:09:10.460392 tst ping_idle_ping.py: using CellId 18967 04:09:10.576739 tst ping_idle_ping.py: using BVCI 18968 04:09:10.683852 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:09:10.694900 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:09:10.705873 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:09:10.716546 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:09:10.727264 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:09:10.738106 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:09:10.748922 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:09:10.759746 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:09:10.878806 tst ping_idle_ping.py:24: start network... 04:09:11.093143 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:09:11.594275 run create_hlr_db(pid=22340): Launched 04:09:11.716854 bus /gobi_6: Setting Powered False 04:09:12.780134 run create_hlr_db(pid=22340): Terminated: ok {rc=0} 04:09:13.207671 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22342): Launched 04:09:13.506749 run osmo-hlr_10.42.42.2(pid=22343): Launched 04:09:13.621884 run osmo-stp_10.42.42.5: Starting osmo-stp 04:09:14.150929 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22345): Launched 04:09:14.445711 run osmo-stp_10.42.42.5(pid=22346): Launched 04:09:14.559302 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:09:15.070323 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22348): Launched 04:09:15.183139 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:09:15.432683 run patchelf(pid=22349): Launched 04:09:15.598602 run osmo-stp_10.42.42.5(pid=22346): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22346)] 04:09:15.723262 run osmo-stp_10.42.42.5(pid=22346): stdout: | (launched: 2022-12-09_04:09:14.391475) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:09:15.854633 run osmo-stp_10.42.42.5(pid=22346): stderr: | 20221209040914562 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040914562 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040914563 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040914563 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040914564 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040914564 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040914564 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:09:16.003458 run osmo-stp_10.42.42.5(pid=22346): stdout: | (launched: 2022-12-09_04:09:14.391475) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:09:16.128320 run osmo-stp_10.42.42.5(pid=22346): stderr: | 20221209040914562 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040914562 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040914563 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040914563 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040914564 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040914564 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040914564 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:09:16.274748 run patchelf(pid=22349): Terminating (SIGINT) 04:09:16.444482 run patchelf(pid=22349): Terminated: ok {rc=0} 04:09:16.567033 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=22346): Process ended prematurely: osmo-stp_10.42.42.5(pid=22346) [trial-2354↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22346)] [trial-2354↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 04:09:16.577170 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 04:09:16.605737 run osmo-hlr_10.42.42.2(pid=22343): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22343)] 04:09:16.654992 run osmo-hlr_10.42.42.2(pid=22343): stdout: | (launched: 2022-12-09_04:09:13.451918) 04:09:16.705946 run osmo-hlr_10.42.42.2(pid=22343): stderr: | 20221209040913626 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209040913626 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209040913626 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209040913626 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209040913626 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209040913626 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209040913638 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209040913647 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209040913647 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209040913647 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:09:16.757221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22342): Terminating (SIGTERM) 04:09:16.798331 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22345): Terminating (SIGTERM) 04:09:16.840117 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22348): Terminating (SIGTERM) 04:09:16.883041 --- ParallelTerminationStrategy: PID 22342 died... 04:09:16.902583 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22342): Terminated: ok {rc=0} 04:09:16.947757 --- ParallelTerminationStrategy: PID 22345 died... 04:09:16.967076 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22345): Terminated: ok {rc=0} 04:09:17.012100 --- ParallelTerminationStrategy: PID 22348 died... 04:09:17.031366 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22348): Terminated: ok {rc=0} 04:09:17.120615 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2354 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 04:09:18.424119 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:09:18.430056 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 04:09:18.463523 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 04:09:18.501518 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 04:09:18.586682 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 04:09:18.619753 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 04:09:18.657415 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 04:09:19.253803 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2354 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 04:09:19.302165 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:09:19.313104 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:09:19.382747 tst cs_paging_gprs_active.py: using LAC 18968 04:09:19.506527 tst cs_paging_gprs_active.py: using RAC 98 04:09:19.625268 tst cs_paging_gprs_active.py: using CellId 18968 04:09:19.744528 tst cs_paging_gprs_active.py: using BVCI 18969 04:09:19.864526 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:09:19.876136 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:09:19.887580 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:09:19.899931 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:09:19.912046 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:09:19.924162 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:09:19.936423 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:09:19.948367 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:09:19.960511 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:09:20.081886 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:09:20.202906 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 04:09:20.422217 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:09:20.747162 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22355): Launched 04:09:21.029488 run iperf3-srv_10.42.42.10(pid=22356): Launched 04:09:21.151949 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 04:09:21.370770 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:09:21.696039 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22357): Launched 04:09:21.977963 run iperf3-srv_10.42.42.10(pid=22358): Launched 04:09:22.099729 tst cs_paging_gprs_active.py:38: start network... 04:09:22.318008 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:09:22.819727 run create_hlr_db(pid=22359): Launched 04:09:22.943679 bus /gobi_6: Setting Powered False 04:09:24.003463 run create_hlr_db(pid=22359): Terminated: ok {rc=0} 04:09:24.434705 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22361): Launched 04:09:24.736770 run osmo-hlr_10.42.42.2(pid=22362): Launched 04:09:24.852069 run osmo-stp_10.42.42.5: Starting osmo-stp 04:09:25.371006 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22364): Launched 04:09:25.671358 run osmo-stp_10.42.42.5(pid=22365): Launched 04:09:25.786560 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:09:26.307318 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22367): Launched 04:09:26.422271 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:09:26.676034 run patchelf(pid=22368): Launched 04:09:26.843680 run osmo-stp_10.42.42.5(pid=22365): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22365)] 04:09:26.971288 run osmo-stp_10.42.42.5(pid=22365): stdout: | (launched: 2022-12-09_04:09:25.616294) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:09:27.100464 run osmo-stp_10.42.42.5(pid=22365): stderr: | 20221209040925783 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040925783 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040925783 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040925784 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040925784 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040925784 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040925784 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:09:27.229336 run osmo-stp_10.42.42.5(pid=22365): stdout: | (launched: 2022-12-09_04:09:25.616294) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:09:27.352537 run osmo-stp_10.42.42.5(pid=22365): stderr: | 20221209040925783 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040925783 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040925783 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040925784 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040925784 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040925784 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040925784 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:09:27.498953 run patchelf(pid=22368): Terminating (SIGINT) 04:09:27.668280 run patchelf(pid=22368): Terminated: ok {rc=0} 04:09:27.790630 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=22365): Process ended prematurely: osmo-stp_10.42.42.5(pid=22365) [trial-2354↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22365)] [trial-2354↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 04:09:27.800106 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 04:09:27.827796 run osmo-hlr_10.42.42.2(pid=22362): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22362)] 04:09:27.876362 run osmo-hlr_10.42.42.2(pid=22362): stdout: | (launched: 2022-12-09_04:09:24.681550) 04:09:27.926051 run osmo-hlr_10.42.42.2(pid=22362): stderr: | 20221209040924858 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209040924858 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209040924858 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209040924858 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209040924858 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209040924858 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209040924874 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209040924884 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209040924884 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209040924884 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:09:27.976096 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22355): Terminating (SIGTERM) 04:09:28.016047 run iperf3-srv_10.42.42.10(pid=22356): Terminating (SIGTERM) 04:09:28.055765 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22357): Terminating (SIGTERM) 04:09:28.095668 run iperf3-srv_10.42.42.10(pid=22358): Terminating (SIGTERM) 04:09:28.135366 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22361): Terminating (SIGTERM) 04:09:28.174998 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22364): Terminating (SIGTERM) 04:09:28.214774 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22367): Terminating (SIGTERM) 04:09:28.254703 --- ParallelTerminationStrategy: PID 22355 died... 04:09:28.273825 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22355): Terminated: ok {rc=0} 04:09:28.317675 --- ParallelTerminationStrategy: PID 22356 died... 04:09:28.336270 run iperf3-srv_10.42.42.10(pid=22356): Terminated {rc=256} 04:09:28.380072 --- ParallelTerminationStrategy: PID 22357 died... 04:09:28.398758 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22357): Terminated: ok {rc=0} 04:09:28.442411 --- ParallelTerminationStrategy: PID 22358 died... 04:09:28.460799 run iperf3-srv_10.42.42.10(pid=22358): Terminated {rc=256} 04:09:28.504538 --- ParallelTerminationStrategy: PID 22361 died... 04:09:28.523134 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22361): Terminated: ok {rc=0} 04:09:28.567347 --- ParallelTerminationStrategy: PID 22364 died... 04:09:28.585983 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22364): Terminated: ok {rc=0} 04:09:28.629804 --- ParallelTerminationStrategy: PID 22367 died... 04:09:28.648381 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22367): Terminated: ok {rc=0} 04:09:28.731792 bus /gobi_0: Setting Powered False 04:09:29.830456 bus /gobi_0: Setting Powered False 04:09:30.949768 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 04:09:32.099510 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:09:32.111696 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:09:32.186966 tst iperf3.py: using LAC 18969 04:09:32.311836 tst iperf3.py: using RAC 99 04:09:32.440121 tst iperf3.py: using CellId 18969 04:09:32.565072 tst iperf3.py: using BVCI 18970 04:09:32.682754 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:09:32.694306 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:09:32.705692 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:09:32.717227 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:09:32.728635 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:09:32.740051 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:09:32.751647 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:09:32.763123 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:09:32.774673 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:09:32.894583 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 04:09:33.113800 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:09:33.440425 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22369): Launched 04:09:33.724118 run iperf3-srv_10.42.42.10(pid=22370): Launched 04:09:33.846935 tst iperf3.py:8: start network... 04:09:34.066202 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:09:34.569477 run create_hlr_db(pid=22371): Launched 04:09:34.693940 bus /gobi_6: Setting Powered False 04:09:35.758197 run create_hlr_db(pid=22371): Terminated: ok {rc=0} 04:09:36.209028 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22373): Launched 04:09:36.533084 run osmo-hlr_10.42.42.2(pid=22374): Launched 04:09:36.657456 run osmo-stp_10.42.42.5: Starting osmo-stp 04:09:37.213100 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22376): Launched 04:09:37.536553 run osmo-stp_10.42.42.5(pid=22377): Launched 04:09:37.661019 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:09:38.218481 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22379): Launched 04:09:38.342709 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:09:38.616316 run patchelf(pid=22380): Launched 04:09:38.795848 run osmo-stp_10.42.42.5(pid=22377): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22377)] 04:09:38.932674 run osmo-stp_10.42.42.5(pid=22377): stdout: | (launched: 2022-12-09_04:09:37.477580) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:09:39.071490 run osmo-stp_10.42.42.5(pid=22377): stderr: | 20221209040937670 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040937670 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040937670 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040937671 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040937671 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040937671 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040937671 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:09:39.210422 run osmo-stp_10.42.42.5(pid=22377): stdout: | (launched: 2022-12-09_04:09:37.477580) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:09:39.343693 run osmo-stp_10.42.42.5(pid=22377): stderr: | 20221209040937670 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040937670 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040937670 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040937671 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040937671 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040937671 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040937671 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:09:39.501575 run patchelf(pid=22380): Terminating (SIGINT) 04:09:39.683677 run patchelf(pid=22380): Terminated: ok {rc=0} 04:09:39.814949 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22377): Process ended prematurely: osmo-stp_10.42.42.5(pid=22377) [trial-2354↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22377)] [trial-2354↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8] 04:09:39.825111 tst iperf3.py:8: Test FAILED (7.8 sec) 04:09:39.854673 run osmo-hlr_10.42.42.2(pid=22374): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22374)] 04:09:39.905787 run osmo-hlr_10.42.42.2(pid=22374): stdout: | (launched: 2022-12-09_04:09:36.474181) 04:09:39.958578 run osmo-hlr_10.42.42.2(pid=22374): stderr: | 20221209040936672 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209040936672 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209040936672 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209040936672 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209040936672 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209040936672 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209040936684 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209040936693 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209040936693 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209040936693 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:09:40.012020 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22369): Terminating (SIGTERM) 04:09:40.054578 run iperf3-srv_10.42.42.10(pid=22370): Terminating (SIGTERM) 04:09:40.096827 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22373): Terminating (SIGTERM) 04:09:40.139379 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22376): Terminating (SIGTERM) 04:09:40.181813 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22379): Terminating (SIGTERM) 04:09:40.225142 --- ParallelTerminationStrategy: PID 22369 died... 04:09:40.245877 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22369): Terminated: ok {rc=0} 04:09:40.292775 --- ParallelTerminationStrategy: PID 22370 died... 04:09:40.312542 run iperf3-srv_10.42.42.10(pid=22370): Terminated {rc=256} 04:09:40.359437 --- ParallelTerminationStrategy: PID 22373 died... 04:09:40.379003 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22373): Terminated: ok {rc=0} 04:09:40.425699 --- ParallelTerminationStrategy: PID 22376 died... 04:09:40.445343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22376): Terminated: ok {rc=0} 04:09:40.492243 --- ParallelTerminationStrategy: PID 22379 died... 04:09:40.511888 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22379): Terminated: ok {rc=0} 04:09:40.600676 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 04:09:41.748406 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:09:41.760215 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:09:41.835536 tst iperf3m4.py: using LAC 18970 04:09:41.953931 tst iperf3m4.py: using RAC 100 04:09:42.071957 tst iperf3m4.py: using CellId 18970 04:09:42.188278 tst iperf3m4.py: using BVCI 18971 04:09:42.297293 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:09:42.308132 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:09:42.318883 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:09:42.329693 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:09:42.340399 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:09:42.351126 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:09:42.361961 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:09:42.372544 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:09:42.383488 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:09:42.498932 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:09:42.621037 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:09:42.739461 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:09:42.855849 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 04:09:43.057780 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:09:43.361506 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22381): Launched 04:09:43.625490 run iperf3-srv_10.42.42.10(pid=22382): Launched 04:09:43.739085 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 04:09:43.940078 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:09:44.243409 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22383): Launched 04:09:44.506693 run iperf3-srv_10.42.42.10(pid=22384): Launched 04:09:44.620133 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 04:09:44.821941 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:09:45.124780 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22385): Launched 04:09:45.387952 run iperf3-srv_10.42.42.10(pid=22386): Launched 04:09:45.501729 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 04:09:45.702277 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:09:46.009297 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22387): Launched 04:09:46.290906 run iperf3-srv_10.42.42.10(pid=22388): Launched 04:09:46.419798 tst iperf3m4.py:8: start network... 04:09:46.625879 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:09:47.103326 run create_hlr_db(pid=22389): Launched 04:09:47.257737 bus /gobi_6: Setting Powered False 04:09:48.318307 run create_hlr_db(pid=22389): Terminated: ok {rc=0} 04:09:48.738217 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22391): Launched 04:09:49.039342 run osmo-hlr_10.42.42.2(pid=22392): Launched 04:09:49.154370 run osmo-stp_10.42.42.5: Starting osmo-stp 04:09:49.673442 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22394): Launched 04:09:49.974574 run osmo-stp_10.42.42.5(pid=22395): Launched 04:09:50.089359 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:09:50.608752 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22397): Launched 04:09:50.724089 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:09:50.978670 run patchelf(pid=22398): Launched 04:09:51.146010 run osmo-stp_10.42.42.5(pid=22395): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22395)] 04:09:51.273571 run osmo-stp_10.42.42.5(pid=22395): stdout: | (launched: 2022-12-09_04:09:49.918874) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:09:51.402742 run osmo-stp_10.42.42.5(pid=22395): stderr: | 20221209040950089 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040950089 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040950089 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040950089 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040950090 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040950090 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040950090 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:09:51.531570 run osmo-stp_10.42.42.5(pid=22395): stdout: | (launched: 2022-12-09_04:09:49.918874) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:09:51.654697 run osmo-stp_10.42.42.5(pid=22395): stderr: | 20221209040950089 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209040950089 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209040950089 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209040950089 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209040950090 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209040950090 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209040950090 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:09:51.800405 run patchelf(pid=22398): Terminating (SIGINT) 04:09:51.970392 run patchelf(pid=22398): Terminated: ok {rc=0} 04:09:52.093758 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22395): Process ended prematurely: osmo-stp_10.42.42.5(pid=22395) [trial-2354↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22395)] [trial-2354↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8] 04:09:52.103353 tst iperf3m4.py:8: Test FAILED (10.4 sec) 04:09:52.131307 run osmo-hlr_10.42.42.2(pid=22392): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22392)] 04:09:52.179464 run osmo-hlr_10.42.42.2(pid=22392): stdout: | (launched: 2022-12-09_04:09:48.983970) 04:09:52.229289 run osmo-hlr_10.42.42.2(pid=22392): stderr: | 20221209040949160 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209040949160 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209040949160 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209040949161 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209040949161 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209040949161 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209040949172 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209040949181 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209040949182 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209040949182 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:09:52.279744 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22381): Terminating (SIGTERM) 04:09:52.321679 run iperf3-srv_10.42.42.10(pid=22382): Terminating (SIGTERM) 04:09:52.361918 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22383): Terminating (SIGTERM) 04:09:52.402189 run iperf3-srv_10.42.42.10(pid=22384): Terminating (SIGTERM) 04:09:52.442271 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22385): Terminating (SIGTERM) 04:09:52.482243 run iperf3-srv_10.42.42.10(pid=22386): Terminating (SIGTERM) 04:09:52.522200 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22387): Terminating (SIGTERM) 04:09:52.562274 run iperf3-srv_10.42.42.10(pid=22388): Terminating (SIGTERM) 04:09:52.602109 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22391): Terminating (SIGTERM) 04:09:52.642348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22394): Terminating (SIGTERM) 04:09:52.682343 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22397): Terminating (SIGTERM) 04:09:52.722389 --- ParallelTerminationStrategy: PID 22381 died... 04:09:52.741639 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22381): Terminated: ok {rc=0} 04:09:52.786339 --- ParallelTerminationStrategy: PID 22382 died... 04:09:52.805254 run iperf3-srv_10.42.42.10(pid=22382): Terminated {rc=256} 04:09:52.849428 --- ParallelTerminationStrategy: PID 22383 died... 04:09:52.868289 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22383): Terminated: ok {rc=0} 04:09:52.913441 --- ParallelTerminationStrategy: PID 22384 died... 04:09:52.932332 run iperf3-srv_10.42.42.10(pid=22384): Terminated {rc=256} 04:09:52.976562 --- ParallelTerminationStrategy: PID 22385 died... 04:09:52.995481 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22385): Terminated: ok {rc=0} 04:09:53.040085 --- ParallelTerminationStrategy: PID 22386 died... 04:09:53.059034 run iperf3-srv_10.42.42.10(pid=22386): Terminated {rc=256} 04:09:53.103317 --- ParallelTerminationStrategy: PID 22387 died... 04:09:53.122281 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22387): Terminated: ok {rc=0} 04:09:53.167064 --- ParallelTerminationStrategy: PID 22388 died... 04:09:53.185953 run iperf3-srv_10.42.42.10(pid=22388): Terminated {rc=256} 04:09:53.230349 --- ParallelTerminationStrategy: PID 22391 died... 04:09:53.249370 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22391): Terminated: ok {rc=0} 04:09:53.293877 --- ParallelTerminationStrategy: PID 22394 died... 04:09:53.312673 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22394): Terminated: ok {rc=0} 04:09:53.357123 --- ParallelTerminationStrategy: PID 22397 died... 04:09:53.376094 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22397): Terminated: ok {rc=0} 04:09:53.461256 bus /gobi_4: Setting Powered False 04:09:54.558819 bus /gobi_4: Setting Powered False 04:09:55.676191 bus /gobi_1: Setting Powered False 04:09:56.776134 bus /gobi_1: Setting Powered False 04:09:57.892190 bus /gobi_0: Setting Powered False 04:09:58.992701 bus /gobi_0: Setting Powered False 04:10:00.109124 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 04:10:01.209936 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:10:01.222544 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:10:01.295585 tst ping.py: using LAC 18971 04:10:01.414190 tst ping.py: using RAC 101 04:10:01.534875 tst ping.py: using CellId 18971 04:10:01.660707 tst ping.py: using BVCI 18972 04:10:01.807481 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:10:01.820511 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:10:01.834148 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:10:01.847271 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:10:01.860375 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:10:01.873167 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:10:01.887292 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:10:01.900485 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:10:02.044726 tst ping.py:19: start network... 04:10:02.292533 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:10:02.789166 run create_hlr_db(pid=22411): Launched 04:10:02.909579 bus /gobi_6: Setting Powered False 04:10:03.968707 run create_hlr_db(pid=22411): Terminated: ok {rc=0} 04:10:04.402521 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22413): Launched 04:10:04.720925 run osmo-hlr_10.42.42.2(pid=22414): Launched 04:10:04.842515 run osmo-stp_10.42.42.5: Starting osmo-stp 04:10:05.399471 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22416): Launched 04:10:05.716382 run osmo-stp_10.42.42.5(pid=22417): Launched 04:10:05.838366 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:10:06.385996 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22419): Launched 04:10:06.507811 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:10:06.775285 run patchelf(pid=22420): Launched 04:10:06.951641 run osmo-stp_10.42.42.5(pid=22417): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22417)] 04:10:07.086198 run osmo-stp_10.42.42.5(pid=22417): stdout: | (launched: 2022-12-09_04:10:05.658540) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:10:07.222391 run osmo-stp_10.42.42.5(pid=22417): stderr: | 20221209041005850 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041005850 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041005850 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041005851 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041005851 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041005851 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041005851 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:10:07.359002 run osmo-stp_10.42.42.5(pid=22417): stdout: | (launched: 2022-12-09_04:10:05.658540) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:10:07.489175 run osmo-stp_10.42.42.5(pid=22417): stderr: | 20221209041005850 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041005850 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041005850 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041005851 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041005851 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041005851 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041005851 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:10:07.643162 run patchelf(pid=22420): Terminating (SIGINT) 04:10:07.823392 run patchelf(pid=22420): Terminated: ok {rc=0} 04:10:07.952066 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=22417): Process ended prematurely: osmo-stp_10.42.42.5(pid=22417) [trial-2354↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22417)] [trial-2354↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22] 04:10:07.961764 tst ping.py:22: Test FAILED (6.7 sec) 04:10:07.990817 run osmo-hlr_10.42.42.2(pid=22414): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22414)] 04:10:08.041705 run osmo-hlr_10.42.42.2(pid=22414): stdout: | (launched: 2022-12-09_04:10:04.663233) 04:10:08.094853 run osmo-hlr_10.42.42.2(pid=22414): stderr: | 20221209041004862 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209041004862 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209041004862 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209041004862 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209041004862 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209041004862 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209041004875 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209041004883 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209041004883 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209041004883 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:10:08.147974 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22413): Terminating (SIGTERM) 04:10:08.190925 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22416): Terminating (SIGTERM) 04:10:08.233675 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22419): Terminating (SIGTERM) 04:10:08.276540 --- ParallelTerminationStrategy: PID 22413 died... 04:10:08.296762 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22413): Terminated: ok {rc=0} 04:10:08.344358 --- ParallelTerminationStrategy: PID 22416 died... 04:10:08.364200 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22416): Terminated: ok {rc=0} 04:10:08.411311 --- ParallelTerminationStrategy: PID 22419 died... 04:10:08.430984 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22419): Terminated: ok {rc=0} 04:10:08.520010 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 04:10:09.609796 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:10:09.622451 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:10:09.696672 tst ping_idle_ping.py: using LAC 18972 04:10:09.823123 tst ping_idle_ping.py: using RAC 102 04:10:09.947138 tst ping_idle_ping.py: using CellId 18972 04:10:10.076104 tst ping_idle_ping.py: using BVCI 18973 04:10:10.193179 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:10:10.204618 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:10:10.215888 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:10:10.227437 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:10:10.238806 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:10:10.250360 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:10:10.261988 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:10:10.273507 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:10:10.391579 tst ping_idle_ping.py:24: start network... 04:10:10.605783 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:10:11.101969 run create_hlr_db(pid=22421): Launched 04:10:11.223100 bus /gobi_6: Setting Powered False 04:10:12.286403 run create_hlr_db(pid=22421): Terminated: ok {rc=0} 04:10:12.714141 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22423): Launched 04:10:13.026266 run osmo-hlr_10.42.42.2(pid=22436): Launched 04:10:13.147219 run osmo-stp_10.42.42.5: Starting osmo-stp 04:10:13.775727 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22533): Launched 04:10:14.095793 run osmo-stp_10.42.42.5(pid=22608): Launched 04:10:14.256441 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:10:14.899556 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22710): Launched 04:10:15.034331 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:10:15.309755 run patchelf(pid=22781): Launched 04:10:15.488405 run osmo-stp_10.42.42.5(pid=22608): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22608)] 04:10:15.623732 run osmo-stp_10.42.42.5(pid=22608): stdout: | (launched: 2022-12-09_04:10:14.039413) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:10:15.760806 run osmo-stp_10.42.42.5(pid=22608): stderr: | 20221209041014349 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041014349 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041014350 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041014350 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041014351 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041014351 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041014351 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:10:15.905902 run osmo-stp_10.42.42.5(pid=22608): stdout: | (launched: 2022-12-09_04:10:14.039413) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:10:16.041075 run osmo-stp_10.42.42.5(pid=22608): stderr: | 20221209041014349 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041014349 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041014350 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041014350 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041014351 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041014351 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041014351 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:10:16.199049 run patchelf(pid=22781): Terminating (SIGINT) 04:10:16.382196 run patchelf(pid=22781): Terminated: ok {rc=0} 04:10:16.514567 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=22608): Process ended prematurely: osmo-stp_10.42.42.5(pid=22608) [trial-2354↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22608)] [trial-2354↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 04:10:16.525174 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 04:10:16.555942 run osmo-hlr_10.42.42.2(pid=22436): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22436)] 04:10:16.609071 run osmo-hlr_10.42.42.2(pid=22436): stdout: | (launched: 2022-12-09_04:10:12.971403) 04:10:16.663499 run osmo-hlr_10.42.42.2(pid=22436): stderr: | 20221209041013322 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209041013322 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209041013322 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209041013322 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209041013322 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209041013323 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209041013342 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209041013358 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209041013358 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209041013358 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:10:16.719011 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22423): Terminating (SIGTERM) 04:10:16.763665 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22533): Terminating (SIGTERM) 04:10:16.809675 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22710): Terminating (SIGTERM) 04:10:16.857162 --- ParallelTerminationStrategy: PID 22423 died... 04:10:16.882016 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22423): Terminated: ok {rc=0} 04:10:16.939993 --- ParallelTerminationStrategy: PID 22533 died... 04:10:16.963534 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22533): Terminated: ok {rc=0} 04:10:17.021344 --- ParallelTerminationStrategy: PID 22710 died... 04:10:17.046485 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22710): Terminated: ok {rc=0} 04:10:17.149050 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2354 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 04:10:18.456858 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:10:18.463530 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 04:10:18.498606 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 04:10:18.533120 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 04:10:18.587319 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 04:10:18.621048 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 04:10:18.655116 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 04:10:19.211952 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2354 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 04:10:19.216924 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:10:19.228174 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 04:10:19.299323 tst switch_tch_pdch.py: using LAC 18973 04:10:19.426816 tst switch_tch_pdch.py: using RAC 103 04:10:19.555438 tst switch_tch_pdch.py: using CellId 18973 04:10:19.674255 tst switch_tch_pdch.py: using BVCI 18974 04:10:19.781259 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:10:19.792392 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:10:19.803388 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:10:19.814526 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:10:19.825597 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:10:19.836458 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:10:19.847511 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:10:19.858570 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:10:19.977685 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:10:20.097269 tst switch_tch_pdch.py:51: start network... 04:10:20.310752 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:10:20.802679 run create_hlr_db(pid=22785): Launched 04:10:20.924690 bus /gobi_6: Setting Powered False 04:10:21.987774 run create_hlr_db(pid=22785): Terminated: ok {rc=0} 04:10:22.431931 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22787): Launched 04:10:22.750198 run osmo-hlr_10.42.42.2(pid=22788): Launched 04:10:22.872394 run osmo-stp_10.42.42.5: Starting osmo-stp 04:10:23.441723 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22806): Launched 04:10:23.761750 run osmo-stp_10.42.42.5(pid=22886): Launched 04:10:23.897952 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:10:24.577980 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22969): Launched 04:10:24.704183 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:10:24.978905 run patchelf(pid=22970): Launched 04:10:25.168510 run osmo-stp_10.42.42.5(pid=22886): ERR: Terminated: ERROR {rc=1} [trial-2354↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22886)] 04:10:25.304592 run osmo-stp_10.42.42.5(pid=22886): stdout: | (launched: 2022-12-09_04:10:23.700676) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:10:25.442952 run osmo-stp_10.42.42.5(pid=22886): stderr: | 20221209041023994 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041023994 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041023995 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041023995 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041023995 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041023996 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041023996 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:10:25.581563 run osmo-stp_10.42.42.5(pid=22886): stdout: | (launched: 2022-12-09_04:10:23.700676) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:10:25.713586 run osmo-stp_10.42.42.5(pid=22886): stderr: | 20221209041023994 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041023994 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041023995 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041023995 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041023995 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041023996 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041023996 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:10:25.869904 run patchelf(pid=22970): Terminating (SIGINT) 04:10:26.051279 run patchelf(pid=22970): Terminated: ok {rc=0} 04:10:26.181842 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=22886): Process ended prematurely: osmo-stp_10.42.42.5(pid=22886) [trial-2354↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22886)] [trial-2354↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 04:10:26.192504 tst switch_tch_pdch.py:54: Test FAILED (7.0 sec) 04:10:26.224199 run osmo-hlr_10.42.42.2(pid=22788): ERR: Terminated: ERROR {rc=237} [trial-2354↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22788)] 04:10:26.277423 run osmo-hlr_10.42.42.2(pid=22788): stdout: | (launched: 2022-12-09_04:10:22.692372) 04:10:26.332451 run osmo-hlr_10.42.42.2(pid=22788): stderr: | 20221209041022890 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209041022891 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209041022891 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209041022891 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209041022891 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209041022891 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209041022903 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209041022911 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209041022912 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209041022912 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:10:26.388065 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22787): Terminating (SIGTERM) 04:10:26.433148 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22806): Terminating (SIGTERM) 04:10:26.479568 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22969): Terminating (SIGTERM) 04:10:26.526314 --- ParallelTerminationStrategy: PID 22787 died... 04:10:26.547334 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22787): Terminated: ok {rc=0} 04:10:26.598462 --- ParallelTerminationStrategy: PID 22806 died... 04:10:26.619347 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22806): Terminated: ok {rc=0} 04:10:26.669380 --- ParallelTerminationStrategy: PID 22969 died... 04:10:26.690138 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22969): Terminated: ok {rc=0} 04:10:26.783531 bus /gobi_0: Setting Powered False 04:10:27.887516 bus /gobi_0: Setting Powered False 04:10:29.032464 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2354 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 04:10:30.292846 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:10:30.298854 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 04:10:30.332053 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 04:10:30.366355 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 04:10:30.419885 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 04:10:30.455165 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 04:10:30.490611 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 04:10:31.055077 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2354 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 04:10:31.063997 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:10:31.080272 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 04:10:31.169094 tst switch_tch_pdch.py: using LAC 18974 04:10:31.296346 tst switch_tch_pdch.py: using RAC 104 04:10:31.414139 tst switch_tch_pdch.py: using CellId 18974 04:10:31.568887 tst switch_tch_pdch.py: using BVCI 18975 04:10:31.715184 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:10:31.730889 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:10:31.745899 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:10:31.759547 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:10:31.773851 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:10:31.787829 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:10:31.803113 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:10:31.817446 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 04:10:31.956787 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 04:10:32.099861 tst switch_tch_pdch.py:51: start network... 04:10:32.307451 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:10:32.777250 run create_hlr_db(pid=22975): Launched 04:10:32.899627 bus /gobi_6: Setting Powered False 04:10:33.962729 run create_hlr_db(pid=22975): Terminated: ok {rc=0} 04:10:34.379684 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22977): Launched 04:10:34.697562 run osmo-hlr_10.42.42.2(pid=22978): Launched 04:10:34.820238 run osmo-stp_10.42.42.5: Starting osmo-stp 04:10:35.341739 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22980): Launched 04:10:35.658014 run osmo-stp_10.42.42.5(pid=22981): Launched 04:10:35.779200 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:10:36.298243 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22983): Launched 04:10:36.420806 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:10:36.689134 run patchelf(pid=22985): Launched 04:10:36.866054 run osmo-stp_10.42.42.5(pid=22981): ERR: Terminated: ERROR {rc=1} [trial-2354↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22981)] 04:10:37.000686 run osmo-stp_10.42.42.5(pid=22981): stdout: | (launched: 2022-12-09_04:10:35.600148) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:10:37.137308 run osmo-stp_10.42.42.5(pid=22981): stderr: | 20221209041035791 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041035792 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041035792 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041035792 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041035793 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041035793 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041035793 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:10:37.273757 run osmo-stp_10.42.42.5(pid=22981): stdout: | (launched: 2022-12-09_04:10:35.600148) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:10:37.404866 run osmo-stp_10.42.42.5(pid=22981): stderr: | 20221209041035791 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041035792 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041035792 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041035792 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041035793 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041035793 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041035793 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:10:37.559702 run patchelf(pid=22985): Terminating (SIGINT) 04:10:37.739500 run patchelf(pid=22985): Terminated: ok {rc=0} 04:10:37.868818 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=22981): Process ended prematurely: osmo-stp_10.42.42.5(pid=22981) [trial-2354↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22981)] [trial-2354↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 04:10:37.878691 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 04:10:37.907899 run osmo-hlr_10.42.42.2(pid=22978): ERR: Terminated: ERROR {rc=237} [trial-2354↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22978)] 04:10:37.959212 run osmo-hlr_10.42.42.2(pid=22978): stdout: | (launched: 2022-12-09_04:10:34.639724) 04:10:38.012278 run osmo-hlr_10.42.42.2(pid=22978): stderr: | 20221209041034834 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209041034834 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209041034834 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209041034834 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209041034834 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209041034834 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209041034847 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209041034855 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209041034855 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209041034855 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:10:38.065860 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22977): Terminating (SIGTERM) 04:10:38.108846 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22980): Terminating (SIGTERM) 04:10:38.151798 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22983): Terminating (SIGTERM) 04:10:38.195048 --- ParallelTerminationStrategy: PID 22977 died... 04:10:38.215377 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22977): Terminated: ok {rc=0} 04:10:38.263378 --- ParallelTerminationStrategy: PID 22980 died... 04:10:38.283341 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22980): Terminated: ok {rc=0} 04:10:38.330987 --- ParallelTerminationStrategy: PID 22983 died... 04:10:38.351005 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22983): Terminated: ok {rc=0} 04:10:38.441350 bus /gobi_0: Setting Powered False 04:10:39.543155 bus /gobi_0: Setting Powered False 04:10:40.661481 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2354 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 nitb_sms:trx-umtrx --------------------------------------------------------------------- 04:10:41.924353 tst nitb_sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:10:41.929286 tst nitb_sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 04:10:41.967527 tst nitb_sms:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 04:10:41.974400 tst nitb_sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 04:10:42.023979 tst nitb_sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 04:10:42.055725 tst nitb_sms:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 04:10:42.062393 tst nitb_sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 04:10:42.605568 tst nitb_sms:trx-umtrx: RESERVED RESOURCES for nitb_sms: bts UmTRX ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 nitb_sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 04:10:42.612502 tst nitb_sms:trx-umtrx: Using 1 x ip_address (candidates: 1) 04:10:42.623250 tst nitb_sms:trx-umtrx: Using 1 x bts (candidates: 1) 04:10:42.670514 tst mo_mt_sms.py: using LAC 18975 04:10:42.786557 tst mo_mt_sms.py: using RAC 105 04:10:42.905600 tst mo_mt_sms.py: using CellId 18975 04:10:43.021972 tst mo_mt_sms.py: using BVCI 18976 04:10:43.129852 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 04:10:43.246687 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 04:10:43.364044 tst mo_mt_sms.py:9: start nitb and bts... 04:10:43.578577 run osmo-nitb_10.42.42.2: Starting osmo-nitb 04:10:44.223497 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22989): Launched 04:10:44.541569 run osmo-nitb_10.42.42.2(pid=22990): Launched 04:10:44.718332 run osmo-nitb_10.42.42.2(pid=22990): ERR: Terminated: ERROR {rc=2} [trial-2354↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22990)] 04:10:44.860614 run osmo-nitb_10.42.42.2(pid=22990): stdout: | (launched: 2022-12-09_04:10:44.483840) 04:10:45.004590 run osmo-nitb_10.42.42.2(pid=22990): stderr: | (launched: 2022-12-09_04:10:44.530907) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:10:45.148406 run osmo-nitb_10.42.42.2(pid=22990): stdout: | (launched: 2022-12-09_04:10:44.483840) 04:10:45.286941 run osmo-nitb_10.42.42.2(pid=22990): stderr: | (launched: 2022-12-09_04:10:44.530907) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f4d467d3268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=22990): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22990) [trial-2354↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22990)] 04:10:45.662253 tst osmo-nitb_10.42.42.2(pid=22990): stdout: | (launched: 2022-12-09_04:10:44.483840) 04:10:45.790848 tst osmo-nitb_10.42.42.2(pid=22990): stderr: | (launched: 2022-12-09_04:10:44.530907) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:10:45.944487 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=22990): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22990) [trial-2354↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22990)] [trial-2354↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11] 04:10:45.954299 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 04:10:45.961479 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22989): Terminating (SIGTERM) 04:10:46.174419 --- ParallelTerminationStrategy: PID 22989 died... 04:10:46.197147 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22989): Terminated: ok {rc=0} 04:10:46.285120 bus /sierra_3: Setting Powered False 04:10:47.383651 bus /sierra_3: Setting Powered False 04:10:48.500807 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 nitb_sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 sms:trx-umtrx --------------------------------------------------------------------- 04:10:49.701745 tst sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:10:49.706001 tst sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 04:10:49.739662 tst sms:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 04:10:49.767132 tst sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 04:10:49.820813 tst sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 04:10:49.853066 tst sms:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 04:10:49.879630 tst sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 04:10:50.427950 tst sms:trx-umtrx: RESERVED RESOURCES for sms: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 04:10:50.433336 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 04:10:50.444149 tst sms:trx-umtrx: Using 1 x bts (candidates: 1) 04:10:50.492927 tst mo_mt_sms.py: using LAC 18976 04:10:50.618963 tst mo_mt_sms.py: using RAC 106 04:10:50.743802 tst mo_mt_sms.py: using CellId 18976 04:10:50.862904 tst mo_mt_sms.py: using BVCI 18977 04:10:50.972308 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 04:10:50.983054 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 04:10:50.993647 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 04:10:51.004260 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 04:10:51.014896 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 04:10:51.025566 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 04:10:51.140730 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 04:10:51.256665 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:10:51.716676 run create_hlr_db(pid=22994): Launched 04:10:51.838363 bus /sierra_2: Setting Powered False 04:10:52.898451 run create_hlr_db(pid=22994): Terminated: ok {rc=0} 04:10:53.332694 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22996): Launched 04:10:53.649132 run osmo-hlr_10.42.42.2(pid=22997): Launched 04:10:53.770062 run osmo-stp_10.42.42.5: Starting osmo-stp 04:10:54.317709 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22999): Launched 04:10:54.636627 run osmo-stp_10.42.42.5(pid=23000): Launched 04:10:54.758730 run osmo-msc_10.42.42.6: Starting osmo-msc 04:10:55.332763 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23002): Launched 04:10:55.649731 run osmo-msc_10.42.42.6(pid=23003): Launched 04:10:55.827458 run osmo-stp_10.42.42.5(pid=23000): ERR: Terminated: ERROR {rc=1} [trial-2354↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23000)] 04:10:55.962023 run osmo-stp_10.42.42.5(pid=23000): stdout: | (launched: 2022-12-09_04:10:54.578437) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:10:56.096852 run osmo-stp_10.42.42.5(pid=23000): stderr: | 20221209041054771 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041054771 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041054771 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041054772 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041054772 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041054772 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041054772 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:10:56.231672 run osmo-stp_10.42.42.5(pid=23000): stdout: | (launched: 2022-12-09_04:10:54.578437) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:10:56.358211 run osmo-stp_10.42.42.5(pid=23000): stderr: | 20221209041054771 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041054771 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041054771 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041054772 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041054772 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041054772 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041054772 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:10:56.509462 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=23000): Process ended prematurely: osmo-stp_10.42.42.5(pid=23000) [trial-2354↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23000)] [trial-2354↪sms:trx-umtrx↪mo_mt_sms.py:16] 04:10:56.518518 tst mo_mt_sms.py:16: Test FAILED (6.1 sec) 04:10:56.546553 run osmo-hlr_10.42.42.2(pid=22997): ERR: Terminated: ERROR {rc=237} [trial-2354↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22997)] 04:10:56.597813 run osmo-hlr_10.42.42.2(pid=22997): stdout: | (launched: 2022-12-09_04:10:53.591603) 04:10:56.650720 run osmo-hlr_10.42.42.2(pid=22997): stderr: | 20221209041053791 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209041053791 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209041053791 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209041053791 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209041053791 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209041053791 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209041053802 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/sms:trx-umtrx/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209041053811 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209041053811 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209041053811 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:10:56.724589 run osmo-msc_10.42.42.6(pid=23003): ERR: Terminated: ERROR {rc=2} [trial-2354↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23003)] 04:10:56.775340 run osmo-msc_10.42.42.6(pid=23003): stdout: | (launched: 2022-12-09_04:10:55.591880) 04:10:56.827874 run osmo-msc_10.42.42.6(pid=23003): stderr: | 20221209041055912 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209041055912 DLGLOBAL DEBUG validating counter group 0x7f7a8ce42c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209041055912 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209041055912 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209041055912 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209041055912 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209041055914 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209041055915 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209041055915 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209041055915 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:10:56.880901 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22996): Terminating (SIGTERM) 04:10:56.923296 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22999): Terminating (SIGTERM) 04:10:56.965894 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23002): Terminating (SIGTERM) 04:10:57.008526 --- ParallelTerminationStrategy: PID 22996 died... 04:10:57.028664 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22996): Terminated: ok {rc=0} 04:10:57.075671 --- ParallelTerminationStrategy: PID 22999 died... 04:10:57.095404 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22999): Terminated: ok {rc=0} 04:10:57.142397 --- ParallelTerminationStrategy: PID 23002 died... 04:10:57.162145 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23002): Terminated: ok {rc=0} 04:10:57.251164 bus /sierra_3: Setting Powered False 04:10:58.352681 bus /sierra_3: Setting Powered False 04:10:59.471419 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 nitb_ussd:trx-umtrx --------------------------------------------------------------------- 04:11:00.701398 tst nitb_ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:11:00.705182 tst nitb_ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 04:11:00.738400 tst nitb_ussd:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 04:11:00.745185 tst nitb_ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 04:11:00.780443 tst nitb_ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 04:11:00.813310 tst nitb_ussd:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 04:11:00.819919 tst nitb_ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 04:11:01.343632 tst nitb_ussd:trx-umtrx: RESERVED RESOURCES for nitb_ussd: bts UmTRX ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2354 nitb_ussd:trx-umtrx assert_extension.py ---------------------------------------------- 04:11:01.349487 tst nitb_ussd:trx-umtrx: Using 1 x ip_address (candidates: 1) 04:11:01.360770 tst nitb_ussd:trx-umtrx: Using 1 x bts (candidates: 1) 04:11:01.410658 tst assert_extension.py: using LAC 18977 04:11:01.569752 tst assert_extension.py: using RAC 107 04:11:01.727459 tst assert_extension.py: using CellId 18977 04:11:01.852388 tst assert_extension.py: using BVCI 18978 04:11:01.972250 tst nitb_ussd:trx-umtrx: Using 1 x modem (candidates: 1) 04:11:02.093241 tst assert_extension.py:10: start nitb and bts... 04:11:02.312100 run osmo-nitb_10.42.42.2: Starting osmo-nitb 04:11:02.961563 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23008): Launched 04:11:03.281578 run osmo-nitb_10.42.42.2(pid=23009): Launched 04:11:03.459329 run osmo-nitb_10.42.42.2(pid=23009): ERR: Terminated: ERROR {rc=2} [trial-2354↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23009)] 04:11:03.602499 run osmo-nitb_10.42.42.2(pid=23009): stdout: | (launched: 2022-12-09_04:11:03.223857) 04:11:03.746837 run osmo-nitb_10.42.42.2(pid=23009): stderr: | (launched: 2022-12-09_04:11:03.270918) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:11:03.891503 run osmo-nitb_10.42.42.2(pid=23009): stdout: | (launched: 2022-12-09_04:11:03.223857) 04:11:04.030246 run osmo-nitb_10.42.42.2(pid=23009): stderr: | (launched: 2022-12-09_04:11:03.270918) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f4d467d3268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=23009): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23009) [trial-2354↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23009)] 04:11:04.403539 tst osmo-nitb_10.42.42.2(pid=23009): stdout: | (launched: 2022-12-09_04:11:03.223857) 04:11:04.531717 tst osmo-nitb_10.42.42.2(pid=23009): stderr: | (launched: 2022-12-09_04:11:03.270918) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:11:04.683241 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=23009): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23009) [trial-2354↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23009)] [trial-2354↪nitb_ussd:trx-umtrx↪assert_extension.py:12] 04:11:04.692261 tst assert_extension.py:12: Test FAILED (3.3 sec) 04:11:04.699422 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23008): Terminating (SIGTERM) 04:11:04.911754 --- ParallelTerminationStrategy: PID 23008 died... 04:11:04.933739 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23008): Terminated: ok {rc=0} 04:11:05.022988 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 nitb_ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 ussd:trx-umtrx --------------------------------------------------------------------- 04:11:06.205248 tst ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:11:06.209474 tst ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 04:11:06.243145 tst ussd:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 04:11:06.270609 tst ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 04:11:06.306668 tst ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 04:11:06.339980 tst ussd:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 04:11:06.368291 tst ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 04:11:06.894881 tst ussd:trx-umtrx: RESERVED RESOURCES for ussd: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2354 ussd:trx-umtrx assert_extension.py ---------------------------------------------- 04:11:06.900264 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 04:11:06.911373 tst ussd:trx-umtrx: Using 1 x bts (candidates: 1) 04:11:06.961357 tst assert_extension.py: using LAC 18978 04:11:07.086236 tst assert_extension.py: using RAC 108 04:11:07.213194 tst assert_extension.py: using CellId 18978 04:11:07.342639 tst assert_extension.py: using BVCI 18979 04:11:07.460336 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 04:11:07.471481 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 04:11:07.482605 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 04:11:07.494496 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 04:11:07.506156 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 04:11:07.517935 tst ussd:trx-umtrx: Using 1 x modem (candidates: 1) 04:11:07.634829 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:11:08.093654 run create_hlr_db(pid=23014): Launched 04:11:08.215145 bus /sierra_2: Setting Powered False 04:11:09.274842 run create_hlr_db(pid=23014): Terminated: ok {rc=0} 04:11:09.710167 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23016): Launched 04:11:10.027170 run osmo-hlr_10.42.42.2(pid=23017): Launched 04:11:10.148900 run osmo-stp_10.42.42.5: Starting osmo-stp 04:11:10.706623 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23019): Launched 04:11:11.024098 run osmo-stp_10.42.42.5(pid=23020): Launched 04:11:11.145099 run osmo-msc_10.42.42.6: Starting osmo-msc 04:11:11.717770 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23022): Launched 04:11:12.034080 run osmo-msc_10.42.42.6(pid=23023): Launched 04:11:12.211779 run osmo-stp_10.42.42.5(pid=23020): ERR: Terminated: ERROR {rc=1} [trial-2354↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23020)] 04:11:12.346861 run osmo-stp_10.42.42.5(pid=23020): stdout: | (launched: 2022-12-09_04:11:10.966333) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:11:12.482817 run osmo-stp_10.42.42.5(pid=23020): stderr: | 20221209041111159 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041111160 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041111160 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041111160 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041111161 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041111161 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041111161 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:11:12.617432 run osmo-stp_10.42.42.5(pid=23020): stdout: | (launched: 2022-12-09_04:11:10.966333) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:11:12.744375 run osmo-stp_10.42.42.5(pid=23020): stderr: | 20221209041111159 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041111160 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041111160 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041111160 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041111161 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041111161 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041111161 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:11:12.895461 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=23020): Process ended prematurely: osmo-stp_10.42.42.5(pid=23020) [trial-2354↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23020)] [trial-2354↪ussd:trx-umtrx↪assert_extension.py:17] 04:11:12.904630 tst assert_extension.py:17: Test FAILED (6.0 sec) 04:11:12.932867 run osmo-hlr_10.42.42.2(pid=23017): ERR: Terminated: ERROR {rc=237} [trial-2354↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23017)] 04:11:12.984328 run osmo-hlr_10.42.42.2(pid=23017): stdout: | (launched: 2022-12-09_04:11:09.969400) 04:11:13.037504 run osmo-hlr_10.42.42.2(pid=23017): stderr: | 20221209041110170 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209041110170 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209041110170 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209041110170 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209041110170 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209041110170 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209041110192 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/ussd:trx-umtrx/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209041110202 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209041110202 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209041110202 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:11:13.111683 run osmo-msc_10.42.42.6(pid=23023): ERR: Terminated: ERROR {rc=2} [trial-2354↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23023)] 04:11:13.163051 run osmo-msc_10.42.42.6(pid=23023): stdout: | (launched: 2022-12-09_04:11:11.976159) 04:11:13.215770 run osmo-msc_10.42.42.6(pid=23023): stderr: | 20221209041112298 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209041112298 DLGLOBAL DEBUG validating counter group 0x7f2a3f422c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209041112298 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209041112298 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209041112298 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209041112299 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209041112300 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209041112301 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209041112301 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209041112301 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:11:13.269364 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23016): Terminating (SIGTERM) 04:11:13.312161 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23019): Terminating (SIGTERM) 04:11:13.355525 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23022): Terminating (SIGTERM) 04:11:13.398754 --- ParallelTerminationStrategy: PID 23016 died... 04:11:13.419066 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23016): Terminated: ok {rc=0} 04:11:13.466528 --- ParallelTerminationStrategy: PID 23019 died... 04:11:13.486428 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23019): Terminated: ok {rc=0} 04:11:13.533428 --- ParallelTerminationStrategy: PID 23022 died... 04:11:13.553169 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23022): Terminated: ok {rc=0} 04:11:13.641875 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 04:11:14.868237 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:11:14.877498 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 04:11:14.911992 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 04:11:14.940039 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 04:11:14.992188 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 04:11:15.025340 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 04:11:15.052081 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 04:11:15.602189 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 04:11:15.652397 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:11:15.663506 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 04:11:15.735919 tst mo_mt_call.py: using LAC 18979 04:11:15.874959 tst mo_mt_call.py: using RAC 109 04:11:16.008913 tst mo_mt_call.py: using CellId 18979 04:11:16.175895 tst mo_mt_call.py: using BVCI 18980 04:11:16.342550 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:11:16.354600 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:11:16.366911 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:11:16.378847 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:11:16.391144 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:11:16.403797 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 04:11:16.545381 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 04:11:16.686509 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:11:17.176599 run create_hlr_db(pid=23029): Launched 04:11:17.331273 bus /sierra_2: Setting Powered False 04:11:18.395184 run create_hlr_db(pid=23029): Terminated: ok {rc=0} 04:11:18.828697 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23031): Launched 04:11:19.130786 run osmo-hlr_10.42.42.2(pid=23032): Launched 04:11:19.244832 run osmo-stp_10.42.42.5: Starting osmo-stp 04:11:19.776644 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23034): Launched 04:11:20.077726 run osmo-stp_10.42.42.5(pid=23035): Launched 04:11:20.191585 run osmo-msc_10.42.42.6: Starting osmo-msc 04:11:20.735550 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23037): Launched 04:11:21.037705 run osmo-msc_10.42.42.6(pid=23038): Launched 04:11:21.206250 run osmo-stp_10.42.42.5(pid=23035): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23035)] 04:11:21.333778 run osmo-stp_10.42.42.5(pid=23035): stdout: | (launched: 2022-12-09_04:11:20.022640) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:11:21.460942 run osmo-stp_10.42.42.5(pid=23035): stderr: | 20221209041120193 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041120193 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041120193 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041120194 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041120194 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041120194 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041120194 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:11:21.586398 run osmo-stp_10.42.42.5(pid=23035): stdout: | (launched: 2022-12-09_04:11:20.022640) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:11:21.706125 run osmo-stp_10.42.42.5(pid=23035): stderr: | 20221209041120193 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041120193 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041120193 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041120194 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041120194 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041120194 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041120194 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:11:21.849940 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23035): Process ended prematurely: osmo-stp_10.42.42.5(pid=23035) [trial-2354↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23035)] [trial-2354↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 04:11:21.858878 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 04:11:21.885567 run osmo-hlr_10.42.42.2(pid=23032): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23032)] 04:11:21.933586 run osmo-hlr_10.42.42.2(pid=23032): stdout: | (launched: 2022-12-09_04:11:19.075430) 04:11:21.983232 run osmo-hlr_10.42.42.2(pid=23032): stderr: | 20221209041119253 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209041119253 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209041119253 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209041119253 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209041119253 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209041119253 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209041119264 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209041119274 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209041119275 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209041119275 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:11:22.052628 run osmo-msc_10.42.42.6(pid=23038): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23038)] 04:11:22.100753 run osmo-msc_10.42.42.6(pid=23038): stdout: | (launched: 2022-12-09_04:11:20.982160) 04:11:22.150424 run osmo-msc_10.42.42.6(pid=23038): stderr: | 20221209041121253 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209041121253 DLGLOBAL DEBUG validating counter group 0x7fcdc2f85c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209041121253 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209041121253 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209041121253 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209041121253 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209041121255 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209041121255 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209041121256 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209041121256 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:11:22.200332 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23031): Terminating (SIGTERM) 04:11:22.240022 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23034): Terminating (SIGTERM) 04:11:22.279912 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23037): Terminating (SIGTERM) 04:11:22.320010 --- ParallelTerminationStrategy: PID 23031 died... 04:11:22.339095 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23031): Terminated: ok {rc=0} 04:11:22.383234 --- ParallelTerminationStrategy: PID 23034 died... 04:11:22.401944 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23034): Terminated: ok {rc=0} 04:11:22.446207 --- ParallelTerminationStrategy: PID 23037 died... 04:11:22.464909 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23037): Terminated: ok {rc=0} 04:11:22.548336 bus /sierra_3: Setting Powered False 04:11:23.644705 bus /sierra_3: Setting Powered False 04:11:24.761570 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2354 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 04:11:25.908633 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:11:25.920162 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 04:11:25.988632 tst mo_mt_call_osmux.py: using LAC 18980 04:11:26.108292 tst mo_mt_call_osmux.py: using RAC 110 04:11:26.228161 tst mo_mt_call_osmux.py: using CellId 18980 04:11:26.360261 tst mo_mt_call_osmux.py: using BVCI 18981 04:11:26.470601 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:11:26.481563 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:11:26.492251 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:11:26.503059 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:11:26.513871 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:11:26.524501 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 04:11:26.642927 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 04:11:26.763142 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:11:27.264316 run create_hlr_db(pid=23040): Launched 04:11:27.388618 bus /sierra_2: Setting Powered False 04:11:28.453109 run create_hlr_db(pid=23040): Terminated: ok {rc=0} 04:11:28.884745 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23042): Launched 04:11:29.185692 run osmo-hlr_10.42.42.2(pid=23043): Launched 04:11:29.300287 run osmo-stp_10.42.42.5: Starting osmo-stp 04:11:29.817399 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23045): Launched 04:11:30.119408 run osmo-stp_10.42.42.5(pid=23046): Launched 04:11:30.234990 run osmo-msc_10.42.42.6: Starting osmo-msc 04:11:30.779380 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23048): Launched 04:11:31.100794 run osmo-msc_10.42.42.6(pid=23049): Launched 04:11:31.374204 run osmo-stp_10.42.42.5(pid=23046): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23046)] 04:11:31.695825 run osmo-stp_10.42.42.5(pid=23046): stdout: | (launched: 2022-12-09_04:11:30.063972) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:11:31.996161 run osmo-stp_10.42.42.5(pid=23046): stderr: | 20221209041130236 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041130236 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041130237 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041130237 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041130238 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041130238 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041130238 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:11:32.144629 run osmo-stp_10.42.42.5(pid=23046): stdout: | (launched: 2022-12-09_04:11:30.063972) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:11:32.269798 run osmo-stp_10.42.42.5(pid=23046): stderr: | 20221209041130236 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041130236 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041130237 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041130237 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041130238 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041130238 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041130238 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:11:32.416445 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23046): Process ended prematurely: osmo-stp_10.42.42.5(pid=23046) [trial-2354↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23046)] [trial-2354↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 04:11:32.425499 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 04:11:32.452505 run osmo-hlr_10.42.42.2(pid=23043): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23043)] 04:11:32.501626 run osmo-hlr_10.42.42.2(pid=23043): stdout: | (launched: 2022-12-09_04:11:29.130900) 04:11:32.551912 run osmo-hlr_10.42.42.2(pid=23043): stderr: | 20221209041129306 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209041129306 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209041129306 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209041129306 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209041129306 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209041129307 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209041129319 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209041129328 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209041129328 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209041129328 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:11:32.622297 run osmo-msc_10.42.42.6(pid=23049): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23049)] 04:11:32.670979 run osmo-msc_10.42.42.6(pid=23049): stdout: | (launched: 2022-12-09_04:11:31.043109) 04:11:32.721173 run osmo-msc_10.42.42.6(pid=23049): stderr: | 20221209041131578 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209041131578 DLGLOBAL DEBUG validating counter group 0x7f0337fc1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209041131578 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209041131578 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209041131578 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209041131579 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209041131580 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209041131581 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209041131581 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209041131581 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:11:32.771332 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23042): Terminating (SIGTERM) 04:11:32.811718 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23045): Terminating (SIGTERM) 04:11:32.852500 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23048): Terminating (SIGTERM) 04:11:32.893541 --- ParallelTerminationStrategy: PID 23042 died... 04:11:32.913046 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23042): Terminated: ok {rc=0} 04:11:32.957676 --- ParallelTerminationStrategy: PID 23045 died... 04:11:32.976578 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23045): Terminated: ok {rc=0} 04:11:33.021202 --- ParallelTerminationStrategy: PID 23048 died... 04:11:33.040014 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23048): Terminated: ok {rc=0} 04:11:33.125428 bus /sierra_3: Setting Powered False 04:11:34.223572 bus /sierra_3: Setting Powered False 04:11:35.340526 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 04:11:36.586014 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:11:36.592410 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 04:11:36.624450 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 04:11:36.650541 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 04:11:36.703489 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 04:11:36.738431 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 04:11:36.766020 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 04:11:37.310649 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 04:11:37.359098 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:11:37.370352 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 04:11:37.438147 tst mo_mt_call.py: using LAC 18981 04:11:37.558117 tst mo_mt_call.py: using RAC 111 04:11:37.677399 tst mo_mt_call.py: using CellId 18981 04:11:37.797754 tst mo_mt_call.py: using BVCI 18982 04:11:37.906821 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:11:37.917959 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:11:37.929030 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:11:37.939871 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:11:37.950828 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:11:37.961727 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 04:11:38.079908 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 04:11:38.198872 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:11:38.701674 run create_hlr_db(pid=23054): Launched 04:11:38.826327 bus /sierra_2: Setting Powered False 04:11:39.890510 run create_hlr_db(pid=23054): Terminated: ok {rc=0} 04:11:40.324562 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23056): Launched 04:11:40.626922 run osmo-hlr_10.42.42.2(pid=23057): Launched 04:11:40.742455 run osmo-stp_10.42.42.5: Starting osmo-stp 04:11:41.278468 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23059): Launched 04:11:41.579790 run osmo-stp_10.42.42.5(pid=23060): Launched 04:11:41.694893 run osmo-msc_10.42.42.6: Starting osmo-msc 04:11:42.239805 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23062): Launched 04:11:42.541593 run osmo-msc_10.42.42.6(pid=23063): Launched 04:11:42.711056 run osmo-stp_10.42.42.5(pid=23060): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23060)] 04:11:42.839259 run osmo-stp_10.42.42.5(pid=23060): stdout: | (launched: 2022-12-09_04:11:41.524508) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:11:42.967908 run osmo-stp_10.42.42.5(pid=23060): stderr: | 20221209041141694 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041141694 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041141694 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041141695 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041141695 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041141695 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041141695 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:11:43.093571 run osmo-stp_10.42.42.5(pid=23060): stdout: | (launched: 2022-12-09_04:11:41.524508) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:11:43.213915 run osmo-stp_10.42.42.5(pid=23060): stderr: | 20221209041141694 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041141694 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041141694 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041141695 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041141695 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041141695 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041141695 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:11:43.357972 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23060): Process ended prematurely: osmo-stp_10.42.42.5(pid=23060) [trial-2354↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23060)] [trial-2354↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 04:11:43.366720 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 04:11:43.393497 run osmo-hlr_10.42.42.2(pid=23057): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23057)] 04:11:43.441483 run osmo-hlr_10.42.42.2(pid=23057): stdout: | (launched: 2022-12-09_04:11:40.571317) 04:11:43.491188 run osmo-hlr_10.42.42.2(pid=23057): stderr: | 20221209041140750 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209041140750 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209041140750 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209041140750 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209041140751 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209041140751 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209041140763 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209041140773 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209041140774 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209041140774 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:11:43.560686 run osmo-msc_10.42.42.6(pid=23063): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23063)] 04:11:43.608894 run osmo-msc_10.42.42.6(pid=23063): stdout: | (launched: 2022-12-09_04:11:42.485776) 04:11:43.658734 run osmo-msc_10.42.42.6(pid=23063): stderr: | 20221209041142759 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209041142759 DLGLOBAL DEBUG validating counter group 0x7efd48b1bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209041142759 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209041142759 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209041142759 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209041142760 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209041142761 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209041142762 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209041142762 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209041142762 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:11:43.708823 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23056): Terminating (SIGTERM) 04:11:43.748492 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23059): Terminating (SIGTERM) 04:11:43.788061 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23062): Terminating (SIGTERM) 04:11:43.828066 --- ParallelTerminationStrategy: PID 23056 died... 04:11:43.847255 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23056): Terminated: ok {rc=0} 04:11:43.891489 --- ParallelTerminationStrategy: PID 23059 died... 04:11:43.910356 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23059): Terminated: ok {rc=0} 04:11:43.954854 --- ParallelTerminationStrategy: PID 23062 died... 04:11:43.973672 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23062): Terminated: ok {rc=0} 04:11:44.060863 bus /sierra_3: Setting Powered False 04:11:45.162387 bus /sierra_3: Setting Powered False 04:11:46.293793 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2354 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 04:11:47.446319 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:11:47.458646 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 04:11:47.530130 tst mo_mt_call_osmux.py: using LAC 18982 04:11:47.658938 tst mo_mt_call_osmux.py: using RAC 112 04:11:47.785599 tst mo_mt_call_osmux.py: using CellId 18982 04:11:47.905220 tst mo_mt_call_osmux.py: using BVCI 18983 04:11:48.014749 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:11:48.025891 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:11:48.036722 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:11:48.048177 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:11:48.059641 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:11:48.071055 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 04:11:48.193492 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 04:11:48.318320 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:11:48.820087 run create_hlr_db(pid=23065): Launched 04:11:48.944573 bus /sierra_2: Setting Powered False 04:11:50.008759 run create_hlr_db(pid=23065): Terminated: ok {rc=0} 04:11:50.458522 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23067): Launched 04:11:50.782395 run osmo-hlr_10.42.42.2(pid=23068): Launched 04:11:50.906902 run osmo-stp_10.42.42.5: Starting osmo-stp 04:11:51.468160 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23070): Launched 04:11:51.791510 run osmo-stp_10.42.42.5(pid=23071): Launched 04:11:51.915816 run osmo-msc_10.42.42.6: Starting osmo-msc 04:11:52.499947 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23073): Launched 04:11:52.823612 run osmo-msc_10.42.42.6(pid=23074): Launched 04:11:53.004244 run osmo-stp_10.42.42.5(pid=23071): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23071)] 04:11:53.141598 run osmo-stp_10.42.42.5(pid=23071): stdout: | (launched: 2022-12-09_04:11:51.732550) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:11:53.279026 run osmo-stp_10.42.42.5(pid=23071): stderr: | 20221209041151924 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041151924 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041151924 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041151925 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041151925 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041151925 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041151925 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:11:53.415921 run osmo-stp_10.42.42.5(pid=23071): stdout: | (launched: 2022-12-09_04:11:51.732550) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:11:53.545153 run osmo-stp_10.42.42.5(pid=23071): stderr: | 20221209041151924 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041151924 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041151924 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041151925 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041151925 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041151925 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041151925 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:11:53.699322 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23071): Process ended prematurely: osmo-stp_10.42.42.5(pid=23071) [trial-2354↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23071)] [trial-2354↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 04:11:53.708807 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 04:11:53.737390 run osmo-hlr_10.42.42.2(pid=23068): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23068)] 04:11:53.787988 run osmo-hlr_10.42.42.2(pid=23068): stdout: | (launched: 2022-12-09_04:11:50.723702) 04:11:53.840441 run osmo-hlr_10.42.42.2(pid=23068): stderr: | 20221209041150922 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209041150922 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209041150922 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209041150922 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209041150922 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209041150923 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209041150935 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209041150943 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209041150944 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209041150944 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:11:53.913698 run osmo-msc_10.42.42.6(pid=23074): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23074)] 04:11:53.964485 run osmo-msc_10.42.42.6(pid=23074): stdout: | (launched: 2022-12-09_04:11:52.764758) 04:11:54.017100 run osmo-msc_10.42.42.6(pid=23074): stderr: | 20221209041153090 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209041153090 DLGLOBAL DEBUG validating counter group 0x7f9fba78cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209041153090 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209041153090 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209041153090 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209041153091 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209041153092 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209041153093 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209041153093 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209041153093 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:11:54.069691 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23067): Terminating (SIGTERM) 04:11:54.111948 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23070): Terminating (SIGTERM) 04:11:54.154207 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23073): Terminating (SIGTERM) 04:11:54.196623 --- ParallelTerminationStrategy: PID 23067 died... 04:11:54.216649 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23067): Terminated: ok {rc=0} 04:11:54.263640 --- ParallelTerminationStrategy: PID 23070 died... 04:11:54.283222 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23070): Terminated: ok {rc=0} 04:11:54.329837 --- ParallelTerminationStrategy: PID 23073 died... 04:11:54.349525 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23073): Terminated: ok {rc=0} 04:11:54.439277 bus /sierra_3: Setting Powered False 04:11:55.539647 bus /sierra_3: Setting Powered False 04:11:56.657562 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 04:11:57.907333 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:11:57.913716 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 04:11:57.945770 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 04:11:57.972302 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 04:11:58.022980 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 04:11:58.055152 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 04:11:58.081458 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 04:11:58.632464 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 04:11:58.681628 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:11:58.692702 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 04:11:58.765804 tst mo_mt_call.py: using LAC 18983 04:11:58.884551 tst mo_mt_call.py: using RAC 113 04:11:59.001489 tst mo_mt_call.py: using CellId 18983 04:11:59.119622 tst mo_mt_call.py: using BVCI 18984 04:11:59.228626 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:11:59.239689 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:11:59.250509 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:11:59.261592 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:11:59.272596 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:11:59.283480 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 04:11:59.396136 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 04:11:59.515185 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:12:00.017099 run create_hlr_db(pid=23079): Launched 04:12:00.141571 bus /sierra_2: Setting Powered False 04:12:01.204153 run create_hlr_db(pid=23079): Terminated: ok {rc=0} 04:12:01.663793 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23081): Launched 04:12:02.005130 run osmo-hlr_10.42.42.2(pid=23082): Launched 04:12:02.210341 run osmo-stp_10.42.42.5: Starting osmo-stp 04:12:02.732904 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23084): Launched 04:12:03.035238 run osmo-stp_10.42.42.5(pid=23085): Launched 04:12:03.150491 run osmo-msc_10.42.42.6: Starting osmo-msc 04:12:03.694847 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23087): Launched 04:12:03.997040 run osmo-msc_10.42.42.6(pid=23088): Launched 04:12:04.166975 run osmo-stp_10.42.42.5(pid=23085): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23085)] 04:12:04.295000 run osmo-stp_10.42.42.5(pid=23085): stdout: | (launched: 2022-12-09_04:12:02.979533) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:12:04.423032 run osmo-stp_10.42.42.5(pid=23085): stderr: | 20221209041203152 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041203152 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041203152 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041203152 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041203153 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041203153 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041203153 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:12:04.549456 run osmo-stp_10.42.42.5(pid=23085): stdout: | (launched: 2022-12-09_04:12:02.979533) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:12:04.669804 run osmo-stp_10.42.42.5(pid=23085): stderr: | 20221209041203152 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041203152 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041203152 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041203152 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041203153 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041203153 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041203153 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:12:04.813901 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23085): Process ended prematurely: osmo-stp_10.42.42.5(pid=23085) [trial-2354↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23085)] [trial-2354↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 04:12:04.822850 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 04:12:04.849561 run osmo-hlr_10.42.42.2(pid=23082): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23082)] 04:12:04.897964 run osmo-hlr_10.42.42.2(pid=23082): stdout: | (launched: 2022-12-09_04:12:01.943836) 04:12:04.948150 run osmo-hlr_10.42.42.2(pid=23082): stderr: | 20221209041202209 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209041202209 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209041202209 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209041202209 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209041202209 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209041202209 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209041202222 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209041202230 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209041202230 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209041202230 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:12:05.018137 run osmo-msc_10.42.42.6(pid=23088): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23088)] 04:12:05.066424 run osmo-msc_10.42.42.6(pid=23088): stdout: | (launched: 2022-12-09_04:12:03.941604) 04:12:05.116891 run osmo-msc_10.42.42.6(pid=23088): stderr: | 20221209041204214 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209041204214 DLGLOBAL DEBUG validating counter group 0x7f311a7a3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209041204214 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209041204214 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209041204214 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209041204215 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209041204216 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209041204217 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209041204217 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209041204217 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:12:05.167091 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23081): Terminating (SIGTERM) 04:12:05.207084 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23084): Terminating (SIGTERM) 04:12:05.247263 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23087): Terminating (SIGTERM) 04:12:05.287686 --- ParallelTerminationStrategy: PID 23081 died... 04:12:05.306944 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23081): Terminated: ok {rc=0} 04:12:05.351899 --- ParallelTerminationStrategy: PID 23084 died... 04:12:05.370900 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23084): Terminated: ok {rc=0} 04:12:05.415341 --- ParallelTerminationStrategy: PID 23087 died... 04:12:05.434295 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23087): Terminated: ok {rc=0} 04:12:05.519438 bus /sierra_3: Setting Powered False 04:12:06.618993 bus /sierra_3: Setting Powered False 04:12:07.737927 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2354 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 04:12:08.885753 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:12:08.897354 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 04:12:08.965512 tst mo_mt_call_osmux.py: using LAC 18984 04:12:09.084034 tst mo_mt_call_osmux.py: using RAC 114 04:12:09.208416 tst mo_mt_call_osmux.py: using CellId 18984 04:12:09.327659 tst mo_mt_call_osmux.py: using BVCI 18985 04:12:09.437354 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:12:09.448269 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:12:09.459154 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:12:09.470096 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:12:09.481124 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:12:09.491813 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 04:12:09.606687 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 04:12:09.726841 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:12:10.230644 run create_hlr_db(pid=23090): Launched 04:12:10.355205 bus /sierra_2: Setting Powered False 04:12:11.420113 run create_hlr_db(pid=23090): Terminated: ok {rc=0} 04:12:11.854007 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23092): Launched 04:12:12.157389 run osmo-hlr_10.42.42.2(pid=23093): Launched 04:12:12.273220 run osmo-stp_10.42.42.5: Starting osmo-stp 04:12:12.796437 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23095): Launched 04:12:13.098842 run osmo-stp_10.42.42.5(pid=23096): Launched 04:12:13.214874 run osmo-msc_10.42.42.6: Starting osmo-msc 04:12:13.760265 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23098): Launched 04:12:14.061786 run osmo-msc_10.42.42.6(pid=23099): Launched 04:12:14.230970 run osmo-stp_10.42.42.5(pid=23096): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23096)] 04:12:14.358214 run osmo-stp_10.42.42.5(pid=23096): stdout: | (launched: 2022-12-09_04:12:13.043381) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:12:14.485684 run osmo-stp_10.42.42.5(pid=23096): stderr: | 20221209041213215 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041213215 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041213215 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041213216 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041213216 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041213216 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041213216 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:12:14.611115 run osmo-stp_10.42.42.5(pid=23096): stdout: | (launched: 2022-12-09_04:12:13.043381) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:12:14.731188 run osmo-stp_10.42.42.5(pid=23096): stderr: | 20221209041213215 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041213215 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041213215 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041213216 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041213216 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041213216 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041213216 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:12:14.875176 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23096): Process ended prematurely: osmo-stp_10.42.42.5(pid=23096) [trial-2354↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23096)] [trial-2354↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 04:12:14.884013 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 04:12:14.910535 run osmo-hlr_10.42.42.2(pid=23093): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23093)] 04:12:14.958874 run osmo-hlr_10.42.42.2(pid=23093): stdout: | (launched: 2022-12-09_04:12:12.101622) 04:12:15.008579 run osmo-hlr_10.42.42.2(pid=23093): stderr: | 20221209041212278 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209041212278 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209041212278 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209041212278 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209041212278 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209041212278 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209041212290 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209041212299 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209041212299 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209041212300 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:12:15.079199 run osmo-msc_10.42.42.6(pid=23099): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23099)] 04:12:15.127262 run osmo-msc_10.42.42.6(pid=23099): stdout: | (launched: 2022-12-09_04:12:14.006397) 04:12:15.176892 run osmo-msc_10.42.42.6(pid=23099): stderr: | 20221209041214282 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209041214282 DLGLOBAL DEBUG validating counter group 0x7fd0f148ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209041214282 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209041214282 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209041214283 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209041214283 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209041214284 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209041214285 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209041214285 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209041214285 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:12:15.227768 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23092): Terminating (SIGTERM) 04:12:15.267928 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23095): Terminating (SIGTERM) 04:12:15.307821 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23098): Terminating (SIGTERM) 04:12:15.347933 --- ParallelTerminationStrategy: PID 23092 died... 04:12:15.367164 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23092): Terminated: ok {rc=0} 04:12:15.411252 --- ParallelTerminationStrategy: PID 23095 died... 04:12:15.430014 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23095): Terminated: ok {rc=0} 04:12:15.474187 --- ParallelTerminationStrategy: PID 23098 died... 04:12:15.492735 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23098): Terminated: ok {rc=0} 04:12:15.577414 bus /sierra_3: Setting Powered False 04:12:16.677779 bus /sierra_3: Setting Powered False 04:12:17.792195 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 04:12:19.048563 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:12:19.057343 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 04:12:19.091305 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 04:12:19.118656 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 04:12:19.169439 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 04:12:19.202610 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 04:12:19.229759 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 04:12:19.781294 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 04:12:19.836030 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:12:19.847534 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 04:12:19.916385 tst mo_mt_call.py: using LAC 18985 04:12:20.042840 tst mo_mt_call.py: using RAC 115 04:12:20.172401 tst mo_mt_call.py: using CellId 18985 04:12:20.297422 tst mo_mt_call.py: using BVCI 18986 04:12:20.407787 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:12:20.418933 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:12:20.429810 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:12:20.440784 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:12:20.451710 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:12:20.462633 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 04:12:20.580181 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 04:12:20.699906 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:12:21.168053 run create_hlr_db(pid=23105): Launched 04:12:21.293647 bus /sierra_2: Setting Powered False 04:12:22.354276 run create_hlr_db(pid=23105): Terminated: ok {rc=0} 04:12:22.795069 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23107): Launched 04:12:23.118354 run osmo-hlr_10.42.42.2(pid=23108): Launched 04:12:23.241777 run osmo-stp_10.42.42.5: Starting osmo-stp 04:12:23.800320 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23110): Launched 04:12:24.123559 run osmo-stp_10.42.42.5(pid=23111): Launched 04:12:24.247113 run osmo-msc_10.42.42.6: Starting osmo-msc 04:12:24.833574 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23113): Launched 04:12:25.157769 run osmo-msc_10.42.42.6(pid=23114): Launched 04:12:25.338972 run osmo-stp_10.42.42.5(pid=23111): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23111)] 04:12:25.476159 run osmo-stp_10.42.42.5(pid=23111): stdout: | (launched: 2022-12-09_04:12:24.064536) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:12:25.613792 run osmo-stp_10.42.42.5(pid=23111): stderr: | 20221209041224255 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041224256 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041224256 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041224256 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041224259 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041224259 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041224259 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:12:25.750660 run osmo-stp_10.42.42.5(pid=23111): stdout: | (launched: 2022-12-09_04:12:24.064536) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:12:25.879989 run osmo-stp_10.42.42.5(pid=23111): stderr: | 20221209041224255 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041224256 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041224256 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041224256 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041224259 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041224259 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041224259 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:12:26.034785 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23111): Process ended prematurely: osmo-stp_10.42.42.5(pid=23111) [trial-2354↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23111)] [trial-2354↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 04:12:26.044486 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 04:12:26.073450 run osmo-hlr_10.42.42.2(pid=23108): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23108)] 04:12:26.124879 run osmo-hlr_10.42.42.2(pid=23108): stdout: | (launched: 2022-12-09_04:12:23.059574) 04:12:26.178006 run osmo-hlr_10.42.42.2(pid=23108): stderr: | 20221209041223259 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209041223259 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209041223259 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209041223259 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209041223259 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209041223259 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209041223272 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209041223281 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209041223281 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209041223281 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:12:26.251676 run osmo-msc_10.42.42.6(pid=23114): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23114)] 04:12:26.302978 run osmo-msc_10.42.42.6(pid=23114): stdout: | (launched: 2022-12-09_04:12:25.098625) 04:12:26.356027 run osmo-msc_10.42.42.6(pid=23114): stderr: | 20221209041225425 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209041225426 DLGLOBAL DEBUG validating counter group 0x7fa1067b2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209041225426 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209041225426 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209041225426 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209041225426 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209041225428 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209041225428 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209041225428 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209041225428 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:12:26.409922 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23107): Terminating (SIGTERM) 04:12:26.452718 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23110): Terminating (SIGTERM) 04:12:26.495430 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23113): Terminating (SIGTERM) 04:12:26.538384 --- ParallelTerminationStrategy: PID 23107 died... 04:12:26.558617 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23107): Terminated: ok {rc=0} 04:12:26.605973 --- ParallelTerminationStrategy: PID 23110 died... 04:12:26.625948 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23110): Terminated: ok {rc=0} 04:12:26.673237 --- ParallelTerminationStrategy: PID 23113 died... 04:12:26.693172 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23113): Terminated: ok {rc=0} 04:12:26.783467 bus /sierra_3: Setting Powered False 04:12:27.883338 bus /sierra_3: Setting Powered False 04:12:29.001656 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2354 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 04:12:30.152247 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:12:30.164546 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 04:12:30.236045 tst mo_mt_call_osmux.py: using LAC 18986 04:12:30.364491 tst mo_mt_call_osmux.py: using RAC 116 04:12:30.491883 tst mo_mt_call_osmux.py: using CellId 18986 04:12:30.618713 tst mo_mt_call_osmux.py: using BVCI 18987 04:12:30.737952 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:12:30.749444 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:12:30.760671 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:12:30.772198 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:12:30.783734 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:12:30.795268 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 04:12:30.942678 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 04:12:31.089597 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:12:31.582750 run create_hlr_db(pid=23116): Launched 04:12:31.740501 bus /sierra_2: Setting Powered False 04:12:32.804810 run create_hlr_db(pid=23116): Terminated: ok {rc=0} 04:12:33.254617 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23118): Launched 04:12:33.578851 run osmo-hlr_10.42.42.2(pid=23119): Launched 04:12:33.701871 run osmo-stp_10.42.42.5: Starting osmo-stp 04:12:34.260030 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23121): Launched 04:12:34.584390 run osmo-stp_10.42.42.5(pid=23122): Launched 04:12:34.708003 run osmo-msc_10.42.42.6: Starting osmo-msc 04:12:35.292126 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23124): Launched 04:12:35.614790 run osmo-msc_10.42.42.6(pid=23125): Launched 04:12:35.800612 run osmo-stp_10.42.42.5(pid=23122): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23122)] 04:12:35.936772 run osmo-stp_10.42.42.5(pid=23122): stdout: | (launched: 2022-12-09_04:12:34.525214) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:12:36.073505 run osmo-stp_10.42.42.5(pid=23122): stderr: | 20221209041234719 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041234720 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041234720 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041234720 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041234721 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041234721 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041234721 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:12:36.209577 run osmo-stp_10.42.42.5(pid=23122): stdout: | (launched: 2022-12-09_04:12:34.525214) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:12:36.338401 run osmo-stp_10.42.42.5(pid=23122): stderr: | 20221209041234719 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041234720 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041234720 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041234720 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041234721 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041234721 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041234721 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:12:36.493027 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23122): Process ended prematurely: osmo-stp_10.42.42.5(pid=23122) [trial-2354↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23122)] [trial-2354↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 04:12:36.502907 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 04:12:36.532024 run osmo-hlr_10.42.42.2(pid=23119): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23119)] 04:12:36.583003 run osmo-hlr_10.42.42.2(pid=23119): stdout: | (launched: 2022-12-09_04:12:33.520049) 04:12:36.636343 run osmo-hlr_10.42.42.2(pid=23119): stderr: | 20221209041233718 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209041233718 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209041233718 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209041233718 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209041233718 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209041233718 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209041233730 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209041233739 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209041233739 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209041233739 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:12:36.709436 run osmo-msc_10.42.42.6(pid=23125): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23125)] 04:12:36.760101 run osmo-msc_10.42.42.6(pid=23125): stdout: | (launched: 2022-12-09_04:12:35.555900) 04:12:36.812524 run osmo-msc_10.42.42.6(pid=23125): stderr: | 20221209041235883 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209041235883 DLGLOBAL DEBUG validating counter group 0x7f137ad16c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209041235883 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209041235883 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209041235883 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209041235883 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209041235885 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209041235885 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209041235886 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209041235886 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:12:36.865416 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23118): Terminating (SIGTERM) 04:12:36.907835 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23121): Terminating (SIGTERM) 04:12:36.950352 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23124): Terminating (SIGTERM) 04:12:36.993313 --- ParallelTerminationStrategy: PID 23118 died... 04:12:37.013368 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23118): Terminated: ok {rc=0} 04:12:37.060506 --- ParallelTerminationStrategy: PID 23121 died... 04:12:37.080237 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23121): Terminated: ok {rc=0} 04:12:37.127160 --- ParallelTerminationStrategy: PID 23124 died... 04:12:37.147010 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23124): Terminated: ok {rc=0} 04:12:37.235223 bus /sierra_3: Setting Powered False 04:12:38.334437 bus /sierra_3: Setting Powered False 04:12:39.451588 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 04:12:40.703327 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:12:40.710387 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 04:12:40.743545 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 04:12:40.770858 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 04:12:40.823555 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 04:12:40.856551 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 04:12:40.883865 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 04:12:41.436366 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 04:12:41.488734 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:12:41.500226 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 04:12:41.570033 tst mo_mt_call.py: using LAC 18987 04:12:41.698295 tst mo_mt_call.py: using RAC 117 04:12:41.824324 tst mo_mt_call.py: using CellId 18987 04:12:41.950301 tst mo_mt_call.py: using BVCI 18988 04:12:42.067842 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:12:42.079359 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:12:42.090691 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:12:42.102300 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:12:42.113991 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:12:42.125676 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 04:12:42.241944 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 04:12:42.362362 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:12:42.865204 run create_hlr_db(pid=23130): Launched 04:12:42.988747 bus /sierra_2: Setting Powered False 04:12:44.053179 run create_hlr_db(pid=23130): Terminated: ok {rc=0} 04:12:44.503806 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23132): Launched 04:12:44.827311 run osmo-hlr_10.42.42.2(pid=23133): Launched 04:12:44.951163 run osmo-stp_10.42.42.5: Starting osmo-stp 04:12:45.510321 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23135): Launched 04:12:45.843315 run osmo-stp_10.42.42.5(pid=23136): Launched 04:12:46.069875 run osmo-msc_10.42.42.6: Starting osmo-msc 04:12:46.824060 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23138): Launched 04:12:47.159172 run osmo-msc_10.42.42.6(pid=23139): Launched 04:12:47.476057 run osmo-stp_10.42.42.5(pid=23136): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23136)] 04:12:47.606320 run osmo-stp_10.42.42.5(pid=23136): stdout: | (launched: 2022-12-09_04:12:45.775272) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:12:47.732690 run osmo-stp_10.42.42.5(pid=23136): stderr: | 20221209041246082 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041246082 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041246082 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041246084 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041246085 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041246085 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041246085 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:12:47.858948 run osmo-stp_10.42.42.5(pid=23136): stdout: | (launched: 2022-12-09_04:12:45.775272) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:12:47.979403 run osmo-stp_10.42.42.5(pid=23136): stderr: | 20221209041246082 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041246082 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041246082 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041246084 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041246085 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041246085 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041246085 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:12:48.123530 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23136): Process ended prematurely: osmo-stp_10.42.42.5(pid=23136) [trial-2354↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23136)] [trial-2354↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 04:12:48.132785 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 04:12:48.159736 run osmo-hlr_10.42.42.2(pid=23133): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23133)] 04:12:48.208447 run osmo-hlr_10.42.42.2(pid=23133): stdout: | (launched: 2022-12-09_04:12:44.768069) 04:12:48.258670 run osmo-hlr_10.42.42.2(pid=23133): stderr: | 20221209041244966 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209041244966 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209041244966 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209041244967 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209041244967 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209041244967 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209041244979 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209041244987 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209041244987 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209041244987 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:12:48.328591 run osmo-msc_10.42.42.6(pid=23139): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23139)] 04:12:48.377443 run osmo-msc_10.42.42.6(pid=23139): stdout: | (launched: 2022-12-09_04:12:47.088214) 04:12:48.427649 run osmo-msc_10.42.42.6(pid=23139): stderr: | 20221209041247474 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209041247474 DLGLOBAL DEBUG validating counter group 0x7f4c9814ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209041247474 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209041247474 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209041247474 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209041247474 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209041247476 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209041247476 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209041247477 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209041247477 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:12:48.478084 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23132): Terminating (SIGTERM) 04:12:48.518438 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23135): Terminating (SIGTERM) 04:12:48.558820 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23138): Terminating (SIGTERM) 04:12:48.599530 --- ParallelTerminationStrategy: PID 23132 died... 04:12:48.619019 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23132): Terminated: ok {rc=0} 04:12:48.664145 --- ParallelTerminationStrategy: PID 23135 died... 04:12:48.683520 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23135): Terminated: ok {rc=0} 04:12:48.729126 --- ParallelTerminationStrategy: PID 23138 died... 04:12:48.748301 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23138): Terminated: ok {rc=0} 04:12:48.835371 bus /sierra_3: Setting Powered False 04:12:49.937551 bus /sierra_3: Setting Powered False 04:12:51.055829 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2354 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 04:12:52.208431 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:12:52.220704 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 04:12:52.291791 tst mo_mt_call_osmux.py: using LAC 18988 04:12:52.419731 tst mo_mt_call_osmux.py: using RAC 118 04:12:52.551970 tst mo_mt_call_osmux.py: using CellId 18988 04:12:52.670855 tst mo_mt_call_osmux.py: using BVCI 18989 04:12:52.781656 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:12:52.792533 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:12:52.803495 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:12:52.814649 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:12:52.825596 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:12:52.836273 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 04:12:52.955564 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 04:12:53.075838 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:12:53.576817 run create_hlr_db(pid=23141): Launched 04:12:53.702825 bus /sierra_2: Setting Powered False 04:12:54.766801 run create_hlr_db(pid=23141): Terminated: ok {rc=0} 04:12:55.198217 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23143): Launched 04:12:55.499839 run osmo-hlr_10.42.42.2(pid=23144): Launched 04:12:55.616868 run osmo-stp_10.42.42.5: Starting osmo-stp 04:12:56.157190 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23146): Launched 04:12:56.458393 run osmo-stp_10.42.42.5(pid=23147): Launched 04:12:56.574204 run osmo-msc_10.42.42.6: Starting osmo-msc 04:12:57.117892 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23149): Launched 04:12:57.418808 run osmo-msc_10.42.42.6(pid=23150): Launched 04:12:57.588719 run osmo-stp_10.42.42.5(pid=23147): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23147)] 04:12:57.715816 run osmo-stp_10.42.42.5(pid=23147): stdout: | (launched: 2022-12-09_04:12:56.402685) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:12:57.843012 run osmo-stp_10.42.42.5(pid=23147): stderr: | 20221209041256572 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041256572 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041256572 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041256573 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041256575 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041256575 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041256575 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:12:57.968074 run osmo-stp_10.42.42.5(pid=23147): stdout: | (launched: 2022-12-09_04:12:56.402685) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:12:58.087512 run osmo-stp_10.42.42.5(pid=23147): stderr: | 20221209041256572 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041256572 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041256572 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041256573 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041256575 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041256575 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041256575 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:12:58.230937 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23147): Process ended prematurely: osmo-stp_10.42.42.5(pid=23147) [trial-2354↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23147)] [trial-2354↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 04:12:58.239911 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 04:12:58.266667 run osmo-hlr_10.42.42.2(pid=23144): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23144)] 04:12:58.314480 run osmo-hlr_10.42.42.2(pid=23144): stdout: | (launched: 2022-12-09_04:12:55.444479) 04:12:58.364019 run osmo-hlr_10.42.42.2(pid=23144): stderr: | 20221209041255621 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209041255621 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209041255621 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209041255621 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209041255621 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209041255621 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209041255633 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209041255642 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209041255642 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209041255642 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:12:58.433491 run osmo-msc_10.42.42.6(pid=23150): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23150)] 04:12:58.481126 run osmo-msc_10.42.42.6(pid=23150): stdout: | (launched: 2022-12-09_04:12:57.363266) 04:12:58.530255 run osmo-msc_10.42.42.6(pid=23150): stderr: | 20221209041257634 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209041257634 DLGLOBAL DEBUG validating counter group 0x7f5f51607c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209041257634 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209041257634 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209041257635 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209041257635 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209041257636 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209041257637 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209041257637 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209041257637 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:12:58.579745 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23143): Terminating (SIGTERM) 04:12:58.619186 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23146): Terminating (SIGTERM) 04:12:58.658672 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23149): Terminating (SIGTERM) 04:12:58.698784 --- ParallelTerminationStrategy: PID 23143 died... 04:12:58.718091 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23143): Terminated: ok {rc=0} 04:12:58.762833 --- ParallelTerminationStrategy: PID 23146 died... 04:12:58.781640 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23146): Terminated: ok {rc=0} 04:12:58.825751 --- ParallelTerminationStrategy: PID 23149 died... 04:12:58.844391 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23149): Terminated: ok {rc=0} 04:12:58.928075 bus /sierra_3: Setting Powered False 04:13:00.026512 bus /sierra_3: Setting Powered False 04:13:01.147697 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 04:13:02.407460 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:13:02.414686 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 04:13:02.448015 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 04:13:02.475743 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 04:13:02.529180 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 04:13:02.562526 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 04:13:02.589757 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 04:13:03.140490 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 04:13:03.192683 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:13:03.204228 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 04:13:03.274342 tst mo_mt_call.py: using LAC 18989 04:13:03.399983 tst mo_mt_call.py: using RAC 119 04:13:03.526625 tst mo_mt_call.py: using CellId 18989 04:13:03.652271 tst mo_mt_call.py: using BVCI 18990 04:13:03.771077 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:13:03.782607 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:13:03.794004 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:13:03.805727 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:13:03.817432 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:13:03.828853 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:13:03.946105 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:13:04.062162 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:13:04.530221 run create_hlr_db(pid=23155): Launched 04:13:04.654362 bus /sierra_2: Setting Powered False 04:13:05.714534 run create_hlr_db(pid=23155): Terminated: ok {rc=0} 04:13:06.156569 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23157): Launched 04:13:06.482258 run osmo-hlr_10.42.42.2(pid=23158): Launched 04:13:06.606547 run osmo-stp_10.42.42.5: Starting osmo-stp 04:13:07.167985 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23160): Launched 04:13:07.493133 run osmo-stp_10.42.42.5(pid=23161): Launched 04:13:07.616677 run osmo-msc_10.42.42.6: Starting osmo-msc 04:13:08.200931 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23163): Launched 04:13:08.525245 run osmo-msc_10.42.42.6(pid=23164): Launched 04:13:08.706592 run osmo-stp_10.42.42.5(pid=23161): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23161)] 04:13:08.843269 run osmo-stp_10.42.42.5(pid=23161): stdout: | (launched: 2022-12-09_04:13:07.433534) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:13:08.981886 run osmo-stp_10.42.42.5(pid=23161): stderr: | 20221209041307627 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041307627 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041307627 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041307627 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041307628 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041307628 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041307628 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:13:09.119055 run osmo-stp_10.42.42.5(pid=23161): stdout: | (launched: 2022-12-09_04:13:07.433534) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:13:09.248400 run osmo-stp_10.42.42.5(pid=23161): stderr: | 20221209041307627 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041307627 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041307627 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041307627 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041307628 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041307628 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041307628 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:13:09.403522 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23161): Process ended prematurely: osmo-stp_10.42.42.5(pid=23161) [trial-2354↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23161)] [trial-2354↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 04:13:09.413522 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 04:13:09.442300 run osmo-hlr_10.42.42.2(pid=23158): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23158)] 04:13:09.493385 run osmo-hlr_10.42.42.2(pid=23158): stdout: | (launched: 2022-12-09_04:13:06.423105) 04:13:09.546351 run osmo-hlr_10.42.42.2(pid=23158): stderr: | 20221209041306620 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209041306620 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209041306620 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209041306620 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209041306620 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209041306620 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209041306632 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209041306641 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209041306641 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209041306641 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:13:09.620641 run osmo-msc_10.42.42.6(pid=23164): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23164)] 04:13:09.671730 run osmo-msc_10.42.42.6(pid=23164): stdout: | (launched: 2022-12-09_04:13:08.466009) 04:13:09.724468 run osmo-msc_10.42.42.6(pid=23164): stderr: | 20221209041308790 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209041308790 DLGLOBAL DEBUG validating counter group 0x7f1eb6f7cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209041308790 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209041308790 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209041308790 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209041308791 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209041308792 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209041308793 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209041308793 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209041308793 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:13:09.777569 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23157): Terminating (SIGTERM) 04:13:09.820284 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23160): Terminating (SIGTERM) 04:13:09.863068 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23163): Terminating (SIGTERM) 04:13:09.906626 --- ParallelTerminationStrategy: PID 23157 died... 04:13:09.926974 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23157): Terminated: ok {rc=0} 04:13:09.974366 --- ParallelTerminationStrategy: PID 23160 died... 04:13:09.994134 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23160): Terminated: ok {rc=0} 04:13:10.041262 --- ParallelTerminationStrategy: PID 23163 died... 04:13:10.061176 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23163): Terminated: ok {rc=0} 04:13:10.150338 bus /sierra_3: Setting Powered False 04:13:11.250547 bus /sierra_3: Setting Powered False 04:13:12.368496 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2354 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 04:13:13.519833 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:13:13.532131 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 04:13:13.603840 tst mo_mt_call_osmux.py: using LAC 18990 04:13:13.731875 tst mo_mt_call_osmux.py: using RAC 120 04:13:13.851654 tst mo_mt_call_osmux.py: using CellId 18990 04:13:13.969845 tst mo_mt_call_osmux.py: using BVCI 18991 04:13:14.078757 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:13:14.090227 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:13:14.101429 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:13:14.112743 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:13:14.124146 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:13:14.135296 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:13:14.254605 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:13:14.374895 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:13:14.878377 run create_hlr_db(pid=23166): Launched 04:13:15.003155 bus /sierra_2: Setting Powered False 04:13:16.065946 run create_hlr_db(pid=23166): Terminated: ok {rc=0} 04:13:16.533842 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23168): Launched 04:13:16.867150 run osmo-hlr_10.42.42.2(pid=23169): Launched 04:13:17.107991 run osmo-stp_10.42.42.5: Starting osmo-stp 04:13:17.672294 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23171): Launched 04:13:17.996297 run osmo-stp_10.42.42.5(pid=23172): Launched 04:13:18.120523 run osmo-msc_10.42.42.6: Starting osmo-msc 04:13:18.705477 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23174): Launched 04:13:19.030106 run osmo-msc_10.42.42.6(pid=23175): Launched 04:13:19.211342 run osmo-stp_10.42.42.5(pid=23172): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23172)] 04:13:19.348156 run osmo-stp_10.42.42.5(pid=23172): stdout: | (launched: 2022-12-09_04:13:17.937250) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:13:19.486220 run osmo-stp_10.42.42.5(pid=23172): stderr: | 20221209041318131 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041318131 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041318131 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041318132 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041318132 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041318132 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041318132 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:13:19.622728 run osmo-stp_10.42.42.5(pid=23172): stdout: | (launched: 2022-12-09_04:13:17.937250) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:13:19.752435 run osmo-stp_10.42.42.5(pid=23172): stderr: | 20221209041318131 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041318131 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041318131 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041318132 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041318132 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041318132 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041318132 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:13:19.907202 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23172): Process ended prematurely: osmo-stp_10.42.42.5(pid=23172) [trial-2354↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23172)] [trial-2354↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 04:13:19.916785 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 04:13:19.945597 run osmo-hlr_10.42.42.2(pid=23169): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23169)] 04:13:19.996585 run osmo-hlr_10.42.42.2(pid=23169): stdout: | (launched: 2022-12-09_04:13:16.806607) 04:13:20.049117 run osmo-hlr_10.42.42.2(pid=23169): stderr: | 20221209041317102 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209041317102 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209041317102 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209041317102 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209041317102 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209041317102 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209041317115 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209041317124 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209041317124 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209041317124 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:13:20.122579 run osmo-msc_10.42.42.6(pid=23175): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23175)] 04:13:20.173514 run osmo-msc_10.42.42.6(pid=23175): stdout: | (launched: 2022-12-09_04:13:18.970872) 04:13:20.225927 run osmo-msc_10.42.42.6(pid=23175): stderr: | 20221209041319292 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209041319293 DLGLOBAL DEBUG validating counter group 0x7f17b65dbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209041319293 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209041319293 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209041319293 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209041319293 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209041319295 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209041319295 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209041319295 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209041319295 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:13:20.278792 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23168): Terminating (SIGTERM) 04:13:20.321501 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23171): Terminating (SIGTERM) 04:13:20.364160 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23174): Terminating (SIGTERM) 04:13:20.406986 --- ParallelTerminationStrategy: PID 23168 died... 04:13:20.427531 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23168): Terminated: ok {rc=0} 04:13:20.474780 --- ParallelTerminationStrategy: PID 23171 died... 04:13:20.494535 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23171): Terminated: ok {rc=0} 04:13:20.542061 --- ParallelTerminationStrategy: PID 23174 died... 04:13:20.561804 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23174): Terminated: ok {rc=0} 04:13:20.650944 bus /sierra_3: Setting Powered False 04:13:21.750657 bus /sierra_3: Setting Powered False 04:13:22.868576 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 voice:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 04:13:24.117375 tst voice:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:13:24.123051 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 04:13:24.154983 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 04:13:24.181871 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 04:13:24.234091 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 04:13:24.266776 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 04:13:24.293075 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 04:13:24.840448 tst voice:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 04:13:24.889167 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:13:24.900169 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:13:24.969424 tst mo_mt_call.py: using LAC 18991 04:13:25.089467 tst mo_mt_call.py: using RAC 121 04:13:25.217358 tst mo_mt_call.py: using CellId 18991 04:13:25.343343 tst mo_mt_call.py: using BVCI 18992 04:13:25.460841 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:13:25.472306 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:13:25.483788 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:13:25.495262 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:13:25.506662 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:13:25.518038 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 04:13:25.634099 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 04:13:25.748426 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:13:26.218111 run create_hlr_db(pid=23180): Launched 04:13:26.343718 bus /sierra_2: Setting Powered False 04:13:27.405338 run create_hlr_db(pid=23180): Terminated: ok {rc=0} 04:13:27.849442 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23182): Launched 04:13:28.175323 run osmo-hlr_10.42.42.2(pid=23183): Launched 04:13:28.300357 run osmo-stp_10.42.42.5: Starting osmo-stp 04:13:28.855884 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23185): Launched 04:13:29.178340 run osmo-stp_10.42.42.5(pid=23186): Launched 04:13:29.301499 run osmo-msc_10.42.42.6: Starting osmo-msc 04:13:29.886546 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23188): Launched 04:13:30.210923 run osmo-msc_10.42.42.6(pid=23189): Launched 04:13:30.391647 run osmo-stp_10.42.42.5(pid=23186): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23186)] 04:13:30.529130 run osmo-stp_10.42.42.5(pid=23186): stdout: | (launched: 2022-12-09_04:13:29.119605) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:13:30.666478 run osmo-stp_10.42.42.5(pid=23186): stderr: | 20221209041329313 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041329313 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041329314 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041329314 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041329314 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041329315 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041329315 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:13:30.803100 run osmo-stp_10.42.42.5(pid=23186): stdout: | (launched: 2022-12-09_04:13:29.119605) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:13:30.940550 run osmo-stp_10.42.42.5(pid=23186): stderr: | 20221209041329313 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041329313 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041329314 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041329314 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041329314 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041329315 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041329315 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:13:31.102830 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23186): Process ended prematurely: osmo-stp_10.42.42.5(pid=23186) [trial-2354↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23186)] [trial-2354↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 04:13:31.113391 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 04:13:31.145450 run osmo-hlr_10.42.42.2(pid=23183): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23183)] 04:13:31.199390 run osmo-hlr_10.42.42.2(pid=23183): stdout: | (launched: 2022-12-09_04:13:28.116009) 04:13:31.255013 run osmo-hlr_10.42.42.2(pid=23183): stderr: | 20221209041328314 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209041328314 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209041328314 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209041328314 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209041328314 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209041328314 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209041328327 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209041328337 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209041328338 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209041328338 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:13:31.332108 run osmo-msc_10.42.42.6(pid=23189): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23189)] 04:13:31.386405 run osmo-msc_10.42.42.6(pid=23189): stdout: | (launched: 2022-12-09_04:13:30.151685) 04:13:31.442157 run osmo-msc_10.42.42.6(pid=23189): stderr: | 20221209041330475 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209041330475 DLGLOBAL DEBUG validating counter group 0x7feb238a9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209041330476 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209041330476 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209041330476 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209041330476 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209041330478 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209041330478 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209041330478 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209041330478 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:13:31.498204 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23182): Terminating (SIGTERM) 04:13:31.543613 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23185): Terminating (SIGTERM) 04:13:31.590253 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23188): Terminating (SIGTERM) 04:13:31.635681 --- ParallelTerminationStrategy: PID 23182 died... 04:13:31.656472 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23182): Terminated: ok {rc=0} 04:13:31.708293 --- ParallelTerminationStrategy: PID 23185 died... 04:13:31.729324 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23185): Terminated: ok {rc=0} 04:13:31.779802 --- ParallelTerminationStrategy: PID 23188 died... 04:13:31.800754 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23188): Terminated: ok {rc=0} 04:13:31.896178 bus /sierra_3: Setting Powered False 04:13:32.998542 bus /sierra_3: Setting Powered False 04:13:34.115155 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2354 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 04:13:35.264812 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:13:35.276920 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:13:35.348479 tst mo_mt_call_osmux.py: using LAC 18992 04:13:35.477762 tst mo_mt_call_osmux.py: using RAC 122 04:13:35.610919 tst mo_mt_call_osmux.py: using CellId 18992 04:13:35.737266 tst mo_mt_call_osmux.py: using BVCI 18993 04:13:35.854828 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:13:35.866389 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:13:35.877649 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:13:35.889123 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:13:35.900340 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:13:35.911802 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 04:13:36.028375 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 04:13:36.149419 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:13:36.652059 run create_hlr_db(pid=23191): Launched 04:13:36.775705 bus /sierra_2: Setting Powered False 04:13:37.840541 run create_hlr_db(pid=23191): Terminated: ok {rc=0} 04:13:38.273496 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23193): Launched 04:13:38.574707 run osmo-hlr_10.42.42.2(pid=23194): Launched 04:13:38.690003 run osmo-stp_10.42.42.5: Starting osmo-stp 04:13:39.220038 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23196): Launched 04:13:39.521935 run osmo-stp_10.42.42.5(pid=23197): Launched 04:13:39.637575 run osmo-msc_10.42.42.6: Starting osmo-msc 04:13:40.189778 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23199): Launched 04:13:40.491660 run osmo-msc_10.42.42.6(pid=23200): Launched 04:13:40.660683 run osmo-stp_10.42.42.5(pid=23197): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23197)] 04:13:40.788231 run osmo-stp_10.42.42.5(pid=23197): stdout: | (launched: 2022-12-09_04:13:39.466514) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:13:40.915557 run osmo-stp_10.42.42.5(pid=23197): stderr: | 20221209041339637 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041339638 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041339638 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041339638 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041339639 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041339639 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041339639 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:13:41.041615 run osmo-stp_10.42.42.5(pid=23197): stdout: | (launched: 2022-12-09_04:13:39.466514) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:13:41.161957 run osmo-stp_10.42.42.5(pid=23197): stderr: | 20221209041339637 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041339638 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041339638 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041339638 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041339639 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041339639 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041339639 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:13:41.306176 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23197): Process ended prematurely: osmo-stp_10.42.42.5(pid=23197) [trial-2354↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23197)] [trial-2354↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 04:13:41.315177 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 04:13:41.342173 run osmo-hlr_10.42.42.2(pid=23194): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23194)] 04:13:41.390321 run osmo-hlr_10.42.42.2(pid=23194): stdout: | (launched: 2022-12-09_04:13:38.519201) 04:13:41.440229 run osmo-hlr_10.42.42.2(pid=23194): stderr: | 20221209041338694 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209041338694 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209041338694 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209041338694 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209041338694 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209041338694 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209041338707 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209041338717 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209041338718 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209041338718 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:13:41.510040 run osmo-msc_10.42.42.6(pid=23200): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23200)] 04:13:41.558273 run osmo-msc_10.42.42.6(pid=23200): stdout: | (launched: 2022-12-09_04:13:40.435984) 04:13:41.608212 run osmo-msc_10.42.42.6(pid=23200): stderr: | 20221209041340709 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209041340709 DLGLOBAL DEBUG validating counter group 0x7fb2f46f0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209041340709 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209041340709 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209041340710 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209041340711 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209041340712 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209041340713 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209041340713 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209041340713 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:13:41.658406 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23193): Terminating (SIGTERM) 04:13:41.698386 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23196): Terminating (SIGTERM) 04:13:41.738278 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23199): Terminating (SIGTERM) 04:13:41.778531 --- ParallelTerminationStrategy: PID 23193 died... 04:13:41.797738 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23193): Terminated: ok {rc=0} 04:13:41.842009 --- ParallelTerminationStrategy: PID 23196 died... 04:13:41.860480 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23196): Terminated: ok {rc=0} 04:13:41.905333 --- ParallelTerminationStrategy: PID 23199 died... 04:13:41.924164 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23199): Terminated: ok {rc=0} 04:13:42.007819 bus /sierra_3: Setting Powered False 04:13:43.106732 bus /sierra_3: Setting Powered False 04:13:44.224604 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 voice:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 04:13:45.477194 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:13:45.483948 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 04:13:45.517575 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 04:13:45.545147 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 04:13:45.599385 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 04:13:45.634167 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 04:13:45.661392 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 04:13:46.225202 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 04:13:46.292787 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 04:13:46.307773 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 04:13:46.367181 tst mo_mt_call.py: using LAC 18993 04:13:46.521812 tst mo_mt_call.py: using RAC 123 04:13:46.654056 tst mo_mt_call.py: using CellId 18993 04:13:46.824660 tst mo_mt_call.py: using BVCI 18994 04:13:46.940184 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 04:13:46.952618 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 04:13:46.964768 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 04:13:46.977573 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 04:13:46.990141 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 04:13:47.002660 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 04:13:47.122339 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 04:13:47.240718 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:13:47.709657 run create_hlr_db(pid=23205): Launched 04:13:47.832551 bus /sierra_2: Setting Powered False 04:13:48.893378 run create_hlr_db(pid=23205): Terminated: ok {rc=0} 04:13:49.333475 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23207): Launched 04:13:49.658239 run osmo-hlr_10.42.42.2(pid=23208): Launched 04:13:49.783139 run osmo-stp_10.42.42.5: Starting osmo-stp 04:13:50.339854 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23210): Launched 04:13:50.663888 run osmo-stp_10.42.42.5(pid=23211): Launched 04:13:50.787484 run osmo-msc_10.42.42.6: Starting osmo-msc 04:13:51.371720 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23213): Launched 04:13:51.695757 run osmo-msc_10.42.42.6(pid=23214): Launched 04:13:51.875762 run osmo-stp_10.42.42.5(pid=23211): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23211)] 04:13:52.013028 run osmo-stp_10.42.42.5(pid=23211): stdout: | (launched: 2022-12-09_04:13:50.604579) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:13:52.150294 run osmo-stp_10.42.42.5(pid=23211): stderr: | 20221209041350796 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041350797 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041350797 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041350797 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041350798 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041350798 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041350798 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:13:52.286772 run osmo-stp_10.42.42.5(pid=23211): stdout: | (launched: 2022-12-09_04:13:50.604579) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:13:52.416354 run osmo-stp_10.42.42.5(pid=23211): stderr: | 20221209041350796 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041350797 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041350797 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041350797 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041350798 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041350798 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041350798 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:13:52.571699 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23211): Process ended prematurely: osmo-stp_10.42.42.5(pid=23211) [trial-2354↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23211)] [trial-2354↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 04:13:52.581317 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 04:13:52.609737 run osmo-hlr_10.42.42.2(pid=23208): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23208)] 04:13:52.660703 run osmo-hlr_10.42.42.2(pid=23208): stdout: | (launched: 2022-12-09_04:13:49.599295) 04:13:52.713455 run osmo-hlr_10.42.42.2(pid=23208): stderr: | 20221209041349795 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209041349796 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209041349796 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209041349796 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209041349796 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209041349796 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209041349808 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209041349816 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209041349816 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209041349816 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:13:52.786867 run osmo-msc_10.42.42.6(pid=23214): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23214)] 04:13:52.837524 run osmo-msc_10.42.42.6(pid=23214): stdout: | (launched: 2022-12-09_04:13:51.636319) 04:13:52.889765 run osmo-msc_10.42.42.6(pid=23214): stderr: | 20221209041351960 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209041351960 DLGLOBAL DEBUG validating counter group 0x7f86a519fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209041351960 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209041351960 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209041351960 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209041351961 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209041351962 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209041351963 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209041351963 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209041351963 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:13:52.942491 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23207): Terminating (SIGTERM) 04:13:52.984713 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23210): Terminating (SIGTERM) 04:13:53.027154 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23213): Terminating (SIGTERM) 04:13:53.069827 --- ParallelTerminationStrategy: PID 23207 died... 04:13:53.090056 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23207): Terminated: ok {rc=0} 04:13:53.137315 --- ParallelTerminationStrategy: PID 23210 died... 04:13:53.157077 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23210): Terminated: ok {rc=0} 04:13:53.204071 --- ParallelTerminationStrategy: PID 23213 died... 04:13:53.223795 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23213): Terminated: ok {rc=0} 04:13:53.313526 bus /sierra_3: Setting Powered False 04:13:54.414001 bus /sierra_3: Setting Powered False 04:13:55.531559 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2354 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 04:13:56.674924 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 04:13:56.686869 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 04:13:56.739526 tst mo_mt_call_osmux.py: using LAC 18994 04:13:56.858097 tst mo_mt_call_osmux.py: using RAC 124 04:13:56.978480 tst mo_mt_call_osmux.py: using CellId 18994 04:13:57.097242 tst mo_mt_call_osmux.py: using BVCI 18995 04:13:57.206546 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 04:13:57.217914 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 04:13:57.228802 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 04:13:57.239947 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 04:13:57.251155 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 04:13:57.262305 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 04:13:57.381265 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 04:13:57.500744 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:13:57.968356 run create_hlr_db(pid=23216): Launched 04:13:58.092904 bus /sierra_2: Setting Powered False 04:13:59.153864 run create_hlr_db(pid=23216): Terminated: ok {rc=0} 04:13:59.596907 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23218): Launched 04:13:59.921604 run osmo-hlr_10.42.42.2(pid=23219): Launched 04:14:00.045604 run osmo-stp_10.42.42.5: Starting osmo-stp 04:14:00.606722 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23221): Launched 04:14:00.963541 run osmo-stp_10.42.42.5(pid=23222): Launched 04:14:01.186308 run osmo-msc_10.42.42.6: Starting osmo-msc 04:14:01.944604 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23224): Launched 04:14:02.272142 run osmo-msc_10.42.42.6(pid=23225): Launched 04:14:02.491333 run osmo-stp_10.42.42.5(pid=23222): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23222)] 04:14:02.628744 run osmo-stp_10.42.42.5(pid=23222): stdout: | (launched: 2022-12-09_04:14:00.883705) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:14:02.766738 run osmo-stp_10.42.42.5(pid=23222): stderr: | 20221209041401188 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041401188 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041401191 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041401193 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041401195 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041401195 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041401195 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:14:02.903250 run osmo-stp_10.42.42.5(pid=23222): stdout: | (launched: 2022-12-09_04:14:00.883705) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:14:03.032281 run osmo-stp_10.42.42.5(pid=23222): stderr: | 20221209041401188 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041401188 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041401191 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041401193 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041401195 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041401195 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041401195 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:14:03.187307 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23222): Process ended prematurely: osmo-stp_10.42.42.5(pid=23222) [trial-2354↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23222)] [trial-2354↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 04:14:03.196852 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 04:14:03.225515 run osmo-hlr_10.42.42.2(pid=23219): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23219)] 04:14:03.276722 run osmo-hlr_10.42.42.2(pid=23219): stdout: | (launched: 2022-12-09_04:13:59.862508) 04:14:03.329939 run osmo-hlr_10.42.42.2(pid=23219): stderr: | 20221209041400063 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209041400064 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209041400064 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209041400064 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209041400064 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209041400064 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209041400076 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209041400084 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209041400084 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209041400085 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:14:03.403513 run osmo-msc_10.42.42.6(pid=23225): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23225)] 04:14:03.454987 run osmo-msc_10.42.42.6(pid=23225): stdout: | (launched: 2022-12-09_04:14:02.208740) 04:14:03.507832 run osmo-msc_10.42.42.6(pid=23225): stderr: | 20221209041402570 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209041402571 DLGLOBAL DEBUG validating counter group 0x7f1fa56dec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209041402571 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209041402571 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209041402571 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209041402571 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209041402573 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209041402573 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209041402574 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209041402574 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:14:03.561246 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23218): Terminating (SIGTERM) 04:14:03.603685 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23221): Terminating (SIGTERM) 04:14:03.646276 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23224): Terminating (SIGTERM) 04:14:03.689130 --- ParallelTerminationStrategy: PID 23218 died... 04:14:03.709390 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23218): Terminated: ok {rc=0} 04:14:03.756780 --- ParallelTerminationStrategy: PID 23221 died... 04:14:03.776718 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23221): Terminated: ok {rc=0} 04:14:03.823758 --- ParallelTerminationStrategy: PID 23224 died... 04:14:03.843592 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23224): Terminated: ok {rc=0} 04:14:03.933070 bus /sierra_3: Setting Powered False 04:14:05.032745 bus /sierra_3: Setting Powered False 04:14:06.150502 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 emergency:trx-umtrx --------------------------------------------------------------------- 04:14:07.396484 tst emergency:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:14:07.400752 tst emergency:trx-umtrx: Verifying 1 x bts (candidates: 11) 04:14:07.432473 tst emergency:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 04:14:07.458938 tst emergency:trx-umtrx: Verifying 4 x modem (candidates: 12) 04:14:07.542379 tst emergency:trx-umtrx: Reserving 1 x bts (candidates: 11) 04:14:07.574183 tst emergency:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 04:14:07.600592 tst emergency:trx-umtrx: Reserving 4 x modem (candidates: 12) 04:14:08.183266 tst emergency:trx-umtrx: RESERVED RESOURCES for emergency: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2354 emergency:trx-umtrx emergency_mo_mt_call.py ---------------------------------------------- 04:14:08.188150 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 04:14:08.198801 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 04:14:08.247025 tst emergency_mo_mt_call.py: using LAC 18995 04:14:08.364851 tst emergency_mo_mt_call.py: using RAC 125 04:14:08.480582 tst emergency_mo_mt_call.py: using CellId 18995 04:14:08.596243 tst emergency_mo_mt_call.py: using BVCI 18996 04:14:08.703103 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 04:14:08.713751 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 04:14:08.724024 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 04:14:08.734522 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 04:14:08.744807 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 04:14:08.755225 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 04:14:08.871914 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 04:14:08.988853 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:14:09.449674 run create_hlr_db(pid=23230): Launched 04:14:09.571722 bus /sierra_2: Setting Powered False 04:14:10.630823 run create_hlr_db(pid=23230): Terminated: ok {rc=0} 04:14:11.045024 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23232): Launched 04:14:11.341700 run osmo-hlr_10.42.42.2(pid=23233): Launched 04:14:11.455028 run osmo-stp_10.42.42.5: Starting osmo-stp 04:14:11.964272 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23235): Launched 04:14:12.261907 run osmo-stp_10.42.42.5(pid=23236): Launched 04:14:12.385119 tst emergency_mo_mt_call.py: using MSISDN 7020 04:14:12.536810 run osmo-msc_10.42.42.6: Starting osmo-msc 04:14:13.071608 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23238): Launched 04:14:13.395375 run osmo-msc_10.42.42.6(pid=23239): Launched 04:14:13.574809 run osmo-stp_10.42.42.5(pid=23236): ERR: Terminated: ERROR {rc=1} [trial-2354↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23236)] 04:14:13.710851 run osmo-stp_10.42.42.5(pid=23236): stdout: | (launched: 2022-12-09_04:14:12.207077) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:14:13.846654 run osmo-stp_10.42.42.5(pid=23236): stderr: | 20221209041412378 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041412378 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041412378 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041412379 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041412381 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041412381 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041412381 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:14:13.981766 run osmo-stp_10.42.42.5(pid=23236): stdout: | (launched: 2022-12-09_04:14:12.207077) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:14:14.108807 run osmo-stp_10.42.42.5(pid=23236): stderr: | 20221209041412378 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041412378 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041412378 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041412379 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041412381 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041412381 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041412381 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:14:14.260637 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=23236): Process ended prematurely: osmo-stp_10.42.42.5(pid=23236) [trial-2354↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23236)] [trial-2354↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19] 04:14:14.269672 tst emergency_mo_mt_call.py:19: Test FAILED (6.1 sec) 04:14:14.297801 run osmo-hlr_10.42.42.2(pid=23233): ERR: Terminated: ERROR {rc=237} [trial-2354↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23233)] 04:14:14.348596 run osmo-hlr_10.42.42.2(pid=23233): stdout: | (launched: 2022-12-09_04:14:11.287106) 04:14:14.401103 run osmo-hlr_10.42.42.2(pid=23233): stderr: | 20221209041411463 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209041411463 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209041411463 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209041411464 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209041411464 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209041411464 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209041411477 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/emergency:trx-umtrx/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209041411485 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209041411486 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209041411486 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:14:14.474594 run osmo-msc_10.42.42.6(pid=23239): ERR: Terminated: ERROR {rc=2} [trial-2354↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23239)] 04:14:14.525381 run osmo-msc_10.42.42.6(pid=23239): stdout: | (launched: 2022-12-09_04:14:13.337323) 04:14:14.577744 run osmo-msc_10.42.42.6(pid=23239): stderr: | 20221209041413658 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209041413659 DLGLOBAL DEBUG validating counter group 0x7f8b82468c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209041413659 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209041413659 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209041413659 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209041413659 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209041413661 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209041413661 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209041413662 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209041413662 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:14:14.630598 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23232): Terminating (SIGTERM) 04:14:14.673366 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23235): Terminating (SIGTERM) 04:14:14.716005 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23238): Terminating (SIGTERM) 04:14:14.758772 --- ParallelTerminationStrategy: PID 23232 died... 04:14:14.778964 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23232): Terminated: ok {rc=0} 04:14:14.826259 --- ParallelTerminationStrategy: PID 23235 died... 04:14:14.846164 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23235): Terminated: ok {rc=0} 04:14:14.893102 --- ParallelTerminationStrategy: PID 23238 died... 04:14:14.912839 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23238): Terminated: ok {rc=0} 04:14:15.002862 bus /sierra_3: Setting Powered False 04:14:16.100611 bus /sierra_3: Setting Powered False 04:14:17.219827 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2354 emergency:trx-umtrx emergency_preemptive_call.py ---------------------------------------------- 04:14:18.307764 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 04:14:18.319171 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 04:14:18.369712 tst emergency_preemptive_call.py: using LAC 18996 04:14:18.488188 tst emergency_preemptive_call.py: using RAC 126 04:14:18.606962 tst emergency_preemptive_call.py: using CellId 18996 04:14:18.725815 tst emergency_preemptive_call.py: using BVCI 18997 04:14:18.833375 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 04:14:18.843853 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 04:14:18.854375 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 04:14:18.864736 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 04:14:18.875170 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 04:14:18.885512 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 04:14:19.001612 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 04:14:19.121239 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 04:14:19.238573 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 04:14:19.355989 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:14:19.819073 run create_hlr_db(pid=23241): Launched 04:14:19.940712 bus /sierra_2: Setting Powered False 04:14:20.999314 run create_hlr_db(pid=23241): Terminated: ok {rc=0} 04:14:21.414611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23243): Launched 04:14:21.711641 run osmo-hlr_10.42.42.2(pid=23244): Launched 04:14:21.824425 run osmo-stp_10.42.42.5: Starting osmo-stp 04:14:22.335462 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23246): Launched 04:14:22.631214 run osmo-stp_10.42.42.5(pid=23247): Launched 04:14:22.754560 tst emergency_preemptive_call.py: using MSISDN 7021 04:14:22.905342 run osmo-msc_10.42.42.6: Starting osmo-msc 04:14:23.436669 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23249): Launched 04:14:23.733024 run osmo-msc_10.42.42.6(pid=23250): Launched 04:14:23.899326 run osmo-stp_10.42.42.5(pid=23247): ERR: Terminated: ERROR {rc=1} [trial-2354↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23247)] 04:14:24.025415 run osmo-stp_10.42.42.5(pid=23247): stdout: | (launched: 2022-12-09_04:14:22.576406) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:14:24.151844 run osmo-stp_10.42.42.5(pid=23247): stderr: | 20221209041422749 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041422749 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041422749 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041422750 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041422750 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041422750 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041422750 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:14:24.276454 run osmo-stp_10.42.42.5(pid=23247): stdout: | (launched: 2022-12-09_04:14:22.576406) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:14:24.394484 run osmo-stp_10.42.42.5(pid=23247): stderr: | 20221209041422749 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041422749 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041422749 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041422750 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041422750 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041422750 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041422750 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:14:24.535286 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=23247): Process ended prematurely: osmo-stp_10.42.42.5(pid=23247) [trial-2354↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23247)] [trial-2354↪emergency:trx-umtrx↪emergency_preemptive_call.py:32] 04:14:24.543603 tst emergency_preemptive_call.py:32: Test FAILED (6.2 sec) 04:14:24.569990 run osmo-hlr_10.42.42.2(pid=23244): ERR: Terminated: ERROR {rc=237} [trial-2354↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23244)] 04:14:24.618251 run osmo-hlr_10.42.42.2(pid=23244): stdout: | (launched: 2022-12-09_04:14:21.657261) 04:14:24.668079 run osmo-hlr_10.42.42.2(pid=23244): stderr: | 20221209041421835 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209041421835 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209041421835 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209041421835 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209041421835 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209041421835 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209041421847 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/emergency:trx-umtrx/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209041421856 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209041421856 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209041421856 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:14:24.737807 run osmo-msc_10.42.42.6(pid=23250): ERR: Terminated: ERROR {rc=2} [trial-2354↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23250)] 04:14:24.785772 run osmo-msc_10.42.42.6(pid=23250): stdout: | (launched: 2022-12-09_04:14:23.678443) 04:14:24.835667 run osmo-msc_10.42.42.6(pid=23250): stderr: | 20221209041423948 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209041423948 DLGLOBAL DEBUG validating counter group 0x7fde3ef17c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209041423948 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209041423948 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209041423948 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209041423948 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209041423950 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209041423951 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209041423951 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209041423951 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:14:24.885487 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23243): Terminating (SIGTERM) 04:14:24.925472 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23246): Terminating (SIGTERM) 04:14:24.965441 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23249): Terminating (SIGTERM) 04:14:25.005753 --- ParallelTerminationStrategy: PID 23243 died... 04:14:25.025220 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23243): Terminated: ok {rc=0} 04:14:25.069636 --- ParallelTerminationStrategy: PID 23246 died... 04:14:25.088373 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23246): Terminated: ok {rc=0} 04:14:25.132678 --- ParallelTerminationStrategy: PID 23249 died... 04:14:25.151411 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23249): Terminated: ok {rc=0} 04:14:25.238682 bus /sierra_9: Setting Powered False 04:14:26.339357 bus /sierra_9: Setting Powered False 04:14:27.456657 bus /sierra_8: Setting Powered False 04:14:28.556875 bus /sierra_8: Setting Powered False 04:14:29.673576 bus /sierra_3: Setting Powered False 04:14:30.772796 bus /sierra_3: Setting Powered False 04:14:31.897888 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 emergency:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 gprs:trx-umtrx --------------------------------------------------------------------- 04:14:33.180801 tst gprs:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:14:33.185477 tst gprs:trx-umtrx: Verifying 1 x bts (candidates: 11) 04:14:33.219073 tst gprs:trx-umtrx: Verifying 9 x ip_address (candidates: 9) 04:14:33.258208 tst gprs:trx-umtrx: Verifying 4 x modem (candidates: 12) 04:14:33.351093 tst gprs:trx-umtrx: Reserving 1 x bts (candidates: 11) 04:14:33.384515 tst gprs:trx-umtrx: Reserving 9 x ip_address (candidates: 9) 04:14:33.423956 tst gprs:trx-umtrx: Reserving 4 x modem (candidates: 12) 04:14:34.008192 tst gprs:trx-umtrx: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2354 gprs:trx-umtrx cs_paging_gprs_active.py ---------------------------------------------- 04:14:34.061659 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:14:34.072531 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 04:14:34.120658 tst cs_paging_gprs_active.py: using LAC 18997 04:14:34.245386 tst cs_paging_gprs_active.py: using RAC 127 04:14:34.375719 tst cs_paging_gprs_active.py: using CellId 18997 04:14:34.501270 tst cs_paging_gprs_active.py: using BVCI 18998 04:14:34.619358 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:14:34.630453 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:14:34.641194 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:14:34.652237 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:14:34.663163 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:14:34.674150 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:14:34.685322 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:14:34.696189 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:14:34.707358 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 04:14:34.828310 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 04:14:34.947415 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 04:14:35.167983 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:14:35.493941 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23257): Launched 04:14:35.776099 run iperf3-srv_10.42.42.10(pid=23258): Launched 04:14:35.898294 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 04:14:36.117215 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:14:36.442256 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23259): Launched 04:14:36.725076 run iperf3-srv_10.42.42.10(pid=23260): Launched 04:14:36.846768 tst cs_paging_gprs_active.py:38: start network... 04:14:37.065250 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:14:37.568134 run create_hlr_db(pid=23261): Launched 04:14:37.691912 bus /sierra_2: Setting Powered False 04:14:38.755992 run create_hlr_db(pid=23261): Terminated: ok {rc=0} 04:14:39.208077 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23263): Launched 04:14:39.532335 run osmo-hlr_10.42.42.2(pid=23264): Launched 04:14:39.657266 run osmo-stp_10.42.42.5: Starting osmo-stp 04:14:40.215294 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23266): Launched 04:14:40.539852 run osmo-stp_10.42.42.5(pid=23267): Launched 04:14:40.664193 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:14:41.220776 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23269): Launched 04:14:41.344269 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:14:41.617438 run patchelf(pid=23270): Launched 04:14:41.797874 run osmo-stp_10.42.42.5(pid=23267): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23267)] 04:14:41.935290 run osmo-stp_10.42.42.5(pid=23267): stdout: | (launched: 2022-12-09_04:14:40.480784) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:14:42.074391 run osmo-stp_10.42.42.5(pid=23267): stderr: | 20221209041440672 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041440672 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041440672 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041440672 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041440673 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041440673 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041440673 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:14:42.213434 run osmo-stp_10.42.42.5(pid=23267): stdout: | (launched: 2022-12-09_04:14:40.480784) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:14:42.346652 run osmo-stp_10.42.42.5(pid=23267): stderr: | 20221209041440672 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041440672 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041440672 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041440672 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041440673 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041440673 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041440673 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:14:42.504827 run patchelf(pid=23270): Terminating (SIGINT) 04:14:42.687615 run patchelf(pid=23270): Terminated: ok {rc=0} 04:14:42.819548 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=23267): Process ended prematurely: osmo-stp_10.42.42.5(pid=23267) [trial-2354↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23267)] [trial-2354↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38] 04:14:42.829641 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 04:14:42.858991 run osmo-hlr_10.42.42.2(pid=23264): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-umtrx↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23264)] 04:14:42.909462 run osmo-hlr_10.42.42.2(pid=23264): stdout: | (launched: 2022-12-09_04:14:39.473391) 04:14:42.961908 run osmo-hlr_10.42.42.2(pid=23264): stderr: | 20221209041439670 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209041439670 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209041439670 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209041439670 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209041439670 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209041439670 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209041439682 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-umtrx/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209041439690 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209041439690 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209041439691 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:14:43.014639 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23257): Terminating (SIGTERM) 04:14:43.056900 run iperf3-srv_10.42.42.10(pid=23258): Terminating (SIGTERM) 04:14:43.099133 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23259): Terminating (SIGTERM) 04:14:43.141399 run iperf3-srv_10.42.42.10(pid=23260): Terminating (SIGTERM) 04:14:43.183319 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23263): Terminating (SIGTERM) 04:14:43.225526 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23266): Terminating (SIGTERM) 04:14:43.267698 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23269): Terminating (SIGTERM) 04:14:43.310389 --- ParallelTerminationStrategy: PID 23257 died... 04:14:43.330503 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23257): Terminated: ok {rc=0} 04:14:43.377527 --- ParallelTerminationStrategy: PID 23258 died... 04:14:43.397180 run iperf3-srv_10.42.42.10(pid=23258): Terminated {rc=256} 04:14:43.443907 --- ParallelTerminationStrategy: PID 23259 died... 04:14:43.463875 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23259): Terminated: ok {rc=0} 04:14:43.511104 --- ParallelTerminationStrategy: PID 23260 died... 04:14:43.530814 run iperf3-srv_10.42.42.10(pid=23260): Terminated {rc=256} 04:14:43.577776 --- ParallelTerminationStrategy: PID 23263 died... 04:14:43.597502 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23263): Terminated: ok {rc=0} 04:14:43.644441 --- ParallelTerminationStrategy: PID 23266 died... 04:14:43.664393 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23266): Terminated: ok {rc=0} 04:14:43.711492 --- ParallelTerminationStrategy: PID 23269 died... 04:14:43.731650 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23269): Terminated: ok {rc=0} 04:14:43.819779 bus /gobi_0: Setting Powered False 04:14:44.919823 bus /gobi_0: Setting Powered False 04:14:46.039208 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:trx-umtrx iperf3.py ---------------------------------------------- 04:14:47.188458 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:14:47.200231 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 04:14:47.250248 tst iperf3.py: using LAC 18998 04:14:47.370222 tst iperf3.py: using RAC 128 04:14:47.491409 tst iperf3.py: using CellId 18998 04:14:47.612414 tst iperf3.py: using BVCI 18999 04:14:47.721718 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:14:47.732261 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:14:47.742881 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:14:47.753149 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:14:47.763215 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:14:47.773384 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:14:47.783705 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:14:47.793983 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:14:47.804434 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 04:14:47.921897 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 04:14:48.124750 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:14:48.427364 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23271): Launched 04:14:48.693268 run iperf3-srv_10.42.42.10(pid=23272): Launched 04:14:48.807093 tst iperf3.py:8: start network... 04:14:49.008556 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:14:49.474980 run create_hlr_db(pid=23273): Launched 04:14:49.599424 bus /gobi_6: Setting Powered False 04:14:50.659744 run create_hlr_db(pid=23273): Terminated: ok {rc=0} 04:14:51.102178 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23275): Launched 04:14:51.427836 run osmo-hlr_10.42.42.2(pid=23276): Launched 04:14:51.553066 run osmo-stp_10.42.42.5: Starting osmo-stp 04:14:52.114822 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23278): Launched 04:14:52.437701 run osmo-stp_10.42.42.5(pid=23279): Launched 04:14:52.562227 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:14:53.121201 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23281): Launched 04:14:53.245446 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:14:53.519702 run patchelf(pid=23282): Launched 04:14:53.700682 run osmo-stp_10.42.42.5(pid=23279): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23279)] 04:14:53.838471 run osmo-stp_10.42.42.5(pid=23279): stdout: | (launched: 2022-12-09_04:14:52.378932) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:14:53.977873 run osmo-stp_10.42.42.5(pid=23279): stderr: | 20221209041452570 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041452570 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041452571 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041452571 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041452571 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041452572 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041452572 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:14:54.117840 run osmo-stp_10.42.42.5(pid=23279): stdout: | (launched: 2022-12-09_04:14:52.378932) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:14:54.251358 run osmo-stp_10.42.42.5(pid=23279): stderr: | 20221209041452570 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041452570 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041452571 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041452571 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041452571 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041452572 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041452572 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:14:54.410094 run patchelf(pid=23282): Terminating (SIGINT) 04:14:54.593181 run patchelf(pid=23282): Terminated: ok {rc=0} 04:14:54.724797 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23279): Process ended prematurely: osmo-stp_10.42.42.5(pid=23279) [trial-2354↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23279)] [trial-2354↪gprs:trx-umtrx↪iperf3.py:8] 04:14:54.734948 tst iperf3.py:8: Test FAILED (7.6 sec) 04:14:54.764240 run osmo-hlr_10.42.42.2(pid=23276): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-umtrx↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23276)] 04:14:54.815365 run osmo-hlr_10.42.42.2(pid=23276): stdout: | (launched: 2022-12-09_04:14:51.368705) 04:14:54.868166 run osmo-hlr_10.42.42.2(pid=23276): stderr: | 20221209041451567 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209041451567 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209041451567 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209041451567 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209041451567 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209041451567 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209041451579 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-umtrx/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209041451587 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209041451587 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209041451587 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:14:54.921483 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23271): Terminating (SIGTERM) 04:14:54.964306 run iperf3-srv_10.42.42.10(pid=23272): Terminating (SIGTERM) 04:14:55.007148 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23275): Terminating (SIGTERM) 04:14:55.049933 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23278): Terminating (SIGTERM) 04:14:55.092631 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23281): Terminating (SIGTERM) 04:14:55.135772 --- ParallelTerminationStrategy: PID 23271 died... 04:14:55.156184 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23271): Terminated: ok {rc=0} 04:14:55.203676 --- ParallelTerminationStrategy: PID 23272 died... 04:14:55.223481 run iperf3-srv_10.42.42.10(pid=23272): Terminated {rc=256} 04:14:55.270702 --- ParallelTerminationStrategy: PID 23275 died... 04:14:55.290569 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23275): Terminated: ok {rc=0} 04:14:55.337763 --- ParallelTerminationStrategy: PID 23278 died... 04:14:55.357587 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23278): Terminated: ok {rc=0} 04:14:55.404819 --- ParallelTerminationStrategy: PID 23281 died... 04:14:55.425037 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23281): Terminated: ok {rc=0} 04:14:55.514082 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:trx-umtrx iperf3m4.py ---------------------------------------------- 04:14:56.661877 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:14:56.674116 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 04:14:56.722323 tst iperf3m4.py: using LAC 18999 04:14:56.840812 tst iperf3m4.py: using RAC 129 04:14:56.959886 tst iperf3m4.py: using CellId 18999 04:14:57.080442 tst iperf3m4.py: using BVCI 19000 04:14:57.190034 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:14:57.200705 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:14:57.211238 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:14:57.222422 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:14:57.233469 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:14:57.244451 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:14:57.255644 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:14:57.266741 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:14:57.278025 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 04:14:57.395830 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 04:14:57.519348 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 04:14:57.637559 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 04:14:57.756892 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 04:14:57.977935 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:14:58.304562 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23283): Launched 04:14:58.588693 run iperf3-srv_10.42.42.10(pid=23284): Launched 04:14:58.711100 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 04:14:58.929783 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:14:59.255193 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23285): Launched 04:14:59.538259 run iperf3-srv_10.42.42.10(pid=23286): Launched 04:14:59.660840 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 04:14:59.879161 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:15:00.204687 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23287): Launched 04:15:00.487984 run iperf3-srv_10.42.42.10(pid=23288): Launched 04:15:00.610535 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 04:15:00.831000 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:15:01.177071 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23289): Launched 04:15:01.504910 run iperf3-srv_10.42.42.10(pid=23293): Launched 04:15:01.643107 tst iperf3m4.py:8: start network... 04:15:01.866711 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:15:02.377651 run create_hlr_db(pid=23294): Launched 04:15:02.503026 bus /gobi_6: Setting Powered False 04:15:03.567096 run create_hlr_db(pid=23294): Terminated: ok {rc=0} 04:15:03.998161 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23296): Launched 04:15:04.299276 run osmo-hlr_10.42.42.2(pid=23297): Launched 04:15:04.414880 run osmo-stp_10.42.42.5: Starting osmo-stp 04:15:04.935823 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23299): Launched 04:15:05.238163 run osmo-stp_10.42.42.5(pid=23300): Launched 04:15:05.354136 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:15:05.874410 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23302): Launched 04:15:05.989683 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:15:06.244500 run patchelf(pid=23303): Launched 04:15:06.412535 run osmo-stp_10.42.42.5(pid=23300): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23300)] 04:15:06.540543 run osmo-stp_10.42.42.5(pid=23300): stdout: | (launched: 2022-12-09_04:15:05.182694) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:15:06.670008 run osmo-stp_10.42.42.5(pid=23300): stderr: | 20221209041505351 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041505351 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041505351 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041505351 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041505352 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041505352 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041505352 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:15:06.799344 run osmo-stp_10.42.42.5(pid=23300): stdout: | (launched: 2022-12-09_04:15:05.182694) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:15:06.922820 run osmo-stp_10.42.42.5(pid=23300): stderr: | 20221209041505351 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041505351 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041505351 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041505351 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041505352 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041505352 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041505352 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:15:07.069294 run patchelf(pid=23303): Terminating (SIGINT) 04:15:07.239404 run patchelf(pid=23303): Terminated: ok {rc=0} 04:15:07.361936 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23300): Process ended prematurely: osmo-stp_10.42.42.5(pid=23300) [trial-2354↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23300)] [trial-2354↪gprs:trx-umtrx↪iperf3m4.py:8] 04:15:07.371266 tst iperf3m4.py:8: Test FAILED (10.7 sec) 04:15:07.398530 run osmo-hlr_10.42.42.2(pid=23297): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-umtrx↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23297)] 04:15:07.445988 run osmo-hlr_10.42.42.2(pid=23297): stdout: | (launched: 2022-12-09_04:15:04.243997) 04:15:07.495135 run osmo-hlr_10.42.42.2(pid=23297): stderr: | 20221209041504418 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209041504418 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209041504418 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209041504418 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209041504418 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209041504418 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209041504430 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-umtrx/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209041504439 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209041504439 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209041504439 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:15:07.545426 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23283): Terminating (SIGTERM) 04:15:07.585162 run iperf3-srv_10.42.42.10(pid=23284): Terminating (SIGTERM) 04:15:07.624757 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23285): Terminating (SIGTERM) 04:15:07.664342 run iperf3-srv_10.42.42.10(pid=23286): Terminating (SIGTERM) 04:15:07.704013 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23287): Terminating (SIGTERM) 04:15:07.743764 run iperf3-srv_10.42.42.10(pid=23288): Terminating (SIGTERM) 04:15:07.783292 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23289): Terminating (SIGTERM) 04:15:07.822995 run iperf3-srv_10.42.42.10(pid=23293): Terminating (SIGTERM) 04:15:07.862417 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23296): Terminating (SIGTERM) 04:15:07.902146 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23299): Terminating (SIGTERM) 04:15:07.941662 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23302): Terminating (SIGTERM) 04:15:07.981517 --- ParallelTerminationStrategy: PID 23283 died... 04:15:08.000603 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23283): Terminated: ok {rc=0} 04:15:08.044768 --- ParallelTerminationStrategy: PID 23284 died... 04:15:08.063474 run iperf3-srv_10.42.42.10(pid=23284): Terminated {rc=256} 04:15:08.107553 --- ParallelTerminationStrategy: PID 23285 died... 04:15:08.126308 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23285): Terminated: ok {rc=0} 04:15:08.170256 --- ParallelTerminationStrategy: PID 23286 died... 04:15:08.188738 run iperf3-srv_10.42.42.10(pid=23286): Terminated {rc=256} 04:15:08.232637 --- ParallelTerminationStrategy: PID 23287 died... 04:15:08.251341 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23287): Terminated: ok {rc=0} 04:15:08.295425 --- ParallelTerminationStrategy: PID 23288 died... 04:15:08.314106 run iperf3-srv_10.42.42.10(pid=23288): Terminated {rc=256} 04:15:08.358551 --- ParallelTerminationStrategy: PID 23289 died... 04:15:08.377173 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23289): Terminated: ok {rc=0} 04:15:08.421517 --- ParallelTerminationStrategy: PID 23293 died... 04:15:08.440089 run iperf3-srv_10.42.42.10(pid=23293): Terminated {rc=256} 04:15:08.483935 --- ParallelTerminationStrategy: PID 23296 died... 04:15:08.502618 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23296): Terminated: ok {rc=0} 04:15:08.546426 --- ParallelTerminationStrategy: PID 23299 died... 04:15:08.565701 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23299): Terminated: ok {rc=0} 04:15:08.609962 --- ParallelTerminationStrategy: PID 23302 died... 04:15:08.628651 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23302): Terminated: ok {rc=0} 04:15:08.714796 bus /gobi_4: Setting Powered False 04:15:09.814822 bus /gobi_4: Setting Powered False 04:15:10.931926 bus /gobi_1: Setting Powered False 04:15:12.031620 bus /gobi_1: Setting Powered False 04:15:13.147335 bus /gobi_0: Setting Powered False 04:15:14.245859 bus /gobi_0: Setting Powered False 04:15:15.360912 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:trx-umtrx ping.py ---------------------------------------------- 04:15:16.473958 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:15:16.491640 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 04:15:16.553416 tst ping.py: using LAC 19000 04:15:16.674885 tst ping.py: using RAC 130 04:15:16.800186 tst ping.py: using CellId 19000 04:15:16.960227 tst ping.py: using BVCI 19001 04:15:17.079135 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:15:17.092035 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:15:17.103977 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:15:17.116123 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:15:17.130620 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:15:17.142679 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:15:17.155228 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:15:17.168375 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 04:15:17.289812 tst ping.py:19: start network... 04:15:17.486789 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:15:17.943015 run create_hlr_db(pid=23304): Launched 04:15:18.063686 bus /gobi_6: Setting Powered False 04:15:19.123072 run create_hlr_db(pid=23304): Terminated: ok {rc=0} 04:15:19.534614 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23306): Launched 04:15:19.829271 run osmo-hlr_10.42.42.2(pid=23307): Launched 04:15:19.941423 run osmo-stp_10.42.42.5: Starting osmo-stp 04:15:20.450252 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23309): Launched 04:15:20.745960 run osmo-stp_10.42.42.5(pid=23310): Launched 04:15:20.858495 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:15:21.366766 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23312): Launched 04:15:21.479461 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:15:21.728537 run patchelf(pid=23313): Launched 04:15:21.894006 run osmo-stp_10.42.42.5(pid=23310): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23310)] 04:15:22.018931 run osmo-stp_10.42.42.5(pid=23310): stdout: | (launched: 2022-12-09_04:15:20.691665) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:15:22.145681 run osmo-stp_10.42.42.5(pid=23310): stderr: | 20221209041520859 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041520859 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041520860 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041520860 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041520861 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041520861 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041520861 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:15:22.272506 run osmo-stp_10.42.42.5(pid=23310): stdout: | (launched: 2022-12-09_04:15:20.691665) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:15:22.393813 run osmo-stp_10.42.42.5(pid=23310): stderr: | 20221209041520859 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041520859 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041520860 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041520860 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041520861 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041520861 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041520861 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:15:22.537937 run patchelf(pid=23313): Terminating (SIGINT) 04:15:22.706515 run patchelf(pid=23313): Terminated: ok {rc=0} 04:15:22.826936 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=23310): Process ended prematurely: osmo-stp_10.42.42.5(pid=23310) [trial-2354↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23310)] [trial-2354↪gprs:trx-umtrx↪ping.py:22] 04:15:22.835611 tst ping.py:22: Test FAILED (6.4 sec) 04:15:22.862437 run osmo-hlr_10.42.42.2(pid=23307): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-umtrx↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23307)] 04:15:22.909975 run osmo-hlr_10.42.42.2(pid=23307): stdout: | (launched: 2022-12-09_04:15:19.774881) 04:15:22.959352 run osmo-hlr_10.42.42.2(pid=23307): stderr: | 20221209041519951 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209041519951 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209041519951 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209041519951 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209041519952 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209041519952 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209041519967 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-umtrx/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209041519976 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209041519977 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209041519977 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:15:23.009215 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23306): Terminating (SIGTERM) 04:15:23.048675 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23309): Terminating (SIGTERM) 04:15:23.088392 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23312): Terminating (SIGTERM) 04:15:23.128269 --- ParallelTerminationStrategy: PID 23306 died... 04:15:23.147293 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23306): Terminated: ok {rc=0} 04:15:23.191138 --- ParallelTerminationStrategy: PID 23309 died... 04:15:23.209917 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23309): Terminated: ok {rc=0} 04:15:23.253737 --- ParallelTerminationStrategy: PID 23312 died... 04:15:23.272323 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23312): Terminated: ok {rc=0} 04:15:23.355562 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:trx-umtrx ping_idle_ping.py ---------------------------------------------- 04:15:24.442814 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:15:24.454824 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 04:15:24.506454 tst ping_idle_ping.py: using LAC 19001 04:15:24.629519 tst ping_idle_ping.py: using RAC 131 04:15:24.746993 tst ping_idle_ping.py: using CellId 19001 04:15:24.863747 tst ping_idle_ping.py: using BVCI 19002 04:15:24.971163 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:15:24.981708 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:15:24.992027 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:15:25.002366 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:15:25.012591 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:15:25.022848 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:15:25.033271 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:15:25.043552 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 04:15:25.161174 tst ping_idle_ping.py:24: start network... 04:15:25.376530 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:15:25.872518 run create_hlr_db(pid=23314): Launched 04:15:25.994055 bus /gobi_6: Setting Powered False 04:15:27.053648 run create_hlr_db(pid=23314): Terminated: ok {rc=0} 04:15:27.477044 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23316): Launched 04:15:27.773365 run osmo-hlr_10.42.42.2(pid=23317): Launched 04:15:27.887178 run osmo-stp_10.42.42.5: Starting osmo-stp 04:15:28.398293 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23319): Launched 04:15:28.695020 run osmo-stp_10.42.42.5(pid=23320): Launched 04:15:28.809151 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:15:29.320045 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23322): Launched 04:15:29.434458 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:15:29.686172 run patchelf(pid=23323): Launched 04:15:29.851155 run osmo-stp_10.42.42.5(pid=23320): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23320)] 04:15:29.976363 run osmo-stp_10.42.42.5(pid=23320): stdout: | (launched: 2022-12-09_04:15:28.640484) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:15:30.103141 run osmo-stp_10.42.42.5(pid=23320): stderr: | 20221209041528809 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041528809 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041528809 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041528810 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041528810 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041528810 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041528810 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:15:30.230335 run osmo-stp_10.42.42.5(pid=23320): stdout: | (launched: 2022-12-09_04:15:28.640484) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:15:30.351615 run osmo-stp_10.42.42.5(pid=23320): stderr: | 20221209041528809 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041528809 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041528809 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041528810 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041528810 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041528810 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041528810 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:15:30.495283 run patchelf(pid=23323): Terminating (SIGINT) 04:15:30.662569 run patchelf(pid=23323): Terminated: ok {rc=0} 04:15:30.783500 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=23320): Process ended prematurely: osmo-stp_10.42.42.5(pid=23320) [trial-2354↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23320)] [trial-2354↪gprs:trx-umtrx↪ping_idle_ping.py:27] 04:15:30.792220 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 04:15:30.819035 run osmo-hlr_10.42.42.2(pid=23317): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-umtrx↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23317)] 04:15:30.867472 run osmo-hlr_10.42.42.2(pid=23317): stdout: | (launched: 2022-12-09_04:15:27.718720) 04:15:30.923327 run osmo-hlr_10.42.42.2(pid=23317): stderr: | 20221209041527894 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209041527894 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209041527894 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209041527894 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209041527894 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209041527894 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209041527906 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-umtrx/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209041527917 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209041527917 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209041527917 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:15:30.974782 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23316): Terminating (SIGTERM) 04:15:31.015999 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23319): Terminating (SIGTERM) 04:15:31.059288 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23322): Terminating (SIGTERM) 04:15:31.102205 --- ParallelTerminationStrategy: PID 23316 died... 04:15:31.122348 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23316): Terminated: ok {rc=0} 04:15:31.168082 --- ParallelTerminationStrategy: PID 23319 died... 04:15:31.187581 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23319): Terminated: ok {rc=0} 04:15:31.232495 --- ParallelTerminationStrategy: PID 23322 died... 04:15:31.251956 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23322): Terminated: ok {rc=0} 04:15:31.342549 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2354 gprs:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 gprs:trx-umtrx+mod-bts0-egprs --------------------------------------------------------------------- 04:15:32.645603 tst gprs:trx-umtrx+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:15:32.650719 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 04:15:32.682404 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 04:15:32.720157 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 04:15:32.805633 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 04:15:32.837605 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 04:15:32.875657 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 04:15:33.466233 tst gprs:trx-umtrx+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2354 gprs:trx-umtrx+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 04:15:33.514591 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:15:33.525446 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:15:33.574647 tst cs_paging_gprs_active.py: using LAC 19002 04:15:33.695742 tst cs_paging_gprs_active.py: using RAC 132 04:15:33.816325 tst cs_paging_gprs_active.py: using CellId 19002 04:15:33.937156 tst cs_paging_gprs_active.py: using BVCI 19003 04:15:34.048027 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:15:34.058845 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:15:34.069401 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:15:34.079952 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:15:34.090538 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:15:34.100924 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:15:34.111574 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:15:34.122045 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:15:34.132641 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:15:34.251301 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:15:34.367124 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 04:15:34.570818 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:15:34.875384 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23327): Launched 04:15:35.138258 run iperf3-srv_10.42.42.10(pid=23328): Launched 04:15:35.251260 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 04:15:35.452568 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:15:35.754835 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23329): Launched 04:15:36.021758 run iperf3-srv_10.42.42.10(pid=23330): Launched 04:15:36.144390 tst cs_paging_gprs_active.py:38: start network... 04:15:36.363689 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:15:36.868705 run create_hlr_db(pid=23331): Launched 04:15:36.993466 bus /gobi_6: Setting Powered False 04:15:38.057881 run create_hlr_db(pid=23331): Terminated: ok {rc=0} 04:15:38.509321 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23333): Launched 04:15:38.833831 run osmo-hlr_10.42.42.2(pid=23334): Launched 04:15:38.958364 run osmo-stp_10.42.42.5: Starting osmo-stp 04:15:39.517662 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23336): Launched 04:15:39.842248 run osmo-stp_10.42.42.5(pid=23337): Launched 04:15:39.967771 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:15:40.527401 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23339): Launched 04:15:40.651697 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:15:40.925763 run patchelf(pid=23340): Launched 04:15:41.106380 run osmo-stp_10.42.42.5(pid=23337): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23337)] 04:15:41.243725 run osmo-stp_10.42.42.5(pid=23337): stdout: | (launched: 2022-12-09_04:15:39.783267) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:15:41.382719 run osmo-stp_10.42.42.5(pid=23337): stderr: | 20221209041539975 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041539975 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041539975 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041539976 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041539976 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041539976 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041539976 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:15:41.522237 run osmo-stp_10.42.42.5(pid=23337): stdout: | (launched: 2022-12-09_04:15:39.783267) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:15:41.655737 run osmo-stp_10.42.42.5(pid=23337): stderr: | 20221209041539975 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041539975 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041539975 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041539976 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041539976 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041539976 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041539976 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:15:41.813671 run patchelf(pid=23340): Terminating (SIGINT) 04:15:41.996813 run patchelf(pid=23340): Terminated: ok {rc=0} 04:15:42.128942 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=23337): Process ended prematurely: osmo-stp_10.42.42.5(pid=23337) [trial-2354↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23337)] [trial-2354↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 04:15:42.139051 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 04:15:42.168614 run osmo-hlr_10.42.42.2(pid=23334): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23334)] 04:15:42.219407 run osmo-hlr_10.42.42.2(pid=23334): stdout: | (launched: 2022-12-09_04:15:38.774523) 04:15:42.271690 run osmo-hlr_10.42.42.2(pid=23334): stderr: | 20221209041538973 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209041538973 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209041538973 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209041538973 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209041538973 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209041538973 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209041538986 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-umtrx+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209041538994 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209041538994 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209041538994 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:15:42.324687 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23327): Terminating (SIGTERM) 04:15:42.367037 run iperf3-srv_10.42.42.10(pid=23328): Terminating (SIGTERM) 04:15:42.409395 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23329): Terminating (SIGTERM) 04:15:42.451780 run iperf3-srv_10.42.42.10(pid=23330): Terminating (SIGTERM) 04:15:42.494323 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23333): Terminating (SIGTERM) 04:15:42.536848 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23336): Terminating (SIGTERM) 04:15:42.579262 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23339): Terminating (SIGTERM) 04:15:42.621978 --- ParallelTerminationStrategy: PID 23327 died... 04:15:42.642148 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23327): Terminated: ok {rc=0} 04:15:42.689143 --- ParallelTerminationStrategy: PID 23328 died... 04:15:42.708719 run iperf3-srv_10.42.42.10(pid=23328): Terminated {rc=256} 04:15:42.755543 --- ParallelTerminationStrategy: PID 23329 died... 04:15:42.775212 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23329): Terminated: ok {rc=0} 04:15:42.822037 --- ParallelTerminationStrategy: PID 23330 died... 04:15:42.841812 run iperf3-srv_10.42.42.10(pid=23330): Terminated {rc=256} 04:15:42.888538 --- ParallelTerminationStrategy: PID 23333 died... 04:15:42.908357 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23333): Terminated: ok {rc=0} 04:15:42.955100 --- ParallelTerminationStrategy: PID 23336 died... 04:15:42.974802 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23336): Terminated: ok {rc=0} 04:15:43.022074 --- ParallelTerminationStrategy: PID 23339 died... 04:15:43.041833 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23339): Terminated: ok {rc=0} 04:15:43.131126 bus /gobi_0: Setting Powered False 04:15:44.230718 bus /gobi_0: Setting Powered False 04:15:45.347169 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:trx-umtrx+mod-bts0-egprs iperf3.py ---------------------------------------------- 04:15:46.501279 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:15:46.517322 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:15:46.580763 tst iperf3.py: using LAC 19003 04:15:46.753132 tst iperf3.py: using RAC 133 04:15:46.882086 tst iperf3.py: using CellId 19003 04:15:47.015826 tst iperf3.py: using BVCI 19004 04:15:47.137285 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:15:47.149680 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:15:47.161741 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:15:47.174521 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:15:47.188692 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:15:47.201789 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:15:47.214931 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:15:47.227990 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:15:47.240520 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:15:47.364681 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 04:15:47.578546 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:15:47.881267 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23341): Launched 04:15:48.144151 run iperf3-srv_10.42.42.10(pid=23342): Launched 04:15:48.257307 tst iperf3.py:8: start network... 04:15:48.458274 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:15:48.924152 run create_hlr_db(pid=23343): Launched 04:15:49.047651 bus /gobi_6: Setting Powered False 04:15:50.107899 run create_hlr_db(pid=23343): Terminated: ok {rc=0} 04:15:50.548682 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23345): Launched 04:15:50.873600 run osmo-hlr_10.42.42.2(pid=23346): Launched 04:15:50.998106 run osmo-stp_10.42.42.5: Starting osmo-stp 04:15:51.565006 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23348): Launched 04:15:51.888546 run osmo-stp_10.42.42.5(pid=23349): Launched 04:15:52.011916 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:15:52.568489 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23351): Launched 04:15:52.692264 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:15:52.965944 run patchelf(pid=23352): Launched 04:15:53.145623 run osmo-stp_10.42.42.5(pid=23349): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23349)] 04:15:53.282057 run osmo-stp_10.42.42.5(pid=23349): stdout: | (launched: 2022-12-09_04:15:51.829523) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:15:53.420619 run osmo-stp_10.42.42.5(pid=23349): stderr: | 20221209041552021 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041552021 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041552021 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041552022 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041552022 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041552022 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041552022 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:15:53.559583 run osmo-stp_10.42.42.5(pid=23349): stdout: | (launched: 2022-12-09_04:15:51.829523) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:15:53.691994 run osmo-stp_10.42.42.5(pid=23349): stderr: | 20221209041552021 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041552021 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041552021 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041552022 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041552022 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041552022 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041552022 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:15:53.849425 run patchelf(pid=23352): Terminating (SIGINT) 04:15:54.030744 run patchelf(pid=23352): Terminated: ok {rc=0} 04:15:54.161623 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23349): Process ended prematurely: osmo-stp_10.42.42.5(pid=23349) [trial-2354↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23349)] [trial-2354↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8] 04:15:54.171710 tst iperf3.py:8: Test FAILED (7.7 sec) 04:15:54.201157 run osmo-hlr_10.42.42.2(pid=23346): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23346)] 04:15:54.251724 run osmo-hlr_10.42.42.2(pid=23346): stdout: | (launched: 2022-12-09_04:15:50.814622) 04:15:54.304264 run osmo-hlr_10.42.42.2(pid=23346): stderr: | 20221209041551014 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209041551014 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209041551014 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209041551014 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209041551014 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209041551014 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209041551025 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-umtrx+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209041551033 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209041551034 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209041551034 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:15:54.357223 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23341): Terminating (SIGTERM) 04:15:54.399483 run iperf3-srv_10.42.42.10(pid=23342): Terminating (SIGTERM) 04:15:54.441610 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23345): Terminating (SIGTERM) 04:15:54.483618 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23348): Terminating (SIGTERM) 04:15:54.526010 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23351): Terminating (SIGTERM) 04:15:54.568482 --- ParallelTerminationStrategy: PID 23341 died... 04:15:54.588380 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23341): Terminated: ok {rc=0} 04:15:54.635267 --- ParallelTerminationStrategy: PID 23342 died... 04:15:54.654905 run iperf3-srv_10.42.42.10(pid=23342): Terminated {rc=256} 04:15:54.701460 --- ParallelTerminationStrategy: PID 23345 died... 04:15:54.721091 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23345): Terminated: ok {rc=0} 04:15:54.767628 --- ParallelTerminationStrategy: PID 23348 died... 04:15:54.787259 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23348): Terminated: ok {rc=0} 04:15:54.834134 --- ParallelTerminationStrategy: PID 23351 died... 04:15:54.853841 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23351): Terminated: ok {rc=0} 04:15:54.942532 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:trx-umtrx+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 04:15:56.084895 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:15:56.096241 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:15:56.148888 tst iperf3m4.py: using LAC 19004 04:15:56.266411 tst iperf3m4.py: using RAC 134 04:15:56.384749 tst iperf3m4.py: using CellId 19004 04:15:56.501484 tst iperf3m4.py: using BVCI 19005 04:15:56.621266 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:15:56.632483 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:15:56.643533 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:15:56.655248 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:15:56.666982 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:15:56.678731 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:15:56.690705 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:15:56.702316 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:15:56.714345 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:15:56.832603 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:15:56.952708 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:15:57.072223 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:15:57.188588 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 04:15:57.390537 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:15:57.693541 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23354): Launched 04:15:57.955705 run iperf3-srv_10.42.42.10(pid=23355): Launched 04:15:58.068875 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 04:15:58.269989 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:15:58.571921 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23356): Launched 04:15:58.835041 run iperf3-srv_10.42.42.10(pid=23357): Launched 04:15:58.948871 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 04:15:59.151173 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:15:59.454014 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23358): Launched 04:15:59.717063 run iperf3-srv_10.42.42.10(pid=23359): Launched 04:15:59.830631 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 04:16:00.031917 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:16:00.334838 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23360): Launched 04:16:00.598368 run iperf3-srv_10.42.42.10(pid=23361): Launched 04:16:00.711811 tst iperf3m4.py:8: start network... 04:16:00.931641 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:16:01.420075 run create_hlr_db(pid=23362): Launched 04:16:01.574342 bus /gobi_6: Setting Powered False 04:16:02.634462 run create_hlr_db(pid=23362): Terminated: ok {rc=0} 04:16:03.076349 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23364): Launched 04:16:03.400689 run osmo-hlr_10.42.42.2(pid=23365): Launched 04:16:03.525285 run osmo-stp_10.42.42.5: Starting osmo-stp 04:16:04.085286 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23367): Launched 04:16:04.410216 run osmo-stp_10.42.42.5(pid=23368): Launched 04:16:04.534747 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:16:05.094938 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23370): Launched 04:16:05.220050 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:16:05.495156 run patchelf(pid=23371): Launched 04:16:05.677190 run osmo-stp_10.42.42.5(pid=23368): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23368)] 04:16:05.815074 run osmo-stp_10.42.42.5(pid=23368): stdout: | (launched: 2022-12-09_04:16:04.351029) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:16:05.955117 run osmo-stp_10.42.42.5(pid=23368): stderr: | 20221209041604540 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041604540 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041604540 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041604541 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041604541 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041604541 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041604541 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:16:06.094937 run osmo-stp_10.42.42.5(pid=23368): stdout: | (launched: 2022-12-09_04:16:04.351029) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:16:06.228802 run osmo-stp_10.42.42.5(pid=23368): stderr: | 20221209041604540 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041604540 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041604540 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041604541 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041604541 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041604541 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041604541 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:16:06.387548 run patchelf(pid=23371): Terminating (SIGINT) 04:16:06.571373 run patchelf(pid=23371): Terminated: ok {rc=0} 04:16:06.703649 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23368): Process ended prematurely: osmo-stp_10.42.42.5(pid=23368) [trial-2354↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23368)] [trial-2354↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8] 04:16:06.713860 tst iperf3m4.py:8: Test FAILED (10.7 sec) 04:16:06.743586 run osmo-hlr_10.42.42.2(pid=23365): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23365)] 04:16:06.794640 run osmo-hlr_10.42.42.2(pid=23365): stdout: | (launched: 2022-12-09_04:16:03.341698) 04:16:06.847616 run osmo-hlr_10.42.42.2(pid=23365): stderr: | 20221209041603538 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209041603538 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209041603538 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209041603538 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209041603538 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209041603538 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209041603550 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-umtrx+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209041603558 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209041603558 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209041603559 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:16:06.900535 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23354): Terminating (SIGTERM) 04:16:06.942934 run iperf3-srv_10.42.42.10(pid=23355): Terminating (SIGTERM) 04:16:06.985490 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23356): Terminating (SIGTERM) 04:16:07.028017 run iperf3-srv_10.42.42.10(pid=23357): Terminating (SIGTERM) 04:16:07.070778 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23358): Terminating (SIGTERM) 04:16:07.113384 run iperf3-srv_10.42.42.10(pid=23359): Terminating (SIGTERM) 04:16:07.155613 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23360): Terminating (SIGTERM) 04:16:07.197868 run iperf3-srv_10.42.42.10(pid=23361): Terminating (SIGTERM) 04:16:07.240162 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23364): Terminating (SIGTERM) 04:16:07.282692 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23367): Terminating (SIGTERM) 04:16:07.325146 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23370): Terminating (SIGTERM) 04:16:07.367862 --- ParallelTerminationStrategy: PID 23354 died... 04:16:07.387854 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23354): Terminated: ok {rc=0} 04:16:07.435134 --- ParallelTerminationStrategy: PID 23355 died... 04:16:07.454858 run iperf3-srv_10.42.42.10(pid=23355): Terminated {rc=256} 04:16:07.502322 --- ParallelTerminationStrategy: PID 23356 died... 04:16:07.522011 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23356): Terminated: ok {rc=0} 04:16:07.569312 --- ParallelTerminationStrategy: PID 23357 died... 04:16:07.588852 run iperf3-srv_10.42.42.10(pid=23357): Terminated {rc=256} 04:16:07.635994 --- ParallelTerminationStrategy: PID 23358 died... 04:16:07.655729 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23358): Terminated: ok {rc=0} 04:16:07.702925 --- ParallelTerminationStrategy: PID 23359 died... 04:16:07.722718 run iperf3-srv_10.42.42.10(pid=23359): Terminated {rc=256} 04:16:07.769517 --- ParallelTerminationStrategy: PID 23360 died... 04:16:07.789335 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23360): Terminated: ok {rc=0} 04:16:07.836317 --- ParallelTerminationStrategy: PID 23361 died... 04:16:07.856172 run iperf3-srv_10.42.42.10(pid=23361): Terminated {rc=256} 04:16:07.903225 --- ParallelTerminationStrategy: PID 23364 died... 04:16:07.923058 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23364): Terminated: ok {rc=0} 04:16:07.970389 --- ParallelTerminationStrategy: PID 23367 died... 04:16:07.990338 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23367): Terminated: ok {rc=0} 04:16:08.037690 --- ParallelTerminationStrategy: PID 23370 died... 04:16:08.057410 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23370): Terminated: ok {rc=0} 04:16:08.146797 bus /gobi_4: Setting Powered False 04:16:09.246389 bus /gobi_4: Setting Powered False 04:16:10.363640 bus /gobi_1: Setting Powered False 04:16:11.463240 bus /gobi_1: Setting Powered False 04:16:12.580104 bus /gobi_0: Setting Powered False 04:16:13.678983 bus /gobi_0: Setting Powered False 04:16:14.796983 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:trx-umtrx+mod-bts0-egprs ping.py ---------------------------------------------- 04:16:15.909398 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:16:15.922186 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:16:15.980409 tst ping.py: using LAC 19005 04:16:16.103483 tst ping.py: using RAC 135 04:16:16.222303 tst ping.py: using CellId 19005 04:16:16.341174 tst ping.py: using BVCI 19006 04:16:16.460360 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:16:16.472080 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:16:16.484297 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:16:16.495332 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:16:16.506859 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:16:16.518237 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:16:16.530111 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:16:16.541627 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:16:16.656364 tst ping.py:19: start network... 04:16:16.865564 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:16:17.435852 run create_hlr_db(pid=23372): Launched 04:16:17.560392 bus /gobi_6: Setting Powered False 04:16:18.620064 run create_hlr_db(pid=23372): Terminated: ok {rc=0} 04:16:19.055883 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23374): Launched 04:16:19.375344 run osmo-hlr_10.42.42.2(pid=23375): Launched 04:16:19.497935 run osmo-stp_10.42.42.5: Starting osmo-stp 04:16:20.050201 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23377): Launched 04:16:20.367233 run osmo-stp_10.42.42.5(pid=23378): Launched 04:16:20.488272 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:16:21.035793 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23380): Launched 04:16:21.158240 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:16:21.427026 run patchelf(pid=23381): Launched 04:16:21.606116 run osmo-stp_10.42.42.5(pid=23378): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23378)] 04:16:21.741422 run osmo-stp_10.42.42.5(pid=23378): stdout: | (launched: 2022-12-09_04:16:20.309478) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:16:21.878650 run osmo-stp_10.42.42.5(pid=23378): stderr: | 20221209041620501 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041620501 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041620501 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041620501 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041620502 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041620502 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041620502 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:16:22.016038 run osmo-stp_10.42.42.5(pid=23378): stdout: | (launched: 2022-12-09_04:16:20.309478) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:16:22.147483 run osmo-stp_10.42.42.5(pid=23378): stderr: | 20221209041620501 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041620501 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041620501 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041620501 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041620502 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041620502 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041620502 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:16:22.303239 run patchelf(pid=23381): Terminating (SIGINT) 04:16:22.482945 run patchelf(pid=23381): Terminated: ok {rc=0} 04:16:22.612776 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=23378): Process ended prematurely: osmo-stp_10.42.42.5(pid=23378) [trial-2354↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23378)] [trial-2354↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22] 04:16:22.622657 tst ping.py:22: Test FAILED (6.7 sec) 04:16:22.651254 run osmo-hlr_10.42.42.2(pid=23375): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23375)] 04:16:22.702211 run osmo-hlr_10.42.42.2(pid=23375): stdout: | (launched: 2022-12-09_04:16:19.317197) 04:16:22.754813 run osmo-hlr_10.42.42.2(pid=23375): stderr: | 20221209041619513 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209041619513 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209041619514 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209041619514 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209041619514 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209041619514 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209041619525 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-umtrx+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209041619534 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209041619534 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209041619534 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:16:22.808035 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23374): Terminating (SIGTERM) 04:16:22.851607 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23377): Terminating (SIGTERM) 04:16:22.893852 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23380): Terminating (SIGTERM) 04:16:22.936243 --- ParallelTerminationStrategy: PID 23374 died... 04:16:22.956122 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23374): Terminated: ok {rc=0} 04:16:23.002605 --- ParallelTerminationStrategy: PID 23377 died... 04:16:23.022348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23377): Terminated: ok {rc=0} 04:16:23.068747 --- ParallelTerminationStrategy: PID 23380 died... 04:16:23.088773 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23380): Terminated: ok {rc=0} 04:16:23.177894 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:trx-umtrx+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 04:16:24.265726 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:16:24.277646 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:16:24.329352 tst ping_idle_ping.py: using LAC 19006 04:16:24.461893 tst ping_idle_ping.py: using RAC 136 04:16:24.596038 tst ping_idle_ping.py: using CellId 19006 04:16:24.720681 tst ping_idle_ping.py: using BVCI 19007 04:16:24.836543 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:16:24.847980 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:16:24.859243 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:16:24.870693 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:16:24.882046 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:16:24.893847 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:16:24.905451 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:16:24.916883 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:16:25.032540 tst ping_idle_ping.py:24: start network... 04:16:25.234194 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:16:25.698721 run create_hlr_db(pid=23382): Launched 04:16:25.821645 bus /gobi_6: Setting Powered False 04:16:26.882473 run create_hlr_db(pid=23382): Terminated: ok {rc=0} 04:16:27.299657 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23384): Launched 04:16:27.599095 run osmo-hlr_10.42.42.2(pid=23385): Launched 04:16:27.713425 run osmo-stp_10.42.42.5: Starting osmo-stp 04:16:28.225416 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23387): Launched 04:16:28.523559 run osmo-stp_10.42.42.5(pid=23388): Launched 04:16:28.637673 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:16:29.151976 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23390): Launched 04:16:29.267446 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:16:29.519204 run patchelf(pid=23391): Launched 04:16:29.686072 run osmo-stp_10.42.42.5(pid=23388): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23388)] 04:16:29.812574 run osmo-stp_10.42.42.5(pid=23388): stdout: | (launched: 2022-12-09_04:16:28.468632) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:16:29.940646 run osmo-stp_10.42.42.5(pid=23388): stderr: | 20221209041628636 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041628636 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041628637 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041628637 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041628637 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041628638 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041628638 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:16:30.069503 run osmo-stp_10.42.42.5(pid=23388): stdout: | (launched: 2022-12-09_04:16:28.468632) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:16:30.192184 run osmo-stp_10.42.42.5(pid=23388): stderr: | 20221209041628636 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041628636 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041628637 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041628637 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041628637 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041628638 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041628638 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:16:30.337485 run patchelf(pid=23391): Terminating (SIGINT) 04:16:30.506113 run patchelf(pid=23391): Terminated: ok {rc=0} 04:16:30.627317 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=23388): Process ended prematurely: osmo-stp_10.42.42.5(pid=23388) [trial-2354↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23388)] [trial-2354↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27] 04:16:30.636486 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 04:16:30.663518 run osmo-hlr_10.42.42.2(pid=23385): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23385)] 04:16:30.712268 run osmo-hlr_10.42.42.2(pid=23385): stdout: | (launched: 2022-12-09_04:16:27.544256) 04:16:30.762403 run osmo-hlr_10.42.42.2(pid=23385): stderr: | 20221209041627719 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209041627719 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209041627719 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209041627720 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209041627720 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209041627720 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209041627732 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-umtrx+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209041627741 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209041627741 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209041627741 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:16:30.813098 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23384): Terminating (SIGTERM) 04:16:30.857262 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23387): Terminating (SIGTERM) 04:16:30.898238 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23390): Terminating (SIGTERM) 04:16:30.939990 --- ParallelTerminationStrategy: PID 23384 died... 04:16:30.959572 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23384): Terminated: ok {rc=0} 04:16:31.004862 --- ParallelTerminationStrategy: PID 23387 died... 04:16:31.025477 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23387): Terminated: ok {rc=0} 04:16:31.070813 --- ParallelTerminationStrategy: PID 23390 died... 04:16:31.090388 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23390): Terminated: ok {rc=0} 04:16:31.178016 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2354 gprs:trx-umtrx+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 gprs:trx-umtrx+mod-bts0-dynts-ipa --------------------------------------------------------------------- 04:16:32.485587 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:16:32.491450 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 04:16:32.523786 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 04:16:32.561882 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 04:16:32.647003 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 04:16:32.679145 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 04:16:32.716718 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 04:16:33.310250 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2354 gprs:trx-umtrx+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 04:16:33.359052 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:16:33.370053 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:16:33.441394 tst cs_paging_gprs_active.py: using LAC 19007 04:16:33.560298 tst cs_paging_gprs_active.py: using RAC 137 04:16:33.685371 tst cs_paging_gprs_active.py: using CellId 19007 04:16:33.802610 tst cs_paging_gprs_active.py: using BVCI 19008 04:16:33.912352 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:16:33.923397 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:16:33.934138 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:16:33.944705 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:16:33.955316 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:16:33.966102 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:16:33.976883 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:16:33.987636 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:16:33.998376 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:16:34.117589 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:16:34.238008 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 04:16:34.458178 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:16:34.784899 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23395): Launched 04:16:35.067522 run iperf3-srv_10.42.42.10(pid=23396): Launched 04:16:35.190204 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 04:16:35.410002 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:16:35.735977 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23397): Launched 04:16:36.018341 run iperf3-srv_10.42.42.10(pid=23398): Launched 04:16:36.140830 tst cs_paging_gprs_active.py:38: start network... 04:16:36.359263 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:16:36.862669 run create_hlr_db(pid=23399): Launched 04:16:36.987470 bus /gobi_6: Setting Powered False 04:16:38.051765 run create_hlr_db(pid=23399): Terminated: ok {rc=0} 04:16:38.486360 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23401): Launched 04:16:38.790106 run osmo-hlr_10.42.42.2(pid=23402): Launched 04:16:38.905230 run osmo-stp_10.42.42.5: Starting osmo-stp 04:16:39.427321 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23404): Launched 04:16:39.730081 run osmo-stp_10.42.42.5(pid=23405): Launched 04:16:39.845077 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:16:40.367153 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23407): Launched 04:16:40.483319 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:16:40.746708 run patchelf(pid=23408): Launched 04:16:40.915847 run osmo-stp_10.42.42.5(pid=23405): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23405)] 04:16:41.043947 run osmo-stp_10.42.42.5(pid=23405): stdout: | (launched: 2022-12-09_04:16:39.674439) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:16:41.173985 run osmo-stp_10.42.42.5(pid=23405): stderr: | 20221209041639843 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041639843 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041639843 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041639844 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041639844 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041639844 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041639844 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:16:41.305084 run osmo-stp_10.42.42.5(pid=23405): stdout: | (launched: 2022-12-09_04:16:39.674439) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:16:41.429990 run osmo-stp_10.42.42.5(pid=23405): stderr: | 20221209041639843 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041639843 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041639843 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041639844 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041639844 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041639844 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041639844 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:16:41.577896 run patchelf(pid=23408): Terminating (SIGINT) 04:16:41.749421 run patchelf(pid=23408): Terminated: ok {rc=0} 04:16:41.873124 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=23405): Process ended prematurely: osmo-stp_10.42.42.5(pid=23405) [trial-2354↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23405)] [trial-2354↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 04:16:41.883127 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 04:16:41.910703 run osmo-hlr_10.42.42.2(pid=23402): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23402)] 04:16:41.959249 run osmo-hlr_10.42.42.2(pid=23402): stdout: | (launched: 2022-12-09_04:16:38.734204) 04:16:42.009227 run osmo-hlr_10.42.42.2(pid=23402): stderr: | 20221209041638911 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209041638911 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209041638911 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209041638911 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209041638911 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209041638911 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209041638923 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-umtrx+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209041638934 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209041638934 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209041638934 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:16:42.059660 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23395): Terminating (SIGTERM) 04:16:42.100131 run iperf3-srv_10.42.42.10(pid=23396): Terminating (SIGTERM) 04:16:42.140497 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23397): Terminating (SIGTERM) 04:16:42.180891 run iperf3-srv_10.42.42.10(pid=23398): Terminating (SIGTERM) 04:16:42.221334 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23401): Terminating (SIGTERM) 04:16:42.261713 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23404): Terminating (SIGTERM) 04:16:42.302259 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23407): Terminating (SIGTERM) 04:16:42.342865 --- ParallelTerminationStrategy: PID 23395 died... 04:16:42.362359 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23395): Terminated: ok {rc=0} 04:16:42.407066 --- ParallelTerminationStrategy: PID 23396 died... 04:16:42.426074 run iperf3-srv_10.42.42.10(pid=23396): Terminated {rc=256} 04:16:42.470758 --- ParallelTerminationStrategy: PID 23397 died... 04:16:42.489886 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23397): Terminated: ok {rc=0} 04:16:42.534890 --- ParallelTerminationStrategy: PID 23398 died... 04:16:42.553902 run iperf3-srv_10.42.42.10(pid=23398): Terminated {rc=256} 04:16:42.598438 --- ParallelTerminationStrategy: PID 23401 died... 04:16:42.617516 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23401): Terminated: ok {rc=0} 04:16:42.662288 --- ParallelTerminationStrategy: PID 23404 died... 04:16:42.681680 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23404): Terminated: ok {rc=0} 04:16:42.726377 --- ParallelTerminationStrategy: PID 23407 died... 04:16:42.745448 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23407): Terminated: ok {rc=0} 04:16:42.829670 bus /gobi_0: Setting Powered False 04:16:43.929249 bus /gobi_0: Setting Powered False 04:16:45.047967 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 04:16:46.228404 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:16:46.245207 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:16:46.340078 tst iperf3.py: using LAC 19008 04:16:46.470178 tst iperf3.py: using RAC 138 04:16:46.623763 tst iperf3.py: using CellId 19008 04:16:46.745347 tst iperf3.py: using BVCI 19009 04:16:46.858070 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:16:46.869091 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:16:46.880497 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:16:46.892235 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:16:46.903774 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:16:46.915621 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:16:46.927537 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:16:46.939338 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:16:46.951215 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:16:47.068594 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 04:16:47.304358 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:16:47.632007 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23409): Launched 04:16:47.914971 run iperf3-srv_10.42.42.10(pid=23410): Launched 04:16:48.037191 tst iperf3.py:8: start network... 04:16:48.255505 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:16:48.758805 run create_hlr_db(pid=23411): Launched 04:16:48.882111 bus /gobi_6: Setting Powered False 04:16:49.946235 run create_hlr_db(pid=23411): Terminated: ok {rc=0} 04:16:50.398399 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23413): Launched 04:16:50.723585 run osmo-hlr_10.42.42.2(pid=23414): Launched 04:16:50.848011 run osmo-stp_10.42.42.5: Starting osmo-stp 04:16:51.501705 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23416): Launched 04:16:51.817793 run osmo-stp_10.42.42.5(pid=23417): Launched 04:16:51.939006 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:16:52.485747 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23419): Launched 04:16:52.607592 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:16:52.875911 run patchelf(pid=23420): Launched 04:16:53.052492 run osmo-stp_10.42.42.5(pid=23417): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23417)] 04:16:53.186769 run osmo-stp_10.42.42.5(pid=23417): stdout: | (launched: 2022-12-09_04:16:51.760188) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:16:53.322707 run osmo-stp_10.42.42.5(pid=23417): stderr: | 20221209041651950 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041651950 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041651950 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041651951 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041651951 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041651951 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041651951 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:16:53.459117 run osmo-stp_10.42.42.5(pid=23417): stdout: | (launched: 2022-12-09_04:16:51.760188) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:16:53.589750 run osmo-stp_10.42.42.5(pid=23417): stderr: | 20221209041651950 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041651950 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041651950 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041651951 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041651951 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041651951 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041651951 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:16:53.743641 run patchelf(pid=23420): Terminating (SIGINT) 04:16:53.921913 run patchelf(pid=23420): Terminated: ok {rc=0} 04:16:54.050554 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23417): Process ended prematurely: osmo-stp_10.42.42.5(pid=23417) [trial-2354↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23417)] [trial-2354↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8] 04:16:54.060551 tst iperf3.py:8: Test FAILED (7.9 sec) 04:16:54.089916 run osmo-hlr_10.42.42.2(pid=23414): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23414)] 04:16:54.140511 run osmo-hlr_10.42.42.2(pid=23414): stdout: | (launched: 2022-12-09_04:16:50.664394) 04:16:54.192769 run osmo-hlr_10.42.42.2(pid=23414): stderr: | 20221209041650860 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209041650860 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209041650861 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209041650861 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209041650861 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209041650861 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209041650874 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209041650883 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209041650883 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209041650883 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:16:54.245626 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23409): Terminating (SIGTERM) 04:16:54.287890 run iperf3-srv_10.42.42.10(pid=23410): Terminating (SIGTERM) 04:16:54.330143 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23413): Terminating (SIGTERM) 04:16:54.372442 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23416): Terminating (SIGTERM) 04:16:54.414797 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23419): Terminating (SIGTERM) 04:16:54.457238 --- ParallelTerminationStrategy: PID 23409 died... 04:16:54.477365 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23409): Terminated: ok {rc=0} 04:16:54.524722 --- ParallelTerminationStrategy: PID 23410 died... 04:16:54.544478 run iperf3-srv_10.42.42.10(pid=23410): Terminated {rc=256} 04:16:54.591364 --- ParallelTerminationStrategy: PID 23413 died... 04:16:54.611072 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23413): Terminated: ok {rc=0} 04:16:54.657860 --- ParallelTerminationStrategy: PID 23416 died... 04:16:54.677540 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23416): Terminated: ok {rc=0} 04:16:54.724358 --- ParallelTerminationStrategy: PID 23419 died... 04:16:54.743968 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23419): Terminated: ok {rc=0} 04:16:54.832706 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 04:16:55.979156 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:16:55.990627 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:16:56.062355 tst iperf3m4.py: using LAC 19009 04:16:56.177814 tst iperf3m4.py: using RAC 139 04:16:56.292627 tst iperf3m4.py: using CellId 19009 04:16:56.407516 tst iperf3m4.py: using BVCI 19010 04:16:56.515324 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:16:56.526188 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:16:56.536566 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:16:56.547261 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:16:56.557973 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:16:56.568592 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:16:56.579262 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:16:56.589684 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:16:56.600428 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:16:56.720102 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:16:56.839817 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:16:56.957730 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:16:57.077396 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 04:16:57.290635 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:16:57.610043 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23421): Launched 04:16:57.887028 run iperf3-srv_10.42.42.10(pid=23422): Launched 04:16:57.999434 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 04:16:58.197066 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:16:58.494972 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23423): Launched 04:16:58.753958 run iperf3-srv_10.42.42.10(pid=23424): Launched 04:16:58.865267 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 04:16:59.062746 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:16:59.359934 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23425): Launched 04:16:59.619058 run iperf3-srv_10.42.42.10(pid=23426): Launched 04:16:59.730547 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 04:16:59.927618 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:17:00.224559 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23427): Launched 04:17:00.482924 run iperf3-srv_10.42.42.10(pid=23428): Launched 04:17:00.594466 tst iperf3m4.py:8: start network... 04:17:00.791046 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:17:01.319671 run create_hlr_db(pid=23429): Launched 04:17:01.487659 bus /gobi_6: Setting Powered False 04:17:02.547751 run create_hlr_db(pid=23429): Terminated: ok {rc=0} 04:17:03.007554 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23434): Launched 04:17:03.324920 run osmo-hlr_10.42.42.2(pid=23435): Launched 04:17:03.445253 run osmo-stp_10.42.42.5: Starting osmo-stp 04:17:03.993343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23437): Launched 04:17:04.310428 run osmo-stp_10.42.42.5(pid=23438): Launched 04:17:04.431142 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:17:04.977576 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23440): Launched 04:17:05.099194 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:17:05.367612 run patchelf(pid=23441): Launched 04:17:05.544078 run osmo-stp_10.42.42.5(pid=23438): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23438)] 04:17:05.679138 run osmo-stp_10.42.42.5(pid=23438): stdout: | (launched: 2022-12-09_04:17:04.252603) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:17:05.815240 run osmo-stp_10.42.42.5(pid=23438): stderr: | 20221209041704439 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041704439 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041704439 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041704439 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041704440 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041704440 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041704440 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:17:05.951619 run osmo-stp_10.42.42.5(pid=23438): stdout: | (launched: 2022-12-09_04:17:04.252603) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:17:06.082509 run osmo-stp_10.42.42.5(pid=23438): stderr: | 20221209041704439 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041704439 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041704439 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041704439 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041704440 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041704440 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041704440 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:17:06.236788 run patchelf(pid=23441): Terminating (SIGINT) 04:17:06.415446 run patchelf(pid=23441): Terminated: ok {rc=0} 04:17:06.544758 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23438): Process ended prematurely: osmo-stp_10.42.42.5(pid=23438) [trial-2354↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23438)] [trial-2354↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8] 04:17:06.555198 tst iperf3m4.py:8: Test FAILED (10.6 sec) 04:17:06.585147 run osmo-hlr_10.42.42.2(pid=23435): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23435)] 04:17:06.636041 run osmo-hlr_10.42.42.2(pid=23435): stdout: | (launched: 2022-12-09_04:17:03.267060) 04:17:06.688796 run osmo-hlr_10.42.42.2(pid=23435): stderr: | 20221209041703463 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209041703463 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209041703463 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209041703463 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209041703463 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209041703463 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209041703474 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209041703484 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209041703484 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209041703484 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:17:06.741963 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23421): Terminating (SIGTERM) 04:17:06.784435 run iperf3-srv_10.42.42.10(pid=23422): Terminating (SIGTERM) 04:17:06.827032 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23423): Terminating (SIGTERM) 04:17:06.869929 run iperf3-srv_10.42.42.10(pid=23424): Terminating (SIGTERM) 04:17:06.912208 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23425): Terminating (SIGTERM) 04:17:06.954688 run iperf3-srv_10.42.42.10(pid=23426): Terminating (SIGTERM) 04:17:06.997074 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23427): Terminating (SIGTERM) 04:17:07.039504 run iperf3-srv_10.42.42.10(pid=23428): Terminating (SIGTERM) 04:17:07.081816 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23434): Terminating (SIGTERM) 04:17:07.124412 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23437): Terminating (SIGTERM) 04:17:07.166798 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23440): Terminating (SIGTERM) 04:17:07.209529 --- ParallelTerminationStrategy: PID 23421 died... 04:17:07.229685 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23421): Terminated: ok {rc=0} 04:17:07.276545 --- ParallelTerminationStrategy: PID 23422 died... 04:17:07.296049 run iperf3-srv_10.42.42.10(pid=23422): Terminated {rc=256} 04:17:07.342594 --- ParallelTerminationStrategy: PID 23423 died... 04:17:07.362116 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23423): Terminated: ok {rc=0} 04:17:07.408477 --- ParallelTerminationStrategy: PID 23424 died... 04:17:07.427882 run iperf3-srv_10.42.42.10(pid=23424): Terminated {rc=256} 04:17:07.474342 --- ParallelTerminationStrategy: PID 23425 died... 04:17:07.493903 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23425): Terminated: ok {rc=0} 04:17:07.541159 --- ParallelTerminationStrategy: PID 23426 died... 04:17:07.560571 run iperf3-srv_10.42.42.10(pid=23426): Terminated {rc=256} 04:17:07.607121 --- ParallelTerminationStrategy: PID 23427 died... 04:17:07.626624 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23427): Terminated: ok {rc=0} 04:17:07.673269 --- ParallelTerminationStrategy: PID 23428 died... 04:17:07.692631 run iperf3-srv_10.42.42.10(pid=23428): Terminated {rc=256} 04:17:07.739192 --- ParallelTerminationStrategy: PID 23434 died... 04:17:07.758697 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23434): Terminated: ok {rc=0} 04:17:07.805134 --- ParallelTerminationStrategy: PID 23437 died... 04:17:07.824620 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23437): Terminated: ok {rc=0} 04:17:07.871147 --- ParallelTerminationStrategy: PID 23440 died... 04:17:07.890684 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23440): Terminated: ok {rc=0} 04:17:07.979018 bus /gobi_4: Setting Powered False 04:17:09.078513 bus /gobi_4: Setting Powered False 04:17:10.194836 bus /gobi_1: Setting Powered False 04:17:11.293950 bus /gobi_1: Setting Powered False 04:17:12.410742 bus /gobi_0: Setting Powered False 04:17:13.509251 bus /gobi_0: Setting Powered False 04:17:14.626490 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:trx-umtrx+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 04:17:15.729405 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:17:15.741120 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:17:15.810762 tst ping.py: using LAC 19010 04:17:15.955981 tst ping.py: using RAC 140 04:17:16.083853 tst ping.py: using CellId 19010 04:17:16.202767 tst ping.py: using BVCI 19011 04:17:16.321745 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:17:16.333491 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:17:16.344729 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:17:16.356927 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:17:16.369185 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:17:16.382128 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:17:16.395963 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:17:16.409151 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:17:16.532633 tst ping.py:19: start network... 04:17:16.740661 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:17:17.221323 run create_hlr_db(pid=23442): Launched 04:17:17.358279 bus /gobi_6: Setting Powered False 04:17:18.417117 run create_hlr_db(pid=23442): Terminated: ok {rc=0} 04:17:18.845556 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23444): Launched 04:17:19.159226 run osmo-hlr_10.42.42.2(pid=23445): Launched 04:17:19.278985 run osmo-stp_10.42.42.5: Starting osmo-stp 04:17:19.816032 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23447): Launched 04:17:20.128707 run osmo-stp_10.42.42.5(pid=23448): Launched 04:17:20.248381 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:17:20.789366 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23450): Launched 04:17:20.909231 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:17:21.173258 run patchelf(pid=23451): Launched 04:17:21.347021 run osmo-stp_10.42.42.5(pid=23448): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23448)] 04:17:21.479387 run osmo-stp_10.42.42.5(pid=23448): stdout: | (launched: 2022-12-09_04:17:20.071527) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:17:21.614468 run osmo-stp_10.42.42.5(pid=23448): stderr: | 20221209041720259 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041720259 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041720260 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041720260 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041720261 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041720261 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041720261 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:17:21.749456 run osmo-stp_10.42.42.5(pid=23448): stdout: | (launched: 2022-12-09_04:17:20.071527) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:17:21.877817 run osmo-stp_10.42.42.5(pid=23448): stderr: | 20221209041720259 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041720259 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041720260 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041720260 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041720261 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041720261 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041720261 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:17:22.030286 run patchelf(pid=23451): Terminating (SIGINT) 04:17:22.206345 run patchelf(pid=23451): Terminated: ok {rc=0} 04:17:22.332805 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=23448): Process ended prematurely: osmo-stp_10.42.42.5(pid=23448) [trial-2354↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23448)] [trial-2354↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22] 04:17:22.342446 tst ping.py:22: Test FAILED (6.6 sec) 04:17:22.371595 run osmo-hlr_10.42.42.2(pid=23445): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23445)] 04:17:22.422187 run osmo-hlr_10.42.42.2(pid=23445): stdout: | (launched: 2022-12-09_04:17:19.102097) 04:17:22.474632 run osmo-hlr_10.42.42.2(pid=23445): stderr: | 20221209041719298 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209041719298 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209041719298 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209041719298 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209041719298 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209041719298 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209041719310 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209041719318 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209041719318 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209041719319 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:17:22.528050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23444): Terminating (SIGTERM) 04:17:22.570643 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23447): Terminating (SIGTERM) 04:17:22.613455 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23450): Terminating (SIGTERM) 04:17:22.655896 --- ParallelTerminationStrategy: PID 23444 died... 04:17:22.675886 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23444): Terminated: ok {rc=0} 04:17:22.722818 --- ParallelTerminationStrategy: PID 23447 died... 04:17:22.742358 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23447): Terminated: ok {rc=0} 04:17:22.789253 --- ParallelTerminationStrategy: PID 23450 died... 04:17:22.808721 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23450): Terminated: ok {rc=0} 04:17:22.898022 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:trx-umtrx+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 04:17:23.986517 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:17:23.998792 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:17:24.073329 tst ping_idle_ping.py: using LAC 19011 04:17:24.197705 tst ping_idle_ping.py: using RAC 141 04:17:24.321317 tst ping_idle_ping.py: using CellId 19011 04:17:24.445300 tst ping_idle_ping.py: using BVCI 19012 04:17:24.560928 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:17:24.572327 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:17:24.583428 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:17:24.594941 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:17:24.606277 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:17:24.617540 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:17:24.628803 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:17:24.640047 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:17:24.757322 tst ping_idle_ping.py:24: start network... 04:17:24.967646 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:17:25.451680 run create_hlr_db(pid=23452): Launched 04:17:25.570678 bus /gobi_6: Setting Powered False 04:17:26.633496 run create_hlr_db(pid=23452): Terminated: ok {rc=0} 04:17:27.070004 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23454): Launched 04:17:27.381697 run osmo-hlr_10.42.42.2(pid=23455): Launched 04:17:27.502284 run osmo-stp_10.42.42.5: Starting osmo-stp 04:17:28.042599 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23457): Launched 04:17:28.356422 run osmo-stp_10.42.42.5(pid=23458): Launched 04:17:28.477383 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:17:29.018124 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23460): Launched 04:17:29.138571 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:17:29.403502 run patchelf(pid=23461): Launched 04:17:29.578356 run osmo-stp_10.42.42.5(pid=23458): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23458)] 04:17:29.711503 run osmo-stp_10.42.42.5(pid=23458): stdout: | (launched: 2022-12-09_04:17:28.299081) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:17:29.845834 run osmo-stp_10.42.42.5(pid=23458): stderr: | 20221209041728490 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041728490 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041728491 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041728491 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041728492 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041728492 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041728492 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:17:29.980152 run osmo-stp_10.42.42.5(pid=23458): stdout: | (launched: 2022-12-09_04:17:28.299081) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:17:30.109041 run osmo-stp_10.42.42.5(pid=23458): stderr: | 20221209041728490 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041728490 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041728491 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041728491 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041728492 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041728492 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041728492 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:17:30.261309 run patchelf(pid=23461): Terminating (SIGINT) 04:17:30.438302 run patchelf(pid=23461): Terminated: ok {rc=0} 04:17:30.565988 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=23458): Process ended prematurely: osmo-stp_10.42.42.5(pid=23458) [trial-2354↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23458)] [trial-2354↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 04:17:30.575567 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 04:17:30.604361 run osmo-hlr_10.42.42.2(pid=23455): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23455)] 04:17:30.654753 run osmo-hlr_10.42.42.2(pid=23455): stdout: | (launched: 2022-12-09_04:17:27.325086) 04:17:30.706982 run osmo-hlr_10.42.42.2(pid=23455): stderr: | 20221209041727521 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209041727521 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209041727522 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209041727522 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209041727522 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209041727522 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209041727540 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209041727550 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209041727550 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209041727550 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:17:30.759534 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23454): Terminating (SIGTERM) 04:17:30.801737 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23457): Terminating (SIGTERM) 04:17:30.844485 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23460): Terminating (SIGTERM) 04:17:30.892607 --- ParallelTerminationStrategy: PID 23454 died... 04:17:30.913124 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23454): Terminated: ok {rc=0} 04:17:30.962107 --- ParallelTerminationStrategy: PID 23457 died... 04:17:30.982499 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23457): Terminated: ok {rc=0} 04:17:31.031886 --- ParallelTerminationStrategy: PID 23460 died... 04:17:31.052461 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23460): Terminated: ok {rc=0} 04:17:31.146228 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2354 gprs:trx-umtrx+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 gprs:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 04:17:32.452204 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:17:32.458970 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 04:17:32.493190 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 04:17:32.532554 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 04:17:32.621496 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 04:17:32.654455 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 04:17:32.693572 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 04:17:33.288906 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2354 gprs:trx-umtrx+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 04:17:33.340612 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:17:33.351890 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:17:33.422435 tst cs_paging_gprs_active.py: using LAC 19012 04:17:33.546708 tst cs_paging_gprs_active.py: using RAC 142 04:17:33.671598 tst cs_paging_gprs_active.py: using CellId 19012 04:17:33.796929 tst cs_paging_gprs_active.py: using BVCI 19013 04:17:33.906646 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:17:33.917635 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:17:33.928525 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:17:33.939699 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:17:33.950489 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:17:33.961568 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:17:33.972543 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:17:33.983083 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:17:33.994013 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:17:34.111688 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:17:34.231120 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 04:17:34.432384 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:17:34.733034 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23465): Launched 04:17:34.993873 run iperf3-srv_10.42.42.10(pid=23466): Launched 04:17:35.106818 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 04:17:35.306741 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:17:35.606869 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23467): Launched 04:17:35.879395 run iperf3-srv_10.42.42.10(pid=23469): Launched 04:17:36.001327 tst cs_paging_gprs_active.py:38: start network... 04:17:36.216670 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:17:36.712546 run create_hlr_db(pid=23470): Launched 04:17:36.834730 bus /gobi_6: Setting Powered False 04:17:37.898864 run create_hlr_db(pid=23470): Terminated: ok {rc=0} 04:17:38.326287 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23472): Launched 04:17:38.624850 run osmo-hlr_10.42.42.2(pid=23473): Launched 04:17:38.739144 run osmo-stp_10.42.42.5: Starting osmo-stp 04:17:39.266478 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23475): Launched 04:17:39.563667 run osmo-stp_10.42.42.5(pid=23476): Launched 04:17:39.677803 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:17:40.212402 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23478): Launched 04:17:40.335697 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:17:40.608367 run patchelf(pid=23479): Launched 04:17:40.786404 run osmo-stp_10.42.42.5(pid=23476): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23476)] 04:17:40.921571 run osmo-stp_10.42.42.5(pid=23476): stdout: | (launched: 2022-12-09_04:17:39.509122) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:17:41.058867 run osmo-stp_10.42.42.5(pid=23476): stderr: | 20221209041739675 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041739676 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041739676 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041739676 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041739677 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041739677 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041739677 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:17:41.195796 run osmo-stp_10.42.42.5(pid=23476): stdout: | (launched: 2022-12-09_04:17:39.509122) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:17:41.327321 run osmo-stp_10.42.42.5(pid=23476): stderr: | 20221209041739675 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041739676 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041739676 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041739676 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041739677 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041739677 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041739677 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:17:41.482904 run patchelf(pid=23479): Terminating (SIGINT) 04:17:41.663281 run patchelf(pid=23479): Terminated: ok {rc=0} 04:17:41.793732 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=23476): Process ended prematurely: osmo-stp_10.42.42.5(pid=23476) [trial-2354↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23476)] [trial-2354↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 04:17:41.803841 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 04:17:41.833244 run osmo-hlr_10.42.42.2(pid=23473): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23473)] 04:17:41.883970 run osmo-hlr_10.42.42.2(pid=23473): stdout: | (launched: 2022-12-09_04:17:38.570338) 04:17:41.936600 run osmo-hlr_10.42.42.2(pid=23473): stderr: | 20221209041738746 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209041738746 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209041738746 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209041738746 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209041738746 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209041738746 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209041738758 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-umtrx+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209041738769 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209041738769 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209041738769 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:17:41.989666 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23465): Terminating (SIGTERM) 04:17:42.032047 run iperf3-srv_10.42.42.10(pid=23466): Terminating (SIGTERM) 04:17:42.074532 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23467): Terminating (SIGTERM) 04:17:42.117534 run iperf3-srv_10.42.42.10(pid=23469): Terminating (SIGTERM) 04:17:42.159800 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23472): Terminating (SIGTERM) 04:17:42.202412 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23475): Terminating (SIGTERM) 04:17:42.244591 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23478): Terminating (SIGTERM) 04:17:42.287282 --- ParallelTerminationStrategy: PID 23465 died... 04:17:42.307474 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23465): Terminated: ok {rc=0} 04:17:42.354635 --- ParallelTerminationStrategy: PID 23466 died... 04:17:42.374227 run iperf3-srv_10.42.42.10(pid=23466): Terminated {rc=256} 04:17:42.421120 --- ParallelTerminationStrategy: PID 23467 died... 04:17:42.440736 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23467): Terminated: ok {rc=0} 04:17:42.487205 --- ParallelTerminationStrategy: PID 23469 died... 04:17:42.506727 run iperf3-srv_10.42.42.10(pid=23469): Terminated {rc=256} 04:17:42.554241 --- ParallelTerminationStrategy: PID 23472 died... 04:17:42.574122 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23472): Terminated: ok {rc=0} 04:17:42.621314 --- ParallelTerminationStrategy: PID 23475 died... 04:17:42.640858 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23475): Terminated: ok {rc=0} 04:17:42.687990 --- ParallelTerminationStrategy: PID 23478 died... 04:17:42.707747 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23478): Terminated: ok {rc=0} 04:17:42.796849 bus /gobi_0: Setting Powered False 04:17:43.896735 bus /gobi_0: Setting Powered False 04:17:45.015655 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 04:17:46.168512 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:17:46.181415 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:17:46.255324 tst iperf3.py: using LAC 19013 04:17:46.377870 tst iperf3.py: using RAC 143 04:17:46.543411 tst iperf3.py: using CellId 19013 04:17:46.673100 tst iperf3.py: using BVCI 19014 04:17:46.791787 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:17:46.803766 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:17:46.815618 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:17:46.828187 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:17:46.840746 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:17:46.853379 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:17:46.866910 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:17:46.879597 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:17:46.891392 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:17:47.012643 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 04:17:47.233423 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:17:47.553840 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23480): Launched 04:17:47.832765 run iperf3-srv_10.42.42.10(pid=23481): Launched 04:17:47.953745 tst iperf3.py:8: start network... 04:17:48.168468 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:17:48.662077 run create_hlr_db(pid=23482): Launched 04:17:48.784315 bus /gobi_6: Setting Powered False 04:17:49.848363 run create_hlr_db(pid=23482): Terminated: ok {rc=0} 04:17:50.291683 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23484): Launched 04:17:50.610605 run osmo-hlr_10.42.42.2(pid=23485): Launched 04:17:50.732652 run osmo-stp_10.42.42.5: Starting osmo-stp 04:17:51.284859 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23487): Launched 04:17:51.604016 run osmo-stp_10.42.42.5(pid=23488): Launched 04:17:51.726149 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:17:52.275041 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23490): Launched 04:17:52.396871 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:17:52.666178 run patchelf(pid=23491): Launched 04:17:52.843295 run osmo-stp_10.42.42.5(pid=23488): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23488)] 04:17:52.978606 run osmo-stp_10.42.42.5(pid=23488): stdout: | (launched: 2022-12-09_04:17:51.545642) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:17:53.115535 run osmo-stp_10.42.42.5(pid=23488): stderr: | 20221209041751737 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041751737 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041751737 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041751738 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041751738 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041751738 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041751738 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:17:53.252369 run osmo-stp_10.42.42.5(pid=23488): stdout: | (launched: 2022-12-09_04:17:51.545642) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:17:53.383247 run osmo-stp_10.42.42.5(pid=23488): stderr: | 20221209041751737 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041751737 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041751737 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041751738 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041751738 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041751738 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041751738 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:17:53.538385 run patchelf(pid=23491): Terminating (SIGINT) 04:17:53.718560 run patchelf(pid=23491): Terminated: ok {rc=0} 04:17:53.848118 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23488): Process ended prematurely: osmo-stp_10.42.42.5(pid=23488) [trial-2354↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23488)] [trial-2354↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8] 04:17:53.858408 tst iperf3.py:8: Test FAILED (7.7 sec) 04:17:53.887869 run osmo-hlr_10.42.42.2(pid=23485): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23485)] 04:17:53.938763 run osmo-hlr_10.42.42.2(pid=23485): stdout: | (launched: 2022-12-09_04:17:50.552275) 04:17:53.991361 run osmo-hlr_10.42.42.2(pid=23485): stderr: | 20221209041750749 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209041750749 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209041750749 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209041750749 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209041750749 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209041750750 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209041750762 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209041750770 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209041750770 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209041750770 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:17:54.044518 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23480): Terminating (SIGTERM) 04:17:54.087094 run iperf3-srv_10.42.42.10(pid=23481): Terminating (SIGTERM) 04:17:54.129788 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23484): Terminating (SIGTERM) 04:17:54.172469 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23487): Terminating (SIGTERM) 04:17:54.215354 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23490): Terminating (SIGTERM) 04:17:54.257972 --- ParallelTerminationStrategy: PID 23480 died... 04:17:54.278132 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23480): Terminated: ok {rc=0} 04:17:54.325459 --- ParallelTerminationStrategy: PID 23481 died... 04:17:54.344940 run iperf3-srv_10.42.42.10(pid=23481): Terminated {rc=256} 04:17:54.392052 --- ParallelTerminationStrategy: PID 23484 died... 04:17:54.411810 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23484): Terminated: ok {rc=0} 04:17:54.458930 --- ParallelTerminationStrategy: PID 23487 died... 04:17:54.478739 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23487): Terminated: ok {rc=0} 04:17:54.525962 --- ParallelTerminationStrategy: PID 23490 died... 04:17:54.545820 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23490): Terminated: ok {rc=0} 04:17:54.635545 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 04:17:55.780936 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:17:55.792450 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:17:55.861386 tst iperf3m4.py: using LAC 19014 04:17:55.978667 tst iperf3m4.py: using RAC 144 04:17:56.096925 tst iperf3m4.py: using CellId 19014 04:17:56.215332 tst iperf3m4.py: using BVCI 19015 04:17:56.324687 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:17:56.335763 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:17:56.346456 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:17:56.357336 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:17:56.368043 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:17:56.378852 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:17:56.389828 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:17:56.400484 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:17:56.411773 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:17:56.526246 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:17:56.645787 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:17:56.762495 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:17:56.877621 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 04:17:57.076767 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:17:57.375102 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23492): Launched 04:17:57.634245 run iperf3-srv_10.42.42.10(pid=23493): Launched 04:17:57.745645 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 04:17:57.944154 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:17:58.242182 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23494): Launched 04:17:58.501277 run iperf3-srv_10.42.42.10(pid=23495): Launched 04:17:58.613128 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 04:17:58.810507 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:17:59.108765 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23496): Launched 04:17:59.367143 run iperf3-srv_10.42.42.10(pid=23497): Launched 04:17:59.478262 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 04:17:59.675610 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:17:59.973541 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23498): Launched 04:18:00.232424 run iperf3-srv_10.42.42.10(pid=23499): Launched 04:18:00.343879 tst iperf3m4.py:8: start network... 04:18:00.541060 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:18:01.036182 run create_hlr_db(pid=23500): Launched 04:18:01.206863 bus /gobi_6: Setting Powered False 04:18:02.274855 run create_hlr_db(pid=23500): Terminated: ok {rc=0} 04:18:02.699039 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23502): Launched 04:18:02.997397 run osmo-hlr_10.42.42.2(pid=23503): Launched 04:18:03.111251 run osmo-stp_10.42.42.5: Starting osmo-stp 04:18:03.638050 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23505): Launched 04:18:03.935084 run osmo-stp_10.42.42.5(pid=23506): Launched 04:18:04.048692 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:18:04.562089 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23508): Launched 04:18:04.675944 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:18:04.927725 run patchelf(pid=23509): Launched 04:18:05.093144 run osmo-stp_10.42.42.5(pid=23506): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23506)] 04:18:05.219054 run osmo-stp_10.42.42.5(pid=23506): stdout: | (launched: 2022-12-09_04:18:03.880229) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:18:05.346669 run osmo-stp_10.42.42.5(pid=23506): stderr: | 20221209041804047 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041804047 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041804048 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041804048 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041804049 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041804049 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041804049 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:18:05.474416 run osmo-stp_10.42.42.5(pid=23506): stdout: | (launched: 2022-12-09_04:18:03.880229) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:18:05.596392 run osmo-stp_10.42.42.5(pid=23506): stderr: | 20221209041804047 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041804047 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041804048 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041804048 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041804049 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041804049 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041804049 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:18:05.740758 run patchelf(pid=23509): Terminating (SIGINT) 04:18:05.909354 run patchelf(pid=23509): Terminated: ok {rc=0} 04:18:06.030984 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23506): Process ended prematurely: osmo-stp_10.42.42.5(pid=23506) [trial-2354↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23506)] [trial-2354↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8] 04:18:06.040514 tst iperf3m4.py:8: Test FAILED (10.3 sec) 04:18:06.071136 run osmo-hlr_10.42.42.2(pid=23503): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23503)] 04:18:06.122238 run osmo-hlr_10.42.42.2(pid=23503): stdout: | (launched: 2022-12-09_04:18:02.942441) 04:18:06.175209 run osmo-hlr_10.42.42.2(pid=23503): stderr: | 20221209041803117 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209041803117 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209041803117 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209041803117 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209041803117 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209041803117 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209041803129 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209041803138 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209041803139 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209041803139 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:18:06.228680 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23492): Terminating (SIGTERM) 04:18:06.271567 run iperf3-srv_10.42.42.10(pid=23493): Terminating (SIGTERM) 04:18:06.314623 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23494): Terminating (SIGTERM) 04:18:06.357722 run iperf3-srv_10.42.42.10(pid=23495): Terminating (SIGTERM) 04:18:06.400387 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23496): Terminating (SIGTERM) 04:18:06.443275 run iperf3-srv_10.42.42.10(pid=23497): Terminating (SIGTERM) 04:18:06.485988 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23498): Terminating (SIGTERM) 04:18:06.529165 run iperf3-srv_10.42.42.10(pid=23499): Terminating (SIGTERM) 04:18:06.572015 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23502): Terminating (SIGTERM) 04:18:06.614961 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23505): Terminating (SIGTERM) 04:18:06.657800 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23508): Terminating (SIGTERM) 04:18:06.700918 --- ParallelTerminationStrategy: PID 23492 died... 04:18:06.721285 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23492): Terminated: ok {rc=0} 04:18:06.768878 --- ParallelTerminationStrategy: PID 23493 died... 04:18:06.789164 run iperf3-srv_10.42.42.10(pid=23493): Terminated {rc=256} 04:18:06.836288 --- ParallelTerminationStrategy: PID 23494 died... 04:18:06.856058 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23494): Terminated: ok {rc=0} 04:18:06.903532 --- ParallelTerminationStrategy: PID 23495 died... 04:18:06.923485 run iperf3-srv_10.42.42.10(pid=23495): Terminated {rc=256} 04:18:06.970842 --- ParallelTerminationStrategy: PID 23496 died... 04:18:06.990762 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23496): Terminated: ok {rc=0} 04:18:07.037986 --- ParallelTerminationStrategy: PID 23497 died... 04:18:07.058017 run iperf3-srv_10.42.42.10(pid=23497): Terminated {rc=256} 04:18:07.105387 --- ParallelTerminationStrategy: PID 23498 died... 04:18:07.125362 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23498): Terminated: ok {rc=0} 04:18:07.172928 --- ParallelTerminationStrategy: PID 23499 died... 04:18:07.192786 run iperf3-srv_10.42.42.10(pid=23499): Terminated {rc=256} 04:18:07.239987 --- ParallelTerminationStrategy: PID 23502 died... 04:18:07.259688 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23502): Terminated: ok {rc=0} 04:18:07.307098 --- ParallelTerminationStrategy: PID 23505 died... 04:18:07.327088 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23505): Terminated: ok {rc=0} 04:18:07.374390 --- ParallelTerminationStrategy: PID 23508 died... 04:18:07.394431 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23508): Terminated: ok {rc=0} 04:18:07.483887 bus /gobi_4: Setting Powered False 04:18:08.584494 bus /gobi_4: Setting Powered False 04:18:09.704383 bus /gobi_1: Setting Powered False 04:18:10.804147 bus /gobi_1: Setting Powered False 04:18:11.921336 bus /gobi_0: Setting Powered False 04:18:13.021758 bus /gobi_0: Setting Powered False 04:18:14.139991 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:trx-umtrx+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 04:18:15.244409 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:18:15.255737 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:18:15.325838 tst ping.py: using LAC 19015 04:18:15.441489 tst ping.py: using RAC 145 04:18:15.569450 tst ping.py: using CellId 19015 04:18:15.693184 tst ping.py: using BVCI 19016 04:18:15.807353 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:18:15.818851 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:18:15.842676 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:18:15.856261 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:18:15.869977 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:18:15.883774 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:18:15.896896 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:18:15.908773 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:18:16.041858 tst ping.py:19: start network... 04:18:16.255363 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:18:16.755109 run create_hlr_db(pid=23510): Launched 04:18:16.909813 bus /gobi_6: Setting Powered False 04:18:17.972277 run create_hlr_db(pid=23510): Terminated: ok {rc=0} 04:18:18.393038 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23512): Launched 04:18:18.688171 run osmo-hlr_10.42.42.2(pid=23513): Launched 04:18:18.800621 run osmo-stp_10.42.42.5: Starting osmo-stp 04:18:19.303361 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23515): Launched 04:18:19.594873 run osmo-stp_10.42.42.5(pid=23516): Launched 04:18:19.705932 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:18:20.209205 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23518): Launched 04:18:20.321761 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:18:20.568653 run patchelf(pid=23519): Launched 04:18:20.730857 run osmo-stp_10.42.42.5(pid=23516): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23516)] 04:18:20.854630 run osmo-stp_10.42.42.5(pid=23516): stdout: | (launched: 2022-12-09_04:18:19.541060) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:18:20.979925 run osmo-stp_10.42.42.5(pid=23516): stderr: | 20221209041819709 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041819710 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041819710 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041819710 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041819711 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041819711 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041819711 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:18:21.105714 run osmo-stp_10.42.42.5(pid=23516): stdout: | (launched: 2022-12-09_04:18:19.541060) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:18:21.225506 run osmo-stp_10.42.42.5(pid=23516): stderr: | 20221209041819709 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041819710 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041819710 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041819710 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041819711 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041819711 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041819711 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:18:21.367419 run patchelf(pid=23519): Terminating (SIGINT) 04:18:21.532448 run patchelf(pid=23519): Terminated: ok {rc=0} 04:18:21.651677 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=23516): Process ended prematurely: osmo-stp_10.42.42.5(pid=23516) [trial-2354↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23516)] [trial-2354↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22] 04:18:21.660506 tst ping.py:22: Test FAILED (6.4 sec) 04:18:21.687711 run osmo-hlr_10.42.42.2(pid=23513): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23513)] 04:18:21.735799 run osmo-hlr_10.42.42.2(pid=23513): stdout: | (launched: 2022-12-09_04:18:18.633449) 04:18:21.785659 run osmo-hlr_10.42.42.2(pid=23513): stderr: | 20221209041818808 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209041818808 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209041818808 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209041818808 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209041818808 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209041818808 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209041818820 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209041818829 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209041818829 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209041818829 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:18:21.836099 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23512): Terminating (SIGTERM) 04:18:21.876323 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23515): Terminating (SIGTERM) 04:18:21.917155 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23518): Terminating (SIGTERM) 04:18:21.957595 --- ParallelTerminationStrategy: PID 23512 died... 04:18:21.976741 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23512): Terminated: ok {rc=0} 04:18:22.021237 --- ParallelTerminationStrategy: PID 23515 died... 04:18:22.039989 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23515): Terminated: ok {rc=0} 04:18:22.084327 --- ParallelTerminationStrategy: PID 23518 died... 04:18:22.103950 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23518): Terminated: ok {rc=0} 04:18:22.188727 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:trx-umtrx+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 04:18:23.274068 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:18:23.285499 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:18:23.356754 tst ping_idle_ping.py: using LAC 19016 04:18:23.472045 tst ping_idle_ping.py: using RAC 146 04:18:23.599389 tst ping_idle_ping.py: using CellId 19016 04:18:23.722717 tst ping_idle_ping.py: using BVCI 19017 04:18:23.838312 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:18:23.849829 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:18:23.861199 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:18:23.873426 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:18:23.885407 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:18:23.897550 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:18:23.909708 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:18:23.921749 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:18:24.038665 tst ping_idle_ping.py:24: start network... 04:18:24.234946 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:18:24.688649 run create_hlr_db(pid=23520): Launched 04:18:24.809102 bus /gobi_6: Setting Powered False 04:18:25.867932 run create_hlr_db(pid=23520): Terminated: ok {rc=0} 04:18:26.298469 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23522): Launched 04:18:26.612778 run osmo-hlr_10.42.42.2(pid=23523): Launched 04:18:26.733728 run osmo-stp_10.42.42.5: Starting osmo-stp 04:18:27.274220 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23525): Launched 04:18:27.589106 run osmo-stp_10.42.42.5(pid=23526): Launched 04:18:27.710104 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:18:28.253940 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23528): Launched 04:18:28.374519 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:18:28.640592 run patchelf(pid=23529): Launched 04:18:28.815926 run osmo-stp_10.42.42.5(pid=23526): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23526)] 04:18:28.949894 run osmo-stp_10.42.42.5(pid=23526): stdout: | (launched: 2022-12-09_04:18:27.531545) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:18:29.085468 run osmo-stp_10.42.42.5(pid=23526): stderr: | 20221209041827721 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041827721 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041827722 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041827722 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041827722 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041827722 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041827722 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:18:29.221456 run osmo-stp_10.42.42.5(pid=23526): stdout: | (launched: 2022-12-09_04:18:27.531545) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:18:29.351498 run osmo-stp_10.42.42.5(pid=23526): stderr: | 20221209041827721 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041827721 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041827722 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041827722 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041827722 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041827722 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041827722 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:18:29.505351 run patchelf(pid=23529): Terminating (SIGINT) 04:18:29.683605 run patchelf(pid=23529): Terminated: ok {rc=0} 04:18:29.811694 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=23526): Process ended prematurely: osmo-stp_10.42.42.5(pid=23526) [trial-2354↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23526)] [trial-2354↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 04:18:29.821325 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 04:18:29.850478 run osmo-hlr_10.42.42.2(pid=23523): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23523)] 04:18:29.901214 run osmo-hlr_10.42.42.2(pid=23523): stdout: | (launched: 2022-12-09_04:18:26.555284) 04:18:29.953981 run osmo-hlr_10.42.42.2(pid=23523): stderr: | 20221209041826751 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209041826751 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209041826751 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209041826751 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209041826752 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209041826752 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209041826766 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209041826776 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209041826776 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209041826776 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:18:30.007235 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23522): Terminating (SIGTERM) 04:18:30.049765 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23525): Terminating (SIGTERM) 04:18:30.092364 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23528): Terminating (SIGTERM) 04:18:30.135038 --- ParallelTerminationStrategy: PID 23522 died... 04:18:30.155221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23522): Terminated: ok {rc=0} 04:18:30.202645 --- ParallelTerminationStrategy: PID 23525 died... 04:18:30.222492 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23525): Terminated: ok {rc=0} 04:18:30.269644 --- ParallelTerminationStrategy: PID 23528 died... 04:18:30.289576 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23528): Terminated: ok {rc=0} 04:18:30.379421 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2354 gprs:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 04:18:31.724092 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:18:31.733224 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 04:18:31.773819 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 04:18:31.820866 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 04:18:31.923521 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 04:18:31.962291 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 04:18:32.011166 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 04:18:32.596563 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2354 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 04:18:32.644389 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:18:32.655831 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 04:18:32.706889 tst cs_paging_gprs_active.py: using LAC 19017 04:18:32.823694 tst cs_paging_gprs_active.py: using RAC 147 04:18:32.942215 tst cs_paging_gprs_active.py: using CellId 19017 04:18:33.065111 tst cs_paging_gprs_active.py: using BVCI 19018 04:18:33.175009 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:18:33.186131 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:18:33.197005 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:18:33.207887 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:18:33.218856 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:18:33.229715 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:18:33.240636 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:18:33.251495 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:18:33.262607 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 04:18:33.382571 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 04:18:33.499819 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 04:18:33.700141 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:18:34.000416 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23533): Launched 04:18:34.262298 run iperf3-srv_10.42.42.10(pid=23534): Launched 04:18:34.374814 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 04:18:34.574562 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:18:34.875012 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23535): Launched 04:18:35.136353 run iperf3-srv_10.42.42.10(pid=23536): Launched 04:18:35.248895 tst cs_paging_gprs_active.py:38: start network... 04:18:35.447765 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:18:35.911843 run create_hlr_db(pid=23537): Launched 04:18:36.034378 bus /gobi_6: Setting Powered False 04:18:37.094234 run create_hlr_db(pid=23537): Terminated: ok {rc=0} 04:18:37.532551 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23539): Launched 04:18:37.855737 run osmo-hlr_10.42.42.2(pid=23540): Launched 04:18:37.979154 run osmo-stp_10.42.42.5: Starting osmo-stp 04:18:38.530238 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23542): Launched 04:18:38.850243 run osmo-stp_10.42.42.5(pid=23543): Launched 04:18:38.973163 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:18:39.525470 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23545): Launched 04:18:39.648371 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:18:39.918950 run patchelf(pid=23546): Launched 04:18:40.097553 run osmo-stp_10.42.42.5(pid=23543): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23543)] 04:18:40.233311 run osmo-stp_10.42.42.5(pid=23543): stdout: | (launched: 2022-12-09_04:18:38.792164) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:18:40.371189 run osmo-stp_10.42.42.5(pid=23543): stderr: | 20221209041838984 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041838984 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041838984 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041838984 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041838985 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041838985 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041838985 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:18:40.508459 run osmo-stp_10.42.42.5(pid=23543): stdout: | (launched: 2022-12-09_04:18:38.792164) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:18:40.640678 run osmo-stp_10.42.42.5(pid=23543): stderr: | 20221209041838984 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041838984 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041838984 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041838984 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041838985 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041838985 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041838985 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:18:40.796306 run patchelf(pid=23546): Terminating (SIGINT) 04:18:40.976482 run patchelf(pid=23546): Terminated: ok {rc=0} 04:18:41.106401 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=23543): Process ended prematurely: osmo-stp_10.42.42.5(pid=23543) [trial-2354↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23543)] [trial-2354↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 04:18:41.116570 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 04:18:41.146121 run osmo-hlr_10.42.42.2(pid=23540): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23540)] 04:18:41.196825 run osmo-hlr_10.42.42.2(pid=23540): stdout: | (launched: 2022-12-09_04:18:37.797402) 04:18:41.249471 run osmo-hlr_10.42.42.2(pid=23540): stderr: | 20221209041837995 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209041837995 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209041837996 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209041837996 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209041837996 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209041837996 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209041838007 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209041838016 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209041838016 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209041838016 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:18:41.302919 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23533): Terminating (SIGTERM) 04:18:41.345396 run iperf3-srv_10.42.42.10(pid=23534): Terminating (SIGTERM) 04:18:41.387862 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23535): Terminating (SIGTERM) 04:18:41.430563 run iperf3-srv_10.42.42.10(pid=23536): Terminating (SIGTERM) 04:18:41.472902 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23539): Terminating (SIGTERM) 04:18:41.515489 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23542): Terminating (SIGTERM) 04:18:41.557978 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23545): Terminating (SIGTERM) 04:18:41.601012 --- ParallelTerminationStrategy: PID 23533 died... 04:18:41.621200 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23533): Terminated: ok {rc=0} 04:18:41.668798 --- ParallelTerminationStrategy: PID 23534 died... 04:18:41.689074 run iperf3-srv_10.42.42.10(pid=23534): Terminated {rc=256} 04:18:41.736282 --- ParallelTerminationStrategy: PID 23535 died... 04:18:41.756162 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23535): Terminated: ok {rc=0} 04:18:41.803162 --- ParallelTerminationStrategy: PID 23536 died... 04:18:41.822990 run iperf3-srv_10.42.42.10(pid=23536): Terminated {rc=256} 04:18:41.870031 --- ParallelTerminationStrategy: PID 23539 died... 04:18:41.889805 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23539): Terminated: ok {rc=0} 04:18:41.936752 --- ParallelTerminationStrategy: PID 23542 died... 04:18:41.956600 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23542): Terminated: ok {rc=0} 04:18:42.003917 --- ParallelTerminationStrategy: PID 23545 died... 04:18:42.023773 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23545): Terminated: ok {rc=0} 04:18:42.111861 bus /gobi_0: Setting Powered False 04:18:43.211393 bus /gobi_0: Setting Powered False 04:18:44.331215 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 04:18:45.476481 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:18:45.488382 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 04:18:45.542678 tst iperf3.py: using LAC 19018 04:18:45.661891 tst iperf3.py: using RAC 148 04:18:45.778636 tst iperf3.py: using CellId 19018 04:18:45.912930 tst iperf3.py: using BVCI 19019 04:18:46.057995 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:18:46.070934 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:18:46.085655 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:18:46.098272 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:18:46.111325 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:18:46.126050 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:18:46.139683 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:18:46.152317 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:18:46.167194 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 04:18:46.305364 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 04:18:46.532168 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:18:46.871717 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23547): Launched 04:18:47.164385 run iperf3-srv_10.42.42.10(pid=23548): Launched 04:18:47.286728 tst iperf3.py:8: start network... 04:18:47.503152 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:18:48.000360 run create_hlr_db(pid=23549): Launched 04:18:48.123445 bus /gobi_6: Setting Powered False 04:18:49.186646 run create_hlr_db(pid=23549): Terminated: ok {rc=0} 04:18:49.632122 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23551): Launched 04:18:49.952180 run osmo-hlr_10.42.42.2(pid=23552): Launched 04:18:50.074541 run osmo-stp_10.42.42.5: Starting osmo-stp 04:18:50.632511 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23554): Launched 04:18:50.952818 run osmo-stp_10.42.42.5(pid=23555): Launched 04:18:51.075380 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:18:51.627774 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23557): Launched 04:18:51.750757 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:18:52.021054 run patchelf(pid=23558): Launched 04:18:52.198753 run osmo-stp_10.42.42.5(pid=23555): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23555)] 04:18:52.334705 run osmo-stp_10.42.42.5(pid=23555): stdout: | (launched: 2022-12-09_04:18:50.894447) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:18:52.472485 run osmo-stp_10.42.42.5(pid=23555): stderr: | 20221209041851086 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041851086 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041851087 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041851087 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041851088 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041851088 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041851088 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:18:52.610473 run osmo-stp_10.42.42.5(pid=23555): stdout: | (launched: 2022-12-09_04:18:50.894447) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:18:52.742339 run osmo-stp_10.42.42.5(pid=23555): stderr: | 20221209041851086 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041851086 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041851087 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041851087 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041851088 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041851088 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041851088 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:18:52.897917 run patchelf(pid=23558): Terminating (SIGINT) 04:18:53.078328 run patchelf(pid=23558): Terminated: ok {rc=0} 04:18:53.208554 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23555): Process ended prematurely: osmo-stp_10.42.42.5(pid=23555) [trial-2354↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23555)] [trial-2354↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 04:18:53.218816 tst iperf3.py:8: Test FAILED (7.8 sec) 04:18:53.248087 run osmo-hlr_10.42.42.2(pid=23552): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23552)] 04:18:53.298864 run osmo-hlr_10.42.42.2(pid=23552): stdout: | (launched: 2022-12-09_04:18:49.893954) 04:18:53.351635 run osmo-hlr_10.42.42.2(pid=23552): stderr: | 20221209041850092 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209041850092 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209041850092 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209041850092 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209041850092 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209041850092 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209041850104 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209041850112 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209041850113 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209041850113 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:18:53.404789 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23547): Terminating (SIGTERM) 04:18:53.447719 run iperf3-srv_10.42.42.10(pid=23548): Terminating (SIGTERM) 04:18:53.490062 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23551): Terminating (SIGTERM) 04:18:53.532700 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23554): Terminating (SIGTERM) 04:18:53.575345 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23557): Terminating (SIGTERM) 04:18:53.618401 --- ParallelTerminationStrategy: PID 23547 died... 04:18:53.638719 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23547): Terminated: ok {rc=0} 04:18:53.686256 --- ParallelTerminationStrategy: PID 23548 died... 04:18:53.706027 run iperf3-srv_10.42.42.10(pid=23548): Terminated {rc=256} 04:18:53.752790 --- ParallelTerminationStrategy: PID 23551 died... 04:18:53.772795 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23551): Terminated: ok {rc=0} 04:18:53.819784 --- ParallelTerminationStrategy: PID 23554 died... 04:18:53.839488 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23554): Terminated: ok {rc=0} 04:18:53.886407 --- ParallelTerminationStrategy: PID 23557 died... 04:18:53.906222 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23557): Terminated: ok {rc=0} 04:18:53.995304 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 04:18:55.146359 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:18:55.158771 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 04:18:55.211579 tst iperf3m4.py: using LAC 19019 04:18:55.341436 tst iperf3m4.py: using RAC 149 04:18:55.466170 tst iperf3m4.py: using CellId 19019 04:18:55.592038 tst iperf3m4.py: using BVCI 19020 04:18:55.708231 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:18:55.719893 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:18:55.731315 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:18:55.743231 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:18:55.754957 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:18:55.766684 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:18:55.778422 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:18:55.790083 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:18:55.802673 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 04:18:55.918617 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 04:18:56.038100 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 04:18:56.155961 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 04:18:56.273138 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 04:18:56.473748 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:18:56.773637 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23559): Launched 04:18:57.034229 run iperf3-srv_10.42.42.10(pid=23560): Launched 04:18:57.146282 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 04:18:57.345094 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:18:57.644257 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23561): Launched 04:18:57.904536 run iperf3-srv_10.42.42.10(pid=23562): Launched 04:18:58.016789 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 04:18:58.215608 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:18:58.515959 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23563): Launched 04:18:58.776404 run iperf3-srv_10.42.42.10(pid=23564): Launched 04:18:58.888631 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 04:18:59.087221 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:18:59.386508 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23565): Launched 04:18:59.646644 run iperf3-srv_10.42.42.10(pid=23566): Launched 04:18:59.758830 tst iperf3m4.py:8: start network... 04:18:59.957261 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:19:00.418868 run create_hlr_db(pid=23567): Launched 04:19:00.542718 bus /gobi_6: Setting Powered False 04:19:01.602356 run create_hlr_db(pid=23567): Terminated: ok {rc=0} 04:19:02.113889 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23569): Launched 04:19:02.415386 run osmo-hlr_10.42.42.2(pid=23570): Launched 04:19:02.530372 run osmo-stp_10.42.42.5: Starting osmo-stp 04:19:03.059327 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23572): Launched 04:19:03.356532 run osmo-stp_10.42.42.5(pid=23573): Launched 04:19:03.470438 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:19:03.983936 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23575): Launched 04:19:04.098567 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:19:04.349777 run patchelf(pid=23576): Launched 04:19:04.515993 run osmo-stp_10.42.42.5(pid=23573): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23573)] 04:19:04.643071 run osmo-stp_10.42.42.5(pid=23573): stdout: | (launched: 2022-12-09_04:19:03.301886) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:19:04.770792 run osmo-stp_10.42.42.5(pid=23573): stderr: | 20221209041903467 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041903467 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041903467 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041903468 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041903468 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041903468 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041903468 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:19:04.898658 run osmo-stp_10.42.42.5(pid=23573): stdout: | (launched: 2022-12-09_04:19:03.301886) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:19:05.021271 run osmo-stp_10.42.42.5(pid=23573): stderr: | 20221209041903467 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041903467 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041903467 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041903468 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041903468 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041903468 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041903468 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:19:05.166251 run patchelf(pid=23576): Terminating (SIGINT) 04:19:05.334314 run patchelf(pid=23576): Terminated: ok {rc=0} 04:19:05.455512 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23573): Process ended prematurely: osmo-stp_10.42.42.5(pid=23573) [trial-2354↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23573)] [trial-2354↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 04:19:05.464921 tst iperf3m4.py:8: Test FAILED (10.4 sec) 04:19:05.492576 run osmo-hlr_10.42.42.2(pid=23570): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23570)] 04:19:05.540389 run osmo-hlr_10.42.42.2(pid=23570): stdout: | (launched: 2022-12-09_04:19:02.360631) 04:19:05.589911 run osmo-hlr_10.42.42.2(pid=23570): stderr: | 20221209041902534 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209041902534 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209041902534 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209041902534 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209041902534 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209041902535 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209041902546 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209041902555 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209041902555 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209041902555 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:19:05.639977 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23559): Terminating (SIGTERM) 04:19:05.679965 run iperf3-srv_10.42.42.10(pid=23560): Terminating (SIGTERM) 04:19:05.719668 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23561): Terminating (SIGTERM) 04:19:05.759535 run iperf3-srv_10.42.42.10(pid=23562): Terminating (SIGTERM) 04:19:05.799193 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23563): Terminating (SIGTERM) 04:19:05.839020 run iperf3-srv_10.42.42.10(pid=23564): Terminating (SIGTERM) 04:19:05.878649 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23565): Terminating (SIGTERM) 04:19:05.918484 run iperf3-srv_10.42.42.10(pid=23566): Terminating (SIGTERM) 04:19:05.958048 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23569): Terminating (SIGTERM) 04:19:05.997724 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23572): Terminating (SIGTERM) 04:19:06.037375 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23575): Terminating (SIGTERM) 04:19:06.077534 --- ParallelTerminationStrategy: PID 23559 died... 04:19:06.096635 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23559): Terminated: ok {rc=0} 04:19:06.140557 --- ParallelTerminationStrategy: PID 23560 died... 04:19:06.159221 run iperf3-srv_10.42.42.10(pid=23560): Terminated {rc=256} 04:19:06.202641 --- ParallelTerminationStrategy: PID 23561 died... 04:19:06.221269 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23561): Terminated: ok {rc=0} 04:19:06.264875 --- ParallelTerminationStrategy: PID 23562 died... 04:19:06.283720 run iperf3-srv_10.42.42.10(pid=23562): Terminated {rc=256} 04:19:06.327277 --- ParallelTerminationStrategy: PID 23563 died... 04:19:06.346123 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23563): Terminated: ok {rc=0} 04:19:06.389896 --- ParallelTerminationStrategy: PID 23564 died... 04:19:06.408523 run iperf3-srv_10.42.42.10(pid=23564): Terminated {rc=256} 04:19:06.452686 --- ParallelTerminationStrategy: PID 23565 died... 04:19:06.471658 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23565): Terminated: ok {rc=0} 04:19:06.515572 --- ParallelTerminationStrategy: PID 23566 died... 04:19:06.534164 run iperf3-srv_10.42.42.10(pid=23566): Terminated {rc=256} 04:19:06.577986 --- ParallelTerminationStrategy: PID 23569 died... 04:19:06.596854 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23569): Terminated: ok {rc=0} 04:19:06.641136 --- ParallelTerminationStrategy: PID 23572 died... 04:19:06.660002 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23572): Terminated: ok {rc=0} 04:19:06.704445 --- ParallelTerminationStrategy: PID 23575 died... 04:19:06.723176 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23575): Terminated: ok {rc=0} 04:19:06.809955 bus /gobi_4: Setting Powered False 04:19:07.911450 bus /gobi_4: Setting Powered False 04:19:09.027966 bus /gobi_1: Setting Powered False 04:19:10.128359 bus /gobi_1: Setting Powered False 04:19:11.244380 bus /gobi_0: Setting Powered False 04:19:12.344612 bus /gobi_0: Setting Powered False 04:19:13.461874 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 04:19:14.565366 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:19:14.577895 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 04:19:14.632614 tst ping.py: using LAC 19020 04:19:14.756056 tst ping.py: using RAC 150 04:19:14.878565 tst ping.py: using CellId 19020 04:19:15.001790 tst ping.py: using BVCI 19021 04:19:15.115839 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:19:15.127698 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:19:15.139357 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:19:15.151288 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:19:15.163216 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:19:15.174985 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:19:15.186988 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:19:15.198853 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 04:19:15.319521 tst ping.py:19: start network... 04:19:15.530155 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:19:16.032405 run create_hlr_db(pid=23577): Launched 04:19:16.182795 bus /gobi_6: Setting Powered False 04:19:17.244757 run create_hlr_db(pid=23577): Terminated: ok {rc=0} 04:19:17.667456 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23579): Launched 04:19:17.959076 run osmo-hlr_10.42.42.2(pid=23580): Launched 04:19:18.071001 run osmo-stp_10.42.42.5: Starting osmo-stp 04:19:18.577561 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23582): Launched 04:19:18.870791 run osmo-stp_10.42.42.5(pid=23583): Launched 04:19:18.982824 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:19:19.488574 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23585): Launched 04:19:19.610961 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:19:19.877102 run patchelf(pid=23586): Launched 04:19:20.052447 run osmo-stp_10.42.42.5(pid=23583): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23583)] 04:19:20.185633 run osmo-stp_10.42.42.5(pid=23583): stdout: | (launched: 2022-12-09_04:19:18.816921) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:19:20.320223 run osmo-stp_10.42.42.5(pid=23583): stderr: | 20221209041918986 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041918986 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041918986 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041918987 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041918987 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041918987 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041918987 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:19:20.455206 run osmo-stp_10.42.42.5(pid=23583): stdout: | (launched: 2022-12-09_04:19:18.816921) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:19:20.585153 run osmo-stp_10.42.42.5(pid=23583): stderr: | 20221209041918986 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041918986 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041918986 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041918987 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041918987 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041918987 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041918987 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:19:20.738661 run patchelf(pid=23586): Terminating (SIGINT) 04:19:20.915339 run patchelf(pid=23586): Terminated: ok {rc=0} 04:19:21.043220 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=23583): Process ended prematurely: osmo-stp_10.42.42.5(pid=23583) [trial-2354↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23583)] [trial-2354↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 04:19:21.052639 tst ping.py:22: Test FAILED (6.5 sec) 04:19:21.081320 run osmo-hlr_10.42.42.2(pid=23580): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23580)] 04:19:21.132556 run osmo-hlr_10.42.42.2(pid=23580): stdout: | (launched: 2022-12-09_04:19:17.905493) 04:19:21.185236 run osmo-hlr_10.42.42.2(pid=23580): stderr: | 20221209041918077 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209041918077 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209041918077 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209041918077 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209041918077 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209041918077 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209041918089 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209041918098 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209041918098 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209041918099 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:19:21.238628 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23579): Terminating (SIGTERM) 04:19:21.281298 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23582): Terminating (SIGTERM) 04:19:21.323886 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23585): Terminating (SIGTERM) 04:19:21.366663 --- ParallelTerminationStrategy: PID 23579 died... 04:19:21.386875 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23579): Terminated: ok {rc=0} 04:19:21.434445 --- ParallelTerminationStrategy: PID 23582 died... 04:19:21.454204 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23582): Terminated: ok {rc=0} 04:19:21.501483 --- ParallelTerminationStrategy: PID 23585 died... 04:19:21.521525 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23585): Terminated: ok {rc=0} 04:19:21.611051 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 04:19:22.699159 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:19:22.711416 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 04:19:22.765455 tst ping_idle_ping.py: using LAC 19021 04:19:22.883310 tst ping_idle_ping.py: using RAC 151 04:19:23.000876 tst ping_idle_ping.py: using CellId 19021 04:19:23.116382 tst ping_idle_ping.py: using BVCI 19022 04:19:23.223095 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:19:23.234416 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:19:23.245397 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:19:23.256931 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:19:23.268434 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:19:23.279956 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:19:23.291533 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:19:23.302924 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 04:19:23.417660 tst ping_idle_ping.py:24: start network... 04:19:23.613097 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:19:24.069616 run create_hlr_db(pid=23587): Launched 04:19:24.189827 bus /gobi_6: Setting Powered False 04:19:25.249184 run create_hlr_db(pid=23587): Terminated: ok {rc=0} 04:19:25.661124 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23589): Launched 04:19:25.955256 run osmo-hlr_10.42.42.2(pid=23590): Launched 04:19:26.067410 run osmo-stp_10.42.42.5: Starting osmo-stp 04:19:26.576487 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23592): Launched 04:19:26.872278 run osmo-stp_10.42.42.5(pid=23593): Launched 04:19:26.984884 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:19:27.491972 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23595): Launched 04:19:27.604408 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:19:27.851677 run patchelf(pid=23596): Launched 04:19:28.014632 run osmo-stp_10.42.42.5(pid=23593): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23593)] 04:19:28.139176 run osmo-stp_10.42.42.5(pid=23593): stdout: | (launched: 2022-12-09_04:19:26.817784) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:19:28.265412 run osmo-stp_10.42.42.5(pid=23593): stderr: | 20221209041926988 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041926988 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041926988 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041926989 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041926989 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041926989 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041926990 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:19:28.391822 run osmo-stp_10.42.42.5(pid=23593): stdout: | (launched: 2022-12-09_04:19:26.817784) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:19:28.512261 run osmo-stp_10.42.42.5(pid=23593): stderr: | 20221209041926988 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041926988 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041926988 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041926989 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041926989 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041926989 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041926990 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:19:28.655812 run patchelf(pid=23596): Terminating (SIGINT) 04:19:28.821822 run patchelf(pid=23596): Terminated: ok {rc=0} 04:19:28.941107 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=23593): Process ended prematurely: osmo-stp_10.42.42.5(pid=23593) [trial-2354↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23593)] [trial-2354↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 04:19:28.950060 tst ping_idle_ping.py:27: Test FAILED (6.2 sec) 04:19:28.976903 run osmo-hlr_10.42.42.2(pid=23590): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23590)] 04:19:29.024638 run osmo-hlr_10.42.42.2(pid=23590): stdout: | (launched: 2022-12-09_04:19:25.901220) 04:19:29.074058 run osmo-hlr_10.42.42.2(pid=23590): stderr: | 20221209041926074 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209041926074 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209041926074 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209041926074 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209041926074 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209041926074 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209041926086 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209041926095 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209041926095 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209041926095 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:19:29.124051 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23589): Terminating (SIGTERM) 04:19:29.163834 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23592): Terminating (SIGTERM) 04:19:29.203696 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23595): Terminating (SIGTERM) 04:19:29.243759 --- ParallelTerminationStrategy: PID 23589 died... 04:19:29.262995 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23589): Terminated: ok {rc=0} 04:19:29.307159 --- ParallelTerminationStrategy: PID 23592 died... 04:19:29.325871 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23592): Terminated: ok {rc=0} 04:19:29.369808 --- ParallelTerminationStrategy: PID 23595 died... 04:19:29.388256 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23595): Terminated: ok {rc=0} 04:19:29.474666 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2354 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 04:19:30.791722 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:19:30.799277 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 04:19:30.835053 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 04:19:30.894173 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 04:19:30.956328 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 04:19:30.991237 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 04:19:31.029431 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 04:19:31.619852 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2354 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 04:19:31.626107 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:19:31.639226 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 04:19:31.716793 tst switch_tch_pdch.py: using LAC 19022 04:19:31.840281 tst switch_tch_pdch.py: using RAC 152 04:19:31.957461 tst switch_tch_pdch.py: using CellId 19022 04:19:32.125259 tst switch_tch_pdch.py: using BVCI 19023 04:19:32.241971 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:19:32.254142 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:19:32.267056 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:19:32.280060 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:19:32.292758 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:19:32.305455 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:19:32.319426 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:19:32.331701 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:19:32.451632 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:19:32.566576 tst switch_tch_pdch.py:51: start network... 04:19:32.763114 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:19:33.217430 run create_hlr_db(pid=23601): Launched 04:19:33.337829 bus /gobi_6: Setting Powered False 04:19:34.397840 run create_hlr_db(pid=23601): Terminated: ok {rc=0} 04:19:34.828214 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23603): Launched 04:19:35.142187 run osmo-hlr_10.42.42.2(pid=23604): Launched 04:19:35.262607 run osmo-stp_10.42.42.5: Starting osmo-stp 04:19:35.802718 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23606): Launched 04:19:36.116147 run osmo-stp_10.42.42.5(pid=23607): Launched 04:19:36.236765 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:19:36.778809 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23609): Launched 04:19:36.899957 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:19:37.164798 run patchelf(pid=23610): Launched 04:19:37.339974 run osmo-stp_10.42.42.5(pid=23607): ERR: Terminated: ERROR {rc=1} [trial-2354↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23607)] 04:19:37.473578 run osmo-stp_10.42.42.5(pid=23607): stdout: | (launched: 2022-12-09_04:19:36.059282) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:19:37.609428 run osmo-stp_10.42.42.5(pid=23607): stderr: | 20221209041936246 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041936246 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041936246 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041936247 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041936247 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041936247 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041936247 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:19:37.745186 run osmo-stp_10.42.42.5(pid=23607): stdout: | (launched: 2022-12-09_04:19:36.059282) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:19:37.874521 run osmo-stp_10.42.42.5(pid=23607): stderr: | 20221209041936246 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041936246 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041936246 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041936247 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041936247 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041936247 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041936247 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:19:38.027890 run patchelf(pid=23610): Terminating (SIGINT) 04:19:38.204489 run patchelf(pid=23610): Terminated: ok {rc=0} 04:19:38.331963 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=23607): Process ended prematurely: osmo-stp_10.42.42.5(pid=23607) [trial-2354↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23607)] [trial-2354↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 04:19:38.341653 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 04:19:38.370377 run osmo-hlr_10.42.42.2(pid=23604): ERR: Terminated: ERROR {rc=237} [trial-2354↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23604)] 04:19:38.421307 run osmo-hlr_10.42.42.2(pid=23604): stdout: | (launched: 2022-12-09_04:19:35.085427) 04:19:38.474199 run osmo-hlr_10.42.42.2(pid=23604): stderr: | 20221209041935281 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209041935281 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209041935281 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209041935281 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209041935281 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209041935281 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209041935318 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209041935328 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209041935328 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209041935328 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:19:38.527554 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23603): Terminating (SIGTERM) 04:19:38.570367 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23606): Terminating (SIGTERM) 04:19:38.613390 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23609): Terminating (SIGTERM) 04:19:38.656356 --- ParallelTerminationStrategy: PID 23603 died... 04:19:38.676617 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23603): Terminated: ok {rc=0} 04:19:38.723776 --- ParallelTerminationStrategy: PID 23606 died... 04:19:38.743409 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23606): Terminated: ok {rc=0} 04:19:38.790534 --- ParallelTerminationStrategy: PID 23609 died... 04:19:38.810111 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23609): Terminated: ok {rc=0} 04:19:38.899391 bus /gobi_0: Setting Powered False 04:19:39.997940 bus /gobi_0: Setting Powered False 04:19:41.114444 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2354 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 dynts:trx-umtrx+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 04:19:42.373154 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:19:42.379307 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 04:19:42.412721 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 04:19:42.447960 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 04:19:42.499921 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 04:19:42.533117 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 04:19:42.568090 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 04:19:43.122122 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2354 dynts:trx-umtrx+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 04:19:43.127673 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:19:43.138696 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 04:19:43.207101 tst switch_tch_pdch.py: using LAC 19023 04:19:43.323191 tst switch_tch_pdch.py: using RAC 153 04:19:43.438913 tst switch_tch_pdch.py: using CellId 19023 04:19:43.553046 tst switch_tch_pdch.py: using BVCI 19024 04:19:43.658698 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:19:43.669625 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:19:43.680193 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:19:43.690835 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:19:43.701993 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:19:43.712752 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:19:43.723607 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:19:43.734373 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 04:19:43.851013 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 04:19:43.969169 tst switch_tch_pdch.py:51: start network... 04:19:44.180112 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:19:44.638742 run create_hlr_db(pid=23615): Launched 04:19:44.759659 bus /gobi_6: Setting Powered False 04:19:45.822548 run create_hlr_db(pid=23615): Terminated: ok {rc=0} 04:19:46.261911 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23617): Launched 04:19:46.670200 run osmo-hlr_10.42.42.2(pid=23618): Launched 04:19:46.877788 run osmo-stp_10.42.42.5: Starting osmo-stp 04:19:47.531560 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23620): Launched 04:19:47.824503 run osmo-stp_10.42.42.5(pid=23621): Launched 04:19:47.936310 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:19:48.416466 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23623): Launched 04:19:48.528564 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:19:48.775324 run patchelf(pid=23624): Launched 04:19:48.938897 run osmo-stp_10.42.42.5(pid=23621): ERR: Terminated: ERROR {rc=1} [trial-2354↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23621)] 04:19:49.062768 run osmo-stp_10.42.42.5(pid=23621): stdout: | (launched: 2022-12-09_04:19:47.770859) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:19:49.188641 run osmo-stp_10.42.42.5(pid=23621): stderr: | 20221209041947941 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041947941 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041947941 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041947942 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041947942 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041947942 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041947942 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:19:49.314292 run osmo-stp_10.42.42.5(pid=23621): stdout: | (launched: 2022-12-09_04:19:47.770859) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:19:49.434773 run osmo-stp_10.42.42.5(pid=23621): stderr: | 20221209041947941 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209041947941 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209041947941 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209041947942 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209041947942 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209041947942 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209041947942 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:19:49.577299 run patchelf(pid=23624): Terminating (SIGINT) 04:19:49.743130 run patchelf(pid=23624): Terminated: ok {rc=0} 04:19:49.862196 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=23621): Process ended prematurely: osmo-stp_10.42.42.5(pid=23621) [trial-2354↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23621)] [trial-2354↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 04:19:49.871133 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 04:19:49.897624 run osmo-hlr_10.42.42.2(pid=23618): ERR: Terminated: ERROR {rc=237} [trial-2354↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23618)] 04:19:49.945231 run osmo-hlr_10.42.42.2(pid=23618): stdout: | (launched: 2022-12-09_04:19:46.591066) 04:19:49.994519 run osmo-hlr_10.42.42.2(pid=23618): stderr: | 20221209041946999 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209041946999 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209041946999 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209041946999 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209041947000 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209041947000 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209041947021 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/dynts:trx-umtrx+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209041947045 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209041947046 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209041947046 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:19:50.044246 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23617): Terminating (SIGTERM) 04:19:50.083637 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23620): Terminating (SIGTERM) 04:19:50.123510 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23623): Terminating (SIGTERM) 04:19:50.163133 --- ParallelTerminationStrategy: PID 23617 died... 04:19:50.182044 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23617): Terminated: ok {rc=0} 04:19:50.225586 --- ParallelTerminationStrategy: PID 23620 died... 04:19:50.244088 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23620): Terminated: ok {rc=0} 04:19:50.287722 --- ParallelTerminationStrategy: PID 23623 died... 04:19:50.306205 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23623): Terminated: ok {rc=0} 04:19:50.392500 bus /gobi_0: Setting Powered False 04:19:51.492900 bus /gobi_0: Setting Powered False 04:19:52.611647 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2354 dynts:trx-umtrx+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 nitb_sms:trx-lms --------------------------------------------------------------------- 04:19:53.867128 tst nitb_sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:19:53.871193 tst nitb_sms:trx-lms: Verifying 1 x bts (candidates: 11) 04:19:53.905278 tst nitb_sms:trx-lms: Verifying 1 x ip_address (candidates: 9) 04:19:53.912148 tst nitb_sms:trx-lms: Verifying 2 x modem (candidates: 12) 04:19:53.965595 tst nitb_sms:trx-lms: Reserving 1 x bts (candidates: 11) 04:19:53.999946 tst nitb_sms:trx-lms: Reserving 1 x ip_address (candidates: 9) 04:19:54.006809 tst nitb_sms:trx-lms: Reserving 2 x modem (candidates: 12) 04:19:54.543962 tst nitb_sms:trx-lms: RESERVED RESOURCES for nitb_sms: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 nitb_sms:trx-lms mo_mt_sms.py ---------------------------------------------- 04:19:54.549499 tst nitb_sms:trx-lms: Using 1 x ip_address (candidates: 1) 04:19:54.560545 tst nitb_sms:trx-lms: Using 1 x bts (candidates: 1) 04:19:54.609342 tst mo_mt_sms.py: using LAC 19024 04:19:54.735974 tst mo_mt_sms.py: using RAC 154 04:19:54.852878 tst mo_mt_sms.py: using CellId 19024 04:19:54.966218 tst mo_mt_sms.py: using BVCI 19025 04:19:55.072938 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 04:19:55.188890 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 04:19:55.306218 tst mo_mt_sms.py:9: start nitb and bts... 04:19:55.517853 run osmo-nitb_10.42.42.2: Starting osmo-nitb 04:19:56.156749 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23628): Launched 04:19:56.470309 run osmo-nitb_10.42.42.2(pid=23629): Launched 04:19:56.645049 run osmo-nitb_10.42.42.2(pid=23629): ERR: Terminated: ERROR {rc=2} [trial-2354↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23629)] 04:19:56.786104 run osmo-nitb_10.42.42.2(pid=23629): stdout: | (launched: 2022-12-09_04:19:56.413112) 04:19:56.928481 run osmo-nitb_10.42.42.2(pid=23629): stderr: | (launched: 2022-12-09_04:19:56.459886) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:19:57.071210 run osmo-nitb_10.42.42.2(pid=23629): stdout: | (launched: 2022-12-09_04:19:56.413112) 04:19:57.208449 run osmo-nitb_10.42.42.2(pid=23629): stderr: | (launched: 2022-12-09_04:19:56.459886) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f4d467d3268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=23629): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23629) [trial-2354↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23629)] 04:19:57.588791 tst osmo-nitb_10.42.42.2(pid=23629): stdout: | (launched: 2022-12-09_04:19:56.413112) 04:19:57.716103 tst osmo-nitb_10.42.42.2(pid=23629): stderr: | (launched: 2022-12-09_04:19:56.459886) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:19:57.865088 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=23629): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23629) [trial-2354↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23629)] [trial-2354↪nitb_sms:trx-lms↪mo_mt_sms.py:11] 04:19:57.874080 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 04:19:57.881466 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23628): Terminating (SIGTERM) 04:19:58.092893 --- ParallelTerminationStrategy: PID 23628 died... 04:19:58.114409 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23628): Terminated: ok {rc=0} 04:19:58.203174 bus /sierra_3: Setting Powered False 04:19:59.300717 bus /sierra_3: Setting Powered False 04:20:00.416799 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 nitb_sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 sms:trx-lms --------------------------------------------------------------------- 04:20:01.635782 tst sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:20:01.640831 tst sms:trx-lms: Verifying 1 x bts (candidates: 11) 04:20:01.680539 tst sms:trx-lms: Verifying 6 x ip_address (candidates: 9) 04:20:01.712514 tst sms:trx-lms: Verifying 2 x modem (candidates: 12) 04:20:01.771839 tst sms:trx-lms: Reserving 1 x bts (candidates: 11) 04:20:01.810622 tst sms:trx-lms: Reserving 6 x ip_address (candidates: 9) 04:20:01.840562 tst sms:trx-lms: Reserving 2 x modem (candidates: 12) 04:20:02.379178 tst sms:trx-lms: RESERVED RESOURCES for sms: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 sms:trx-lms mo_mt_sms.py ---------------------------------------------- 04:20:02.385405 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 04:20:02.396644 tst sms:trx-lms: Using 1 x bts (candidates: 1) 04:20:02.449427 tst mo_mt_sms.py: using LAC 19025 04:20:02.577814 tst mo_mt_sms.py: using RAC 155 04:20:02.702907 tst mo_mt_sms.py: using CellId 19025 04:20:02.826637 tst mo_mt_sms.py: using BVCI 19026 04:20:02.940868 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 04:20:02.951873 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 04:20:02.962705 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 04:20:02.974237 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 04:20:02.985782 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 04:20:02.997342 tst sms:trx-lms: Using 1 x modem (candidates: 2) 04:20:03.114264 tst sms:trx-lms: Using 1 x modem (candidates: 2) 04:20:03.234694 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:20:03.720780 run create_hlr_db(pid=23636): Launched 04:20:03.841205 bus /sierra_2: Setting Powered False 04:20:04.903397 run create_hlr_db(pid=23636): Terminated: ok {rc=0} 04:20:05.322096 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23638): Launched 04:20:05.614283 run osmo-hlr_10.42.42.2(pid=23639): Launched 04:20:05.727007 run osmo-stp_10.42.42.5: Starting osmo-stp 04:20:06.240873 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23641): Launched 04:20:06.532616 run osmo-stp_10.42.42.5(pid=23642): Launched 04:20:06.643814 run osmo-msc_10.42.42.6: Starting osmo-msc 04:20:07.174009 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23644): Launched 04:20:07.465723 run osmo-msc_10.42.42.6(pid=23645): Launched 04:20:07.628764 run osmo-stp_10.42.42.5(pid=23642): ERR: Terminated: ERROR {rc=1} [trial-2354↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23642)] 04:20:07.753136 run osmo-stp_10.42.42.5(pid=23642): stdout: | (launched: 2022-12-09_04:20:06.478704) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:20:07.877114 run osmo-stp_10.42.42.5(pid=23642): stderr: | 20221209042006650 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042006650 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042006650 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042006650 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042006651 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042006651 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042006651 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:20:07.999383 run osmo-stp_10.42.42.5(pid=23642): stdout: | (launched: 2022-12-09_04:20:06.478704) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:20:08.115836 run osmo-stp_10.42.42.5(pid=23642): stderr: | 20221209042006650 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042006650 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042006650 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042006650 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042006651 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042006651 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042006651 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:20:08.254681 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=23642): Process ended prematurely: osmo-stp_10.42.42.5(pid=23642) [trial-2354↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23642)] [trial-2354↪sms:trx-lms↪mo_mt_sms.py:16] 04:20:08.262827 tst mo_mt_sms.py:16: Test FAILED (5.9 sec) 04:20:08.288655 run osmo-hlr_10.42.42.2(pid=23639): ERR: Terminated: ERROR {rc=237} [trial-2354↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23639)] 04:20:08.336058 run osmo-hlr_10.42.42.2(pid=23639): stdout: | (launched: 2022-12-09_04:20:05.560314) 04:20:08.385248 run osmo-hlr_10.42.42.2(pid=23639): stderr: | 20221209042005733 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209042005733 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209042005733 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209042005733 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209042005733 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209042005733 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209042005745 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/sms:trx-lms/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209042005754 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209042005754 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209042005754 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:20:08.453822 run osmo-msc_10.42.42.6(pid=23645): ERR: Terminated: ERROR {rc=2} [trial-2354↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23645)] 04:20:08.500867 run osmo-msc_10.42.42.6(pid=23645): stdout: | (launched: 2022-12-09_04:20:07.411906) 04:20:08.549882 run osmo-msc_10.42.42.6(pid=23645): stderr: | 20221209042007683 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209042007684 DLGLOBAL DEBUG validating counter group 0x7fc2ab1ffc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209042007684 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209042007684 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209042007684 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209042007684 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209042007686 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209042007687 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209042007687 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209042007687 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:20:08.599441 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23638): Terminating (SIGTERM) 04:20:08.638937 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23641): Terminating (SIGTERM) 04:20:08.678317 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23644): Terminating (SIGTERM) 04:20:08.717873 --- ParallelTerminationStrategy: PID 23638 died... 04:20:08.736899 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23638): Terminated: ok {rc=0} 04:20:08.780487 --- ParallelTerminationStrategy: PID 23641 died... 04:20:08.798955 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23641): Terminated: ok {rc=0} 04:20:08.842782 --- ParallelTerminationStrategy: PID 23644 died... 04:20:08.861193 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23644): Terminated: ok {rc=0} 04:20:08.945466 bus /sierra_3: Setting Powered False 04:20:10.043573 bus /sierra_3: Setting Powered False 04:20:11.161421 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 nitb_ussd:trx-lms --------------------------------------------------------------------- 04:20:12.393896 tst nitb_ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:20:12.398056 tst nitb_ussd:trx-lms: Verifying 1 x bts (candidates: 11) 04:20:12.432851 tst nitb_ussd:trx-lms: Verifying 1 x ip_address (candidates: 9) 04:20:12.439982 tst nitb_ussd:trx-lms: Verifying 1 x modem (candidates: 12) 04:20:12.476483 tst nitb_ussd:trx-lms: Reserving 1 x bts (candidates: 11) 04:20:12.509401 tst nitb_ussd:trx-lms: Reserving 1 x ip_address (candidates: 9) 04:20:12.515938 tst nitb_ussd:trx-lms: Reserving 1 x modem (candidates: 12) 04:20:13.036516 tst nitb_ussd:trx-lms: RESERVED RESOURCES for nitb_ussd: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2354 nitb_ussd:trx-lms assert_extension.py ---------------------------------------------- 04:20:13.041924 tst nitb_ussd:trx-lms: Using 1 x ip_address (candidates: 1) 04:20:13.052879 tst nitb_ussd:trx-lms: Using 1 x bts (candidates: 1) 04:20:13.103554 tst assert_extension.py: using LAC 19026 04:20:13.228648 tst assert_extension.py: using RAC 156 04:20:13.351376 tst assert_extension.py: using CellId 19026 04:20:13.477679 tst assert_extension.py: using BVCI 19027 04:20:13.593747 tst nitb_ussd:trx-lms: Using 1 x modem (candidates: 1) 04:20:13.706367 tst assert_extension.py:10: start nitb and bts... 04:20:13.903149 run osmo-nitb_10.42.42.2: Starting osmo-nitb 04:20:14.503656 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23651): Launched 04:20:14.796010 run osmo-nitb_10.42.42.2(pid=23652): Launched 04:20:14.958488 run osmo-nitb_10.42.42.2(pid=23652): ERR: Terminated: ERROR {rc=2} [trial-2354↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23652)] 04:20:15.090104 run osmo-nitb_10.42.42.2(pid=23652): stdout: | (launched: 2022-12-09_04:20:14.742337) 04:20:15.223286 run osmo-nitb_10.42.42.2(pid=23652): stderr: | (launched: 2022-12-09_04:20:14.785733) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:20:15.356550 run osmo-nitb_10.42.42.2(pid=23652): stdout: | (launched: 2022-12-09_04:20:14.742337) 04:20:15.484209 run osmo-nitb_10.42.42.2(pid=23652): stderr: | (launched: 2022-12-09_04:20:14.785733) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f4d467d3268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=23652): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23652) [trial-2354↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23652)] 04:20:15.906300 tst osmo-nitb_10.42.42.2(pid=23652): stdout: | (launched: 2022-12-09_04:20:14.742337) 04:20:16.048426 tst osmo-nitb_10.42.42.2(pid=23652): stderr: | (launched: 2022-12-09_04:20:14.785733) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:20:16.190724 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=23652): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23652) [trial-2354↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23652)] [trial-2354↪nitb_ussd:trx-lms↪assert_extension.py:12] 04:20:16.200151 tst assert_extension.py:12: Test FAILED (3.2 sec) 04:20:16.207766 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23651): Terminating (SIGTERM) 04:20:16.417800 --- ParallelTerminationStrategy: PID 23651 died... 04:20:16.441106 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23651): Terminated: ok {rc=0} 04:20:16.546760 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 nitb_ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 ussd:trx-lms --------------------------------------------------------------------- 04:20:17.737346 tst ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:20:17.741551 tst ussd:trx-lms: Verifying 1 x bts (candidates: 11) 04:20:17.775757 tst ussd:trx-lms: Verifying 6 x ip_address (candidates: 9) 04:20:17.802876 tst ussd:trx-lms: Verifying 1 x modem (candidates: 12) 04:20:17.837636 tst ussd:trx-lms: Reserving 1 x bts (candidates: 11) 04:20:17.870139 tst ussd:trx-lms: Reserving 6 x ip_address (candidates: 9) 04:20:17.896439 tst ussd:trx-lms: Reserving 1 x modem (candidates: 12) 04:20:18.427239 tst ussd:trx-lms: RESERVED RESOURCES for ussd: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2354 ussd:trx-lms assert_extension.py ---------------------------------------------- 04:20:18.432442 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 04:20:18.443360 tst ussd:trx-lms: Using 1 x bts (candidates: 1) 04:20:18.492683 tst assert_extension.py: using LAC 19027 04:20:18.614215 tst assert_extension.py: using RAC 157 04:20:18.736311 tst assert_extension.py: using CellId 19027 04:20:18.859590 tst assert_extension.py: using BVCI 19028 04:20:18.973405 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 04:20:18.984239 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 04:20:18.995044 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 04:20:19.006059 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 04:20:19.017109 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 04:20:19.028193 tst ussd:trx-lms: Using 1 x modem (candidates: 1) 04:20:19.141503 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:20:19.596854 run create_hlr_db(pid=23656): Launched 04:20:19.717951 bus /sierra_2: Setting Powered False 04:20:20.776928 run create_hlr_db(pid=23656): Terminated: ok {rc=0} 04:20:21.208185 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23658): Launched 04:20:21.523110 run osmo-hlr_10.42.42.2(pid=23659): Launched 04:20:21.644452 run osmo-stp_10.42.42.5: Starting osmo-stp 04:20:22.190130 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23661): Launched 04:20:22.503869 run osmo-stp_10.42.42.5(pid=23662): Launched 04:20:22.625060 run osmo-msc_10.42.42.6: Starting osmo-msc 04:20:23.192133 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23664): Launched 04:20:23.505710 run osmo-msc_10.42.42.6(pid=23665): Launched 04:20:23.682802 run osmo-stp_10.42.42.5(pid=23662): ERR: Terminated: ERROR {rc=1} [trial-2354↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23662)] 04:20:23.817155 run osmo-stp_10.42.42.5(pid=23662): stdout: | (launched: 2022-12-09_04:20:22.446545) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:20:23.952205 run osmo-stp_10.42.42.5(pid=23662): stderr: | 20221209042022638 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042022639 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042022639 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042022639 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042022640 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042022640 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042022640 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:20:24.086228 run osmo-stp_10.42.42.5(pid=23662): stdout: | (launched: 2022-12-09_04:20:22.446545) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:20:24.211617 run osmo-stp_10.42.42.5(pid=23662): stderr: | 20221209042022638 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042022639 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042022639 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042022639 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042022640 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042022640 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042022640 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:20:24.361858 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=23662): Process ended prematurely: osmo-stp_10.42.42.5(pid=23662) [trial-2354↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23662)] [trial-2354↪ussd:trx-lms↪assert_extension.py:17] 04:20:24.370609 tst assert_extension.py:17: Test FAILED (5.9 sec) 04:20:24.398592 run osmo-hlr_10.42.42.2(pid=23659): ERR: Terminated: ERROR {rc=237} [trial-2354↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23659)] 04:20:24.449797 run osmo-hlr_10.42.42.2(pid=23659): stdout: | (launched: 2022-12-09_04:20:21.466023) 04:20:24.502447 run osmo-hlr_10.42.42.2(pid=23659): stderr: | 20221209042021662 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209042021662 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209042021662 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209042021662 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209042021662 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209042021662 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209042021675 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/ussd:trx-lms/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209042021683 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209042021683 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209042021683 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:20:24.576134 run osmo-msc_10.42.42.6(pid=23665): ERR: Terminated: ERROR {rc=2} [trial-2354↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23665)] 04:20:24.627104 run osmo-msc_10.42.42.6(pid=23665): stdout: | (launched: 2022-12-09_04:20:23.448524) 04:20:24.680222 run osmo-msc_10.42.42.6(pid=23665): stderr: | 20221209042023768 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209042023768 DLGLOBAL DEBUG validating counter group 0x7f224c260c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209042023768 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209042023768 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209042023768 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209042023769 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209042023770 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209042023771 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209042023771 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209042023771 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:20:24.733371 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23658): Terminating (SIGTERM) 04:20:24.775778 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23661): Terminating (SIGTERM) 04:20:24.818506 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23664): Terminating (SIGTERM) 04:20:24.861461 --- ParallelTerminationStrategy: PID 23658 died... 04:20:24.881602 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23658): Terminated: ok {rc=0} 04:20:24.928885 --- ParallelTerminationStrategy: PID 23661 died... 04:20:24.948778 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23661): Terminated: ok {rc=0} 04:20:24.995982 --- ParallelTerminationStrategy: PID 23664 died... 04:20:25.015834 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23664): Terminated: ok {rc=0} 04:20:25.106259 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 04:20:26.318772 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:20:26.326431 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 04:20:26.361209 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 04:20:26.388355 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 04:20:26.442826 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 04:20:26.476873 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 04:20:26.504145 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 04:20:27.053873 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 04:20:27.106431 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:20:27.117897 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 04:20:27.189311 tst mo_mt_call.py: using LAC 19028 04:20:27.315565 tst mo_mt_call.py: using RAC 158 04:20:27.439530 tst mo_mt_call.py: using CellId 19028 04:20:27.565565 tst mo_mt_call.py: using BVCI 19029 04:20:27.677581 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:20:27.688640 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:20:27.699914 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:20:27.711545 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:20:27.723174 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:20:27.734589 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 04:20:27.848903 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 04:20:27.964019 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:20:28.428804 run create_hlr_db(pid=23670): Launched 04:20:28.551446 bus /sierra_2: Setting Powered False 04:20:29.611424 run create_hlr_db(pid=23670): Terminated: ok {rc=0} 04:20:30.027877 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23672): Launched 04:20:30.326034 run osmo-hlr_10.42.42.2(pid=23673): Launched 04:20:30.439789 run osmo-stp_10.42.42.5: Starting osmo-stp 04:20:31.021858 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23675): Launched 04:20:31.359421 run osmo-stp_10.42.42.5(pid=23676): Launched 04:20:31.691205 run osmo-msc_10.42.42.6: Starting osmo-msc 04:20:32.241928 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23678): Launched 04:20:32.552388 run osmo-msc_10.42.42.6(pid=23679): Launched 04:20:32.719214 run osmo-stp_10.42.42.5(pid=23676): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23676)] 04:20:32.844790 run osmo-stp_10.42.42.5(pid=23676): stdout: | (launched: 2022-12-09_04:20:31.299017) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:20:32.971495 run osmo-stp_10.42.42.5(pid=23676): stderr: | 20221209042031514 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042031514 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042031514 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042031515 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042031520 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042031520 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042031520 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:20:33.095640 run osmo-stp_10.42.42.5(pid=23676): stdout: | (launched: 2022-12-09_04:20:31.299017) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:20:33.215229 run osmo-stp_10.42.42.5(pid=23676): stderr: | 20221209042031514 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042031514 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042031514 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042031515 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042031520 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042031520 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042031520 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:20:33.357629 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23676): Process ended prematurely: osmo-stp_10.42.42.5(pid=23676) [trial-2354↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23676)] [trial-2354↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 04:20:33.366573 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 04:20:33.393330 run osmo-hlr_10.42.42.2(pid=23673): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23673)] 04:20:33.441977 run osmo-hlr_10.42.42.2(pid=23673): stdout: | (launched: 2022-12-09_04:20:30.271183) 04:20:33.491851 run osmo-hlr_10.42.42.2(pid=23673): stderr: | 20221209042030445 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209042030445 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209042030445 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209042030445 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209042030445 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209042030445 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209042030457 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209042030466 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209042030466 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209042030467 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:20:33.561518 run osmo-msc_10.42.42.6(pid=23679): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23679)] 04:20:33.609650 run osmo-msc_10.42.42.6(pid=23679): stdout: | (launched: 2022-12-09_04:20:32.497430) 04:20:33.659689 run osmo-msc_10.42.42.6(pid=23679): stderr: | 20221209042032772 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209042032773 DLGLOBAL DEBUG validating counter group 0x7f4714f30c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209042032773 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209042032773 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209042032773 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209042032773 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209042032775 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209042032775 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209042032775 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209042032775 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:20:33.709907 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23672): Terminating (SIGTERM) 04:20:33.749843 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23675): Terminating (SIGTERM) 04:20:33.789505 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23678): Terminating (SIGTERM) 04:20:33.829944 --- ParallelTerminationStrategy: PID 23672 died... 04:20:33.849111 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23672): Terminated: ok {rc=0} 04:20:33.893743 --- ParallelTerminationStrategy: PID 23675 died... 04:20:33.912465 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23675): Terminated: ok {rc=0} 04:20:33.957288 --- ParallelTerminationStrategy: PID 23678 died... 04:20:33.976221 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23678): Terminated: ok {rc=0} 04:20:34.063290 bus /sierra_3: Setting Powered False 04:20:35.164581 bus /sierra_3: Setting Powered False 04:20:36.282918 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2354 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 04:20:37.427443 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:20:37.439106 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 04:20:37.509085 tst mo_mt_call_osmux.py: using LAC 19029 04:20:37.634247 tst mo_mt_call_osmux.py: using RAC 159 04:20:37.762650 tst mo_mt_call_osmux.py: using CellId 19029 04:20:37.887076 tst mo_mt_call_osmux.py: using BVCI 19030 04:20:38.002889 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:20:38.014336 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:20:38.025574 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:20:38.037066 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:20:38.048505 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:20:38.059863 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 04:20:38.179058 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 04:20:38.298732 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:20:38.763384 run create_hlr_db(pid=23681): Launched 04:20:38.886820 bus /sierra_2: Setting Powered False 04:20:39.947937 run create_hlr_db(pid=23681): Terminated: ok {rc=0} 04:20:40.365776 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23683): Launched 04:20:40.664550 run osmo-hlr_10.42.42.2(pid=23684): Launched 04:20:40.778872 run osmo-stp_10.42.42.5: Starting osmo-stp 04:20:41.296347 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23686): Launched 04:20:41.596483 run osmo-stp_10.42.42.5(pid=23687): Launched 04:20:41.712713 run osmo-msc_10.42.42.6: Starting osmo-msc 04:20:42.254714 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23689): Launched 04:20:42.553675 run osmo-msc_10.42.42.6(pid=23690): Launched 04:20:42.722726 run osmo-stp_10.42.42.5(pid=23687): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23687)] 04:20:42.848943 run osmo-stp_10.42.42.5(pid=23687): stdout: | (launched: 2022-12-09_04:20:41.541415) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:20:42.976155 run osmo-stp_10.42.42.5(pid=23687): stderr: | 20221209042041712 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042041712 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042041712 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042041713 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042041713 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042041713 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042041713 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:20:43.101266 run osmo-stp_10.42.42.5(pid=23687): stdout: | (launched: 2022-12-09_04:20:41.541415) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:20:43.221085 run osmo-stp_10.42.42.5(pid=23687): stderr: | 20221209042041712 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042041712 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042041712 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042041713 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042041713 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042041713 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042041713 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:20:43.364055 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23687): Process ended prematurely: osmo-stp_10.42.42.5(pid=23687) [trial-2354↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23687)] [trial-2354↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 04:20:43.373150 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 04:20:43.400120 run osmo-hlr_10.42.42.2(pid=23684): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23684)] 04:20:43.448656 run osmo-hlr_10.42.42.2(pid=23684): stdout: | (launched: 2022-12-09_04:20:40.609599) 04:20:43.498741 run osmo-hlr_10.42.42.2(pid=23684): stderr: | 20221209042040784 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209042040784 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209042040784 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209042040784 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209042040784 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209042040784 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209042040799 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209042040810 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209042040811 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209042040811 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:20:43.568638 run osmo-msc_10.42.42.6(pid=23690): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23690)] 04:20:43.617105 run osmo-msc_10.42.42.6(pid=23690): stdout: | (launched: 2022-12-09_04:20:42.498723) 04:20:43.667144 run osmo-msc_10.42.42.6(pid=23690): stderr: | 20221209042042771 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209042042771 DLGLOBAL DEBUG validating counter group 0x7f4cf2f1cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209042042771 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209042042771 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209042042772 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209042042773 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209042042775 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209042042775 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209042042775 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209042042775 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:20:43.718096 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23683): Terminating (SIGTERM) 04:20:43.758231 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23686): Terminating (SIGTERM) 04:20:43.798457 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23689): Terminating (SIGTERM) 04:20:43.838895 --- ParallelTerminationStrategy: PID 23683 died... 04:20:43.858136 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23683): Terminated: ok {rc=0} 04:20:43.902909 --- ParallelTerminationStrategy: PID 23686 died... 04:20:43.921688 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23686): Terminated: ok {rc=0} 04:20:43.966036 --- ParallelTerminationStrategy: PID 23689 died... 04:20:43.984861 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23689): Terminated: ok {rc=0} 04:20:44.069224 bus /sierra_3: Setting Powered False 04:20:45.167652 bus /sierra_3: Setting Powered False 04:20:46.287894 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 04:20:47.543036 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:20:47.550466 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 04:20:47.584587 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 04:20:47.611944 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 04:20:47.662637 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 04:20:47.696770 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 04:20:47.723972 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 04:20:48.277788 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 04:20:48.329271 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:20:48.340619 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 04:20:48.414333 tst mo_mt_call.py: using LAC 19030 04:20:48.538250 tst mo_mt_call.py: using RAC 160 04:20:48.662459 tst mo_mt_call.py: using CellId 19030 04:20:48.786196 tst mo_mt_call.py: using BVCI 19031 04:20:48.901816 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:20:48.913222 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:20:48.924476 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:20:48.936004 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:20:48.947611 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:20:48.959103 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 04:20:49.074527 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 04:20:49.192118 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:20:49.689529 run create_hlr_db(pid=23695): Launched 04:20:49.813295 bus /sierra_2: Setting Powered False 04:20:50.876763 run create_hlr_db(pid=23695): Terminated: ok {rc=0} 04:20:51.306136 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23697): Launched 04:20:51.606039 run osmo-hlr_10.42.42.2(pid=23698): Launched 04:20:51.722853 run osmo-stp_10.42.42.5: Starting osmo-stp 04:20:52.237269 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23700): Launched 04:20:52.535335 run osmo-stp_10.42.42.5(pid=23701): Launched 04:20:52.649444 run osmo-msc_10.42.42.6: Starting osmo-msc 04:20:53.190679 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23703): Launched 04:20:53.490481 run osmo-msc_10.42.42.6(pid=23704): Launched 04:20:53.657786 run osmo-stp_10.42.42.5(pid=23701): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23701)] 04:20:53.786847 run osmo-stp_10.42.42.5(pid=23701): stdout: | (launched: 2022-12-09_04:20:52.480436) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:20:53.913215 run osmo-stp_10.42.42.5(pid=23701): stderr: | 20221209042052650 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042052650 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042052651 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042052651 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042052652 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042052652 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042052652 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:20:54.037728 run osmo-stp_10.42.42.5(pid=23701): stdout: | (launched: 2022-12-09_04:20:52.480436) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:20:54.156630 run osmo-stp_10.42.42.5(pid=23701): stderr: | 20221209042052650 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042052650 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042052651 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042052651 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042052652 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042052652 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042052652 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:20:54.298931 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23701): Process ended prematurely: osmo-stp_10.42.42.5(pid=23701) [trial-2354↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23701)] [trial-2354↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 04:20:54.307926 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 04:20:54.334605 run osmo-hlr_10.42.42.2(pid=23698): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23698)] 04:20:54.382638 run osmo-hlr_10.42.42.2(pid=23698): stdout: | (launched: 2022-12-09_04:20:51.551008) 04:20:54.432454 run osmo-hlr_10.42.42.2(pid=23698): stderr: | 20221209042051726 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209042051726 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209042051727 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209042051727 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209042051727 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209042051727 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209042051739 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209042051747 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209042051748 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209042051748 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:20:54.501478 run osmo-msc_10.42.42.6(pid=23704): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23704)] 04:20:54.549097 run osmo-msc_10.42.42.6(pid=23704): stdout: | (launched: 2022-12-09_04:20:53.434775) 04:20:54.598200 run osmo-msc_10.42.42.6(pid=23704): stderr: | 20221209042053706 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209042053706 DLGLOBAL DEBUG validating counter group 0x7f1ede9c1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209042053707 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209042053707 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209042053707 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209042053707 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209042053709 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209042053709 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209042053709 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209042053709 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:20:54.647773 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23697): Terminating (SIGTERM) 04:20:54.687747 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23700): Terminating (SIGTERM) 04:20:54.727581 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23703): Terminating (SIGTERM) 04:20:54.767657 --- ParallelTerminationStrategy: PID 23697 died... 04:20:54.786736 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23697): Terminated: ok {rc=0} 04:20:54.830766 --- ParallelTerminationStrategy: PID 23700 died... 04:20:54.849347 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23700): Terminated: ok {rc=0} 04:20:54.893543 --- ParallelTerminationStrategy: PID 23703 died... 04:20:54.912294 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23703): Terminated: ok {rc=0} 04:20:54.996801 bus /sierra_3: Setting Powered False 04:20:56.096026 bus /sierra_3: Setting Powered False 04:20:57.216388 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2354 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 04:20:58.361864 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:20:58.373547 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 04:20:58.441492 tst mo_mt_call_osmux.py: using LAC 19031 04:20:58.558904 tst mo_mt_call_osmux.py: using RAC 161 04:20:58.677280 tst mo_mt_call_osmux.py: using CellId 19031 04:20:58.803388 tst mo_mt_call_osmux.py: using BVCI 19032 04:20:58.919254 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:20:58.930657 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:20:58.942201 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:20:58.953830 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:20:58.965966 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:20:58.977683 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 04:20:59.096262 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 04:20:59.215715 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:20:59.713027 run create_hlr_db(pid=23706): Launched 04:20:59.836222 bus /sierra_2: Setting Powered False 04:21:00.919415 run create_hlr_db(pid=23706): Terminated: ok {rc=0} 04:21:01.377718 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23709): Launched 04:21:01.729784 run osmo-hlr_10.42.42.2(pid=23710): Launched 04:21:01.960474 run osmo-stp_10.42.42.5: Starting osmo-stp 04:21:02.529933 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23712): Launched 04:21:02.828224 run osmo-stp_10.42.42.5(pid=23713): Launched 04:21:02.941992 run osmo-msc_10.42.42.6: Starting osmo-msc 04:21:03.482577 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23715): Launched 04:21:03.780627 run osmo-msc_10.42.42.6(pid=23716): Launched 04:21:03.947429 run osmo-stp_10.42.42.5(pid=23713): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23713)] 04:21:04.074518 run osmo-stp_10.42.42.5(pid=23713): stdout: | (launched: 2022-12-09_04:21:02.773415) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:21:04.201130 run osmo-stp_10.42.42.5(pid=23713): stderr: | 20221209042102945 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042102945 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042102945 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042102946 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042102946 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042102946 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042102946 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:21:04.325171 run osmo-stp_10.42.42.5(pid=23713): stdout: | (launched: 2022-12-09_04:21:02.773415) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:21:04.443732 run osmo-stp_10.42.42.5(pid=23713): stderr: | 20221209042102945 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042102945 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042102945 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042102946 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042102946 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042102946 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042102946 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:21:04.585862 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23713): Process ended prematurely: osmo-stp_10.42.42.5(pid=23713) [trial-2354↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23713)] [trial-2354↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 04:21:04.594618 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 04:21:04.621225 run osmo-hlr_10.42.42.2(pid=23710): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23710)] 04:21:04.669030 run osmo-hlr_10.42.42.2(pid=23710): stdout: | (launched: 2022-12-09_04:21:01.655837) 04:21:04.718894 run osmo-hlr_10.42.42.2(pid=23710): stderr: | 20221209042101905 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209042101905 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209042101905 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209042101905 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209042101905 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209042101905 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209042101919 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209042101939 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209042101940 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209042101940 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:21:04.788134 run osmo-msc_10.42.42.6(pid=23716): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23716)] 04:21:04.836016 run osmo-msc_10.42.42.6(pid=23716): stdout: | (launched: 2022-12-09_04:21:03.725969) 04:21:04.885430 run osmo-msc_10.42.42.6(pid=23716): stderr: | 20221209042103998 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209042103999 DLGLOBAL DEBUG validating counter group 0x7fab467c2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209042103999 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209042103999 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209042103999 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209042103999 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209042104001 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209042104001 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209042104002 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209042104002 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:21:04.934990 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23709): Terminating (SIGTERM) 04:21:04.974567 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23712): Terminating (SIGTERM) 04:21:05.014268 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23715): Terminating (SIGTERM) 04:21:05.054277 --- ParallelTerminationStrategy: PID 23709 died... 04:21:05.073347 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23709): Terminated: ok {rc=0} 04:21:05.117251 --- ParallelTerminationStrategy: PID 23712 died... 04:21:05.135786 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23712): Terminated: ok {rc=0} 04:21:05.179422 --- ParallelTerminationStrategy: PID 23715 died... 04:21:05.197912 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23715): Terminated: ok {rc=0} 04:21:05.282043 bus /sierra_3: Setting Powered False 04:21:06.380043 bus /sierra_3: Setting Powered False 04:21:07.498155 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 04:21:08.743936 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:21:08.750431 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 04:21:08.782724 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 04:21:08.808850 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 04:21:08.860285 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 04:21:08.892654 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 04:21:08.918560 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 04:21:09.470803 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 04:21:09.518418 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:21:09.529526 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 04:21:09.598504 tst mo_mt_call.py: using LAC 19032 04:21:09.721886 tst mo_mt_call.py: using RAC 162 04:21:09.838673 tst mo_mt_call.py: using CellId 19032 04:21:09.955940 tst mo_mt_call.py: using BVCI 19033 04:21:10.063690 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:21:10.074679 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:21:10.085537 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:21:10.096321 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:21:10.107107 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:21:10.117840 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 04:21:10.237233 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 04:21:10.355443 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:21:10.819762 run create_hlr_db(pid=23721): Launched 04:21:10.942364 bus /sierra_2: Setting Powered False 04:21:12.002726 run create_hlr_db(pid=23721): Terminated: ok {rc=0} 04:21:12.441486 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23723): Launched 04:21:12.764662 run osmo-hlr_10.42.42.2(pid=23724): Launched 04:21:12.888020 run osmo-stp_10.42.42.5: Starting osmo-stp 04:21:13.443101 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23726): Launched 04:21:13.763996 run osmo-stp_10.42.42.5(pid=23727): Launched 04:21:13.886130 run osmo-msc_10.42.42.6: Starting osmo-msc 04:21:14.464670 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23729): Launched 04:21:14.785067 run osmo-msc_10.42.42.6(pid=23730): Launched 04:21:14.963481 run osmo-stp_10.42.42.5(pid=23727): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23727)] 04:21:15.099342 run osmo-stp_10.42.42.5(pid=23727): stdout: | (launched: 2022-12-09_04:21:13.705923) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:21:15.235620 run osmo-stp_10.42.42.5(pid=23727): stderr: | 20221209042113898 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042113898 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042113899 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042113899 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042113899 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042113900 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042113900 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:21:15.370939 run osmo-stp_10.42.42.5(pid=23727): stdout: | (launched: 2022-12-09_04:21:13.705923) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:21:15.499151 run osmo-stp_10.42.42.5(pid=23727): stderr: | 20221209042113898 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042113898 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042113899 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042113899 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042113899 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042113900 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042113900 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:21:15.651954 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23727): Process ended prematurely: osmo-stp_10.42.42.5(pid=23727) [trial-2354↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23727)] [trial-2354↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 04:21:15.661911 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 04:21:15.690858 run osmo-hlr_10.42.42.2(pid=23724): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23724)] 04:21:15.742021 run osmo-hlr_10.42.42.2(pid=23724): stdout: | (launched: 2022-12-09_04:21:12.706452) 04:21:15.794844 run osmo-hlr_10.42.42.2(pid=23724): stderr: | 20221209042112907 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209042112907 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209042112907 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209042112907 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209042112907 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209042112908 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209042112921 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209042112931 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209042112931 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209042112931 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:21:15.874869 run osmo-msc_10.42.42.6(pid=23730): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23730)] 04:21:15.931893 run osmo-msc_10.42.42.6(pid=23730): stdout: | (launched: 2022-12-09_04:21:14.726727) 04:21:15.986437 run osmo-msc_10.42.42.6(pid=23730): stderr: | 20221209042115047 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209042115047 DLGLOBAL DEBUG validating counter group 0x7fd9b81b0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209042115047 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209042115047 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209042115047 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209042115048 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209042115049 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209042115050 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209042115050 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209042115050 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:21:16.041628 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23723): Terminating (SIGTERM) 04:21:16.086753 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23726): Terminating (SIGTERM) 04:21:16.132102 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23729): Terminating (SIGTERM) 04:21:16.176626 --- ParallelTerminationStrategy: PID 23723 died... 04:21:16.197871 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23723): Terminated: ok {rc=0} 04:21:16.247187 --- ParallelTerminationStrategy: PID 23726 died... 04:21:16.267842 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23726): Terminated: ok {rc=0} 04:21:16.316130 --- ParallelTerminationStrategy: PID 23729 died... 04:21:16.337173 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23729): Terminated: ok {rc=0} 04:21:16.430812 bus /sierra_3: Setting Powered False 04:21:17.531474 bus /sierra_3: Setting Powered False 04:21:18.647850 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2354 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 04:21:19.797628 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:21:19.809622 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 04:21:19.880543 tst mo_mt_call_osmux.py: using LAC 19033 04:21:20.007586 tst mo_mt_call_osmux.py: using RAC 163 04:21:20.134195 tst mo_mt_call_osmux.py: using CellId 19033 04:21:20.259491 tst mo_mt_call_osmux.py: using BVCI 19034 04:21:20.377414 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:21:20.388725 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:21:20.400101 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:21:20.411704 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:21:20.423281 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:21:20.434802 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 04:21:20.552297 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 04:21:20.672709 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:21:21.169537 run create_hlr_db(pid=23732): Launched 04:21:21.292380 bus /sierra_2: Setting Powered False 04:21:22.355625 run create_hlr_db(pid=23732): Terminated: ok {rc=0} 04:21:22.784520 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23734): Launched 04:21:23.084190 run osmo-hlr_10.42.42.2(pid=23735): Launched 04:21:23.198829 run osmo-stp_10.42.42.5: Starting osmo-stp 04:21:23.726889 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23737): Launched 04:21:24.025511 run osmo-stp_10.42.42.5(pid=23738): Launched 04:21:24.140321 run osmo-msc_10.42.42.6: Starting osmo-msc 04:21:24.681043 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23740): Launched 04:21:24.979895 run osmo-msc_10.42.42.6(pid=23741): Launched 04:21:25.147224 run osmo-stp_10.42.42.5(pid=23738): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23738)] 04:21:25.273312 run osmo-stp_10.42.42.5(pid=23738): stdout: | (launched: 2022-12-09_04:21:23.970636) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:21:25.399749 run osmo-stp_10.42.42.5(pid=23738): stderr: | 20221209042124143 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042124143 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042124143 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042124144 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042124144 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042124144 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042124144 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:21:25.524309 run osmo-stp_10.42.42.5(pid=23738): stdout: | (launched: 2022-12-09_04:21:23.970636) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:21:25.643789 run osmo-stp_10.42.42.5(pid=23738): stderr: | 20221209042124143 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042124143 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042124143 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042124144 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042124144 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042124144 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042124144 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:21:25.785945 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23738): Process ended prematurely: osmo-stp_10.42.42.5(pid=23738) [trial-2354↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23738)] [trial-2354↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 04:21:25.794673 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 04:21:25.824172 run osmo-hlr_10.42.42.2(pid=23735): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23735)] 04:21:25.876099 run osmo-hlr_10.42.42.2(pid=23735): stdout: | (launched: 2022-12-09_04:21:23.029468) 04:21:25.929816 run osmo-hlr_10.42.42.2(pid=23735): stderr: | 20221209042123208 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209042123208 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209042123208 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209042123208 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209042123208 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209042123208 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209042123220 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209042123231 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209042123231 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209042123231 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:21:26.004137 run osmo-msc_10.42.42.6(pid=23741): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23741)] 04:21:26.055911 run osmo-msc_10.42.42.6(pid=23741): stdout: | (launched: 2022-12-09_04:21:24.925278) 04:21:26.109755 run osmo-msc_10.42.42.6(pid=23741): stderr: | 20221209042125198 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209042125198 DLGLOBAL DEBUG validating counter group 0x7f23bcabcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209042125198 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209042125198 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209042125199 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209042125199 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209042125201 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209042125201 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209042125201 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209042125201 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:21:26.163598 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23734): Terminating (SIGTERM) 04:21:26.206747 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23737): Terminating (SIGTERM) 04:21:26.249844 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23740): Terminating (SIGTERM) 04:21:26.293429 --- ParallelTerminationStrategy: PID 23734 died... 04:21:26.313708 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23734): Terminated: ok {rc=0} 04:21:26.362064 --- ParallelTerminationStrategy: PID 23737 died... 04:21:26.381808 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23737): Terminated: ok {rc=0} 04:21:26.430059 --- ParallelTerminationStrategy: PID 23740 died... 04:21:26.449862 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23740): Terminated: ok {rc=0} 04:21:26.541424 bus /sierra_3: Setting Powered False 04:21:27.640687 bus /sierra_3: Setting Powered False 04:21:28.762336 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 04:21:30.009775 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:21:30.016165 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 04:21:30.048681 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 04:21:30.074828 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 04:21:30.127763 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 04:21:30.162853 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 04:21:30.190439 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 04:21:30.734696 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 04:21:30.782362 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:21:30.793387 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 04:21:30.872366 tst mo_mt_call.py: using LAC 19034 04:21:31.003070 tst mo_mt_call.py: using RAC 164 04:21:31.120854 tst mo_mt_call.py: using CellId 19034 04:21:31.292236 tst mo_mt_call.py: using BVCI 19035 04:21:31.412800 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:21:31.425316 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:21:31.437739 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:21:31.451012 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:21:31.464445 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:21:31.478538 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 04:21:31.605629 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 04:21:31.766529 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:21:32.248355 run create_hlr_db(pid=23746): Launched 04:21:32.388364 bus /sierra_2: Setting Powered False 04:21:33.448787 run create_hlr_db(pid=23746): Terminated: ok {rc=0} 04:21:33.866215 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23748): Launched 04:21:34.164300 run osmo-hlr_10.42.42.2(pid=23749): Launched 04:21:34.277451 run osmo-stp_10.42.42.5: Starting osmo-stp 04:21:34.804561 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23751): Launched 04:21:35.102146 run osmo-stp_10.42.42.5(pid=23752): Launched 04:21:35.215891 run osmo-msc_10.42.42.6: Starting osmo-msc 04:21:35.755015 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23754): Launched 04:21:36.052811 run osmo-msc_10.42.42.6(pid=23755): Launched 04:21:36.219619 run osmo-stp_10.42.42.5(pid=23752): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23752)] 04:21:36.345713 run osmo-stp_10.42.42.5(pid=23752): stdout: | (launched: 2022-12-09_04:21:35.047620) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:21:36.472055 run osmo-stp_10.42.42.5(pid=23752): stderr: | 20221209042135217 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042135217 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042135217 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042135217 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042135218 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042135218 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042135218 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:21:36.595981 run osmo-stp_10.42.42.5(pid=23752): stdout: | (launched: 2022-12-09_04:21:35.047620) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:21:36.714522 run osmo-stp_10.42.42.5(pid=23752): stderr: | 20221209042135217 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042135217 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042135217 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042135217 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042135218 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042135218 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042135218 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:21:36.856193 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23752): Process ended prematurely: osmo-stp_10.42.42.5(pid=23752) [trial-2354↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23752)] [trial-2354↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 04:21:36.865036 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 04:21:36.891712 run osmo-hlr_10.42.42.2(pid=23749): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23749)] 04:21:36.939817 run osmo-hlr_10.42.42.2(pid=23749): stdout: | (launched: 2022-12-09_04:21:34.109377) 04:21:36.989660 run osmo-hlr_10.42.42.2(pid=23749): stderr: | 20221209042134286 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209042134286 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209042134286 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209042134286 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209042134287 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209042134287 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209042134300 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209042134308 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209042134309 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209042134309 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:21:37.059460 run osmo-msc_10.42.42.6(pid=23755): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23755)] 04:21:37.107706 run osmo-msc_10.42.42.6(pid=23755): stdout: | (launched: 2022-12-09_04:21:35.997854) 04:21:37.157456 run osmo-msc_10.42.42.6(pid=23755): stderr: | 20221209042136267 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209042136268 DLGLOBAL DEBUG validating counter group 0x7fdefcb96c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209042136268 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209042136268 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209042136269 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209042136269 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209042136271 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209042136271 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209042136272 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209042136272 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:21:37.207599 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23748): Terminating (SIGTERM) 04:21:37.247163 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23751): Terminating (SIGTERM) 04:21:37.286608 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23754): Terminating (SIGTERM) 04:21:37.326355 --- ParallelTerminationStrategy: PID 23748 died... 04:21:37.345470 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23748): Terminated: ok {rc=0} 04:21:37.389391 --- ParallelTerminationStrategy: PID 23751 died... 04:21:37.407853 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23751): Terminated: ok {rc=0} 04:21:37.452672 --- ParallelTerminationStrategy: PID 23754 died... 04:21:37.471516 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23754): Terminated: ok {rc=0} 04:21:37.556204 bus /sierra_3: Setting Powered False 04:21:38.655217 bus /sierra_3: Setting Powered False 04:21:39.777451 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2354 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 04:21:40.923886 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:21:40.935488 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 04:21:41.007856 tst mo_mt_call_osmux.py: using LAC 19035 04:21:41.124729 tst mo_mt_call_osmux.py: using RAC 165 04:21:41.240692 tst mo_mt_call_osmux.py: using CellId 19035 04:21:41.357101 tst mo_mt_call_osmux.py: using BVCI 19036 04:21:41.464911 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:21:41.475998 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:21:41.486817 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:21:41.497582 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:21:41.508339 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:21:41.519413 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 04:21:41.633556 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 04:21:41.753393 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:21:42.217243 run create_hlr_db(pid=23757): Launched 04:21:42.339881 bus /sierra_2: Setting Powered False 04:21:43.404650 run create_hlr_db(pid=23757): Terminated: ok {rc=0} 04:21:43.834717 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23759): Launched 04:21:44.133771 run osmo-hlr_10.42.42.2(pid=23760): Launched 04:21:44.246974 run osmo-stp_10.42.42.5: Starting osmo-stp 04:21:44.774534 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23762): Launched 04:21:45.072627 run osmo-stp_10.42.42.5(pid=23763): Launched 04:21:45.186220 run osmo-msc_10.42.42.6: Starting osmo-msc 04:21:45.726917 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23765): Launched 04:21:46.063566 run osmo-msc_10.42.42.6(pid=23766): Launched 04:21:46.423058 run osmo-stp_10.42.42.5(pid=23763): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23763)] 04:21:46.651030 run osmo-stp_10.42.42.5(pid=23763): stdout: | (launched: 2022-12-09_04:21:45.017876) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:21:46.863021 run osmo-stp_10.42.42.5(pid=23763): stderr: | 20221209042145189 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042145189 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042145189 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042145190 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042145190 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042145190 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042145190 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:21:47.065623 run osmo-stp_10.42.42.5(pid=23763): stdout: | (launched: 2022-12-09_04:21:45.017876) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:21:47.187945 run osmo-stp_10.42.42.5(pid=23763): stderr: | 20221209042145189 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042145189 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042145189 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042145190 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042145190 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042145190 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042145190 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:21:47.333001 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23763): Process ended prematurely: osmo-stp_10.42.42.5(pid=23763) [trial-2354↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23763)] [trial-2354↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 04:21:47.342030 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 04:21:47.368924 run osmo-hlr_10.42.42.2(pid=23760): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23760)] 04:21:47.417099 run osmo-hlr_10.42.42.2(pid=23760): stdout: | (launched: 2022-12-09_04:21:44.078866) 04:21:47.466847 run osmo-hlr_10.42.42.2(pid=23760): stderr: | 20221209042144253 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209042144253 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209042144253 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209042144253 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209042144253 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209042144253 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209042144264 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209042144273 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209042144273 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209042144273 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:21:47.536758 run osmo-msc_10.42.42.6(pid=23766): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23766)] 04:21:47.585259 run osmo-msc_10.42.42.6(pid=23766): stdout: | (launched: 2022-12-09_04:21:45.998004) 04:21:47.635251 run osmo-msc_10.42.42.6(pid=23766): stderr: | 20221209042146562 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209042146562 DLGLOBAL DEBUG validating counter group 0x7fe1f50a9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209042146562 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209042146562 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209042146562 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209042146563 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209042146564 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209042146565 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209042146565 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209042146565 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:21:47.685718 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23759): Terminating (SIGTERM) 04:21:47.726442 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23762): Terminating (SIGTERM) 04:21:47.767087 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23765): Terminating (SIGTERM) 04:21:47.807698 --- ParallelTerminationStrategy: PID 23759 died... 04:21:47.827261 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23759): Terminated: ok {rc=0} 04:21:47.872156 --- ParallelTerminationStrategy: PID 23762 died... 04:21:47.891123 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23762): Terminated: ok {rc=0} 04:21:47.935952 --- ParallelTerminationStrategy: PID 23765 died... 04:21:47.955030 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23765): Terminated: ok {rc=0} 04:21:48.043151 bus /sierra_3: Setting Powered False 04:21:49.144763 bus /sierra_3: Setting Powered False 04:21:50.261881 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 04:21:51.515532 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:21:51.521779 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 04:21:51.554422 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 04:21:51.580386 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 04:21:51.632688 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 04:21:51.665477 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 04:21:51.691256 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 04:21:52.239185 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 04:21:52.286959 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:21:52.297941 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 04:21:52.365367 tst mo_mt_call.py: using LAC 19036 04:21:52.482437 tst mo_mt_call.py: using RAC 166 04:21:52.601148 tst mo_mt_call.py: using CellId 19036 04:21:52.721754 tst mo_mt_call.py: using BVCI 19037 04:21:52.840449 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:21:52.851998 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:21:52.863345 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:21:52.874973 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:21:52.886760 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:21:52.898346 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 04:21:53.014441 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 04:21:53.133771 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:21:53.597297 run create_hlr_db(pid=23772): Launched 04:21:53.721086 bus /sierra_2: Setting Powered False 04:21:54.781561 run create_hlr_db(pid=23772): Terminated: ok {rc=0} 04:21:55.218194 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23774): Launched 04:21:55.538634 run osmo-hlr_10.42.42.2(pid=23775): Launched 04:21:55.662279 run osmo-stp_10.42.42.5: Starting osmo-stp 04:21:56.216533 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23777): Launched 04:21:56.536812 run osmo-stp_10.42.42.5(pid=23778): Launched 04:21:56.659951 run osmo-msc_10.42.42.6: Starting osmo-msc 04:21:57.244335 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23780): Launched 04:21:57.565482 run osmo-msc_10.42.42.6(pid=23781): Launched 04:21:57.746730 run osmo-stp_10.42.42.5(pid=23778): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23778)] 04:21:57.882467 run osmo-stp_10.42.42.5(pid=23778): stdout: | (launched: 2022-12-09_04:21:56.478692) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:21:58.019287 run osmo-stp_10.42.42.5(pid=23778): stderr: | 20221209042156671 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042156671 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042156671 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042156672 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042156672 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042156672 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042156672 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:21:58.155306 run osmo-stp_10.42.42.5(pid=23778): stdout: | (launched: 2022-12-09_04:21:56.478692) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:21:58.283561 run osmo-stp_10.42.42.5(pid=23778): stderr: | 20221209042156671 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042156671 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042156671 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042156672 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042156672 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042156672 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042156672 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:21:58.436728 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23778): Process ended prematurely: osmo-stp_10.42.42.5(pid=23778) [trial-2354↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23778)] [trial-2354↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 04:21:58.446438 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 04:21:58.475103 run osmo-hlr_10.42.42.2(pid=23775): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23775)] 04:21:58.525988 run osmo-hlr_10.42.42.2(pid=23775): stdout: | (launched: 2022-12-09_04:21:55.480543) 04:21:58.578939 run osmo-hlr_10.42.42.2(pid=23775): stderr: | 20221209042155678 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209042155678 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209042155678 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209042155678 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209042155678 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209042155678 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209042155692 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209042155702 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209042155702 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209042155702 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:21:58.652543 run osmo-msc_10.42.42.6(pid=23781): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23781)] 04:21:58.704547 run osmo-msc_10.42.42.6(pid=23781): stdout: | (launched: 2022-12-09_04:21:57.507003) 04:21:58.757559 run osmo-msc_10.42.42.6(pid=23781): stderr: | 20221209042157830 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209042157830 DLGLOBAL DEBUG validating counter group 0x7f8acaf10c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209042157830 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209042157830 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209042157830 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209042157830 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209042157832 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209042157832 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209042157833 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209042157833 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:21:58.810669 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23774): Terminating (SIGTERM) 04:21:58.853139 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23777): Terminating (SIGTERM) 04:21:58.895551 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23780): Terminating (SIGTERM) 04:21:58.938397 --- ParallelTerminationStrategy: PID 23774 died... 04:21:58.958586 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23774): Terminated: ok {rc=0} 04:21:59.005714 --- ParallelTerminationStrategy: PID 23777 died... 04:21:59.025468 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23777): Terminated: ok {rc=0} 04:21:59.072508 --- ParallelTerminationStrategy: PID 23780 died... 04:21:59.092200 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23780): Terminated: ok {rc=0} 04:21:59.181012 bus /sierra_3: Setting Powered False 04:22:00.280418 bus /sierra_3: Setting Powered False 04:22:01.403059 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2354 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 04:22:02.558442 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:22:02.570385 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 04:22:02.641193 tst mo_mt_call_osmux.py: using LAC 19037 04:22:02.768412 tst mo_mt_call_osmux.py: using RAC 167 04:22:02.887569 tst mo_mt_call_osmux.py: using CellId 19037 04:22:03.006636 tst mo_mt_call_osmux.py: using BVCI 19038 04:22:03.114952 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:22:03.126066 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:22:03.137041 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:22:03.147911 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:22:03.158780 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:22:03.169564 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 04:22:03.287343 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 04:22:03.405033 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:22:03.871180 run create_hlr_db(pid=23783): Launched 04:22:03.993950 bus /sierra_2: Setting Powered False 04:22:05.053548 run create_hlr_db(pid=23783): Terminated: ok {rc=0} 04:22:05.471076 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23785): Launched 04:22:05.770191 run osmo-hlr_10.42.42.2(pid=23786): Launched 04:22:05.884048 run osmo-stp_10.42.42.5: Starting osmo-stp 04:22:06.397423 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23788): Launched 04:22:06.696220 run osmo-stp_10.42.42.5(pid=23789): Launched 04:22:06.809491 run osmo-msc_10.42.42.6: Starting osmo-msc 04:22:07.348885 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23791): Launched 04:22:07.647595 run osmo-msc_10.42.42.6(pid=23792): Launched 04:22:07.817171 run osmo-stp_10.42.42.5(pid=23789): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23789)] 04:22:07.944731 run osmo-stp_10.42.42.5(pid=23789): stdout: | (launched: 2022-12-09_04:22:06.640732) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:22:08.071438 run osmo-stp_10.42.42.5(pid=23789): stderr: | 20221209042206812 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042206812 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042206812 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042206812 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042206813 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042206813 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042206813 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:22:08.195927 run osmo-stp_10.42.42.5(pid=23789): stdout: | (launched: 2022-12-09_04:22:06.640732) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:22:08.314436 run osmo-stp_10.42.42.5(pid=23789): stderr: | 20221209042206812 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042206812 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042206812 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042206812 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042206813 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042206813 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042206813 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:22:08.456636 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23789): Process ended prematurely: osmo-stp_10.42.42.5(pid=23789) [trial-2354↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23789)] [trial-2354↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 04:22:08.465738 tst mo_mt_call_osmux.py:8: Test FAILED (5.9 sec) 04:22:08.492365 run osmo-hlr_10.42.42.2(pid=23786): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23786)] 04:22:08.540305 run osmo-hlr_10.42.42.2(pid=23786): stdout: | (launched: 2022-12-09_04:22:05.714993) 04:22:08.590068 run osmo-hlr_10.42.42.2(pid=23786): stderr: | 20221209042205893 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209042205893 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209042205893 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209042205893 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209042205893 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209042205893 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209042205905 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209042205916 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209042205916 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209042205917 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:22:08.659947 run osmo-msc_10.42.42.6(pid=23792): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23792)] 04:22:08.708110 run osmo-msc_10.42.42.6(pid=23792): stdout: | (launched: 2022-12-09_04:22:07.592512) 04:22:08.757827 run osmo-msc_10.42.42.6(pid=23792): stderr: | 20221209042207862 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209042207862 DLGLOBAL DEBUG validating counter group 0x7f6527eedc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209042207862 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209042207862 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209042207862 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209042207863 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209042207864 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209042207865 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209042207865 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209042207865 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:22:08.807913 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23785): Terminating (SIGTERM) 04:22:08.847602 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23788): Terminating (SIGTERM) 04:22:08.887313 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23791): Terminating (SIGTERM) 04:22:08.927131 --- ParallelTerminationStrategy: PID 23785 died... 04:22:08.946585 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23785): Terminated: ok {rc=0} 04:22:08.990734 --- ParallelTerminationStrategy: PID 23788 died... 04:22:09.009396 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23788): Terminated: ok {rc=0} 04:22:09.053213 --- ParallelTerminationStrategy: PID 23791 died... 04:22:09.071711 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23791): Terminated: ok {rc=0} 04:22:09.156194 bus /sierra_3: Setting Powered False 04:22:10.251304 bus /sierra_3: Setting Powered False 04:22:11.366853 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 04:22:12.616683 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:22:12.623289 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 04:22:12.656051 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 04:22:12.682377 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 04:22:12.733144 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 04:22:12.765515 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 04:22:12.791497 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 04:22:13.342536 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 04:22:13.390219 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:22:13.401291 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 04:22:13.470927 tst mo_mt_call.py: using LAC 19038 04:22:13.587756 tst mo_mt_call.py: using RAC 168 04:22:13.710497 tst mo_mt_call.py: using CellId 19038 04:22:13.827638 tst mo_mt_call.py: using BVCI 19039 04:22:13.936125 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:22:13.947239 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:22:13.958144 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:22:13.969125 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:22:13.979956 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:22:13.990710 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:22:14.108507 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:22:14.226018 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:22:14.689657 run create_hlr_db(pid=23798): Launched 04:22:14.812279 bus /sierra_2: Setting Powered False 04:22:15.900264 run create_hlr_db(pid=23798): Terminated: ok {rc=0} 04:22:16.345211 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23800): Launched 04:22:16.677724 run osmo-hlr_10.42.42.2(pid=23801): Launched 04:22:16.889377 run osmo-stp_10.42.42.5: Starting osmo-stp 04:22:17.502431 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23803): Launched 04:22:17.823670 run osmo-stp_10.42.42.5(pid=23804): Launched 04:22:17.946250 run osmo-msc_10.42.42.6: Starting osmo-msc 04:22:18.525532 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23806): Launched 04:22:18.846940 run osmo-msc_10.42.42.6(pid=23807): Launched 04:22:19.025942 run osmo-stp_10.42.42.5(pid=23804): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23804)] 04:22:19.161125 run osmo-stp_10.42.42.5(pid=23804): stdout: | (launched: 2022-12-09_04:22:17.765339) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:22:19.296540 run osmo-stp_10.42.42.5(pid=23804): stderr: | 20221209042217958 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042217958 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042217959 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042217959 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042217959 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042217959 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042217959 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:22:19.431861 run osmo-stp_10.42.42.5(pid=23804): stdout: | (launched: 2022-12-09_04:22:17.765339) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:22:19.559905 run osmo-stp_10.42.42.5(pid=23804): stderr: | 20221209042217958 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042217958 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042217959 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042217959 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042217959 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042217959 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042217959 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:22:19.713755 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23804): Process ended prematurely: osmo-stp_10.42.42.5(pid=23804) [trial-2354↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23804)] [trial-2354↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 04:22:19.723339 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 04:22:19.752304 run osmo-hlr_10.42.42.2(pid=23801): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23801)] 04:22:19.803218 run osmo-hlr_10.42.42.2(pid=23801): stdout: | (launched: 2022-12-09_04:22:16.603754) 04:22:19.856074 run osmo-hlr_10.42.42.2(pid=23801): stderr: | 20221209042216947 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209042216947 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209042216947 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209042216947 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209042216947 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209042216947 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209042216971 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209042216991 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209042216991 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209042216991 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:22:19.929627 run osmo-msc_10.42.42.6(pid=23807): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23807)] 04:22:19.980350 run osmo-msc_10.42.42.6(pid=23807): stdout: | (launched: 2022-12-09_04:22:18.788454) 04:22:20.033229 run osmo-msc_10.42.42.6(pid=23807): stderr: | 20221209042219111 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209042219112 DLGLOBAL DEBUG validating counter group 0x7f3c12963c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209042219112 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209042219112 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209042219112 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209042219112 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209042219114 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209042219114 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209042219114 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209042219114 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:22:20.086307 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23800): Terminating (SIGTERM) 04:22:20.128898 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23803): Terminating (SIGTERM) 04:22:20.171529 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23806): Terminating (SIGTERM) 04:22:20.214129 --- ParallelTerminationStrategy: PID 23800 died... 04:22:20.234351 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23800): Terminated: ok {rc=0} 04:22:20.281742 --- ParallelTerminationStrategy: PID 23803 died... 04:22:20.301591 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23803): Terminated: ok {rc=0} 04:22:20.348439 --- ParallelTerminationStrategy: PID 23806 died... 04:22:20.368221 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23806): Terminated: ok {rc=0} 04:22:20.457568 bus /sierra_3: Setting Powered False 04:22:21.559347 bus /sierra_3: Setting Powered False 04:22:22.676213 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2354 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 04:22:23.826076 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:22:23.838203 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 04:22:23.910753 tst mo_mt_call_osmux.py: using LAC 19039 04:22:24.037196 tst mo_mt_call_osmux.py: using RAC 169 04:22:24.164279 tst mo_mt_call_osmux.py: using CellId 19039 04:22:24.290555 tst mo_mt_call_osmux.py: using BVCI 19040 04:22:24.406924 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:22:24.418530 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:22:24.429935 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:22:24.441939 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:22:24.453623 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:22:24.465237 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:22:24.580539 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:22:24.699437 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:22:25.196049 run create_hlr_db(pid=23809): Launched 04:22:25.319118 bus /sierra_2: Setting Powered False 04:22:26.379599 run create_hlr_db(pid=23809): Terminated: ok {rc=0} 04:22:26.825191 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23811): Launched 04:22:27.147170 run osmo-hlr_10.42.42.2(pid=23812): Launched 04:22:27.269683 run osmo-stp_10.42.42.5: Starting osmo-stp 04:22:27.824404 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23814): Launched 04:22:28.145310 run osmo-stp_10.42.42.5(pid=23815): Launched 04:22:28.268077 run osmo-msc_10.42.42.6: Starting osmo-msc 04:22:28.854826 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23817): Launched 04:22:29.177452 run osmo-msc_10.42.42.6(pid=23818): Launched 04:22:29.358235 run osmo-stp_10.42.42.5(pid=23815): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23815)] 04:22:29.499166 run osmo-stp_10.42.42.5(pid=23815): stdout: | (launched: 2022-12-09_04:22:28.086700) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:22:29.636442 run osmo-stp_10.42.42.5(pid=23815): stderr: | 20221209042228277 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042228277 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042228277 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042228278 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042228278 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042228278 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042228278 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:22:29.773177 run osmo-stp_10.42.42.5(pid=23815): stdout: | (launched: 2022-12-09_04:22:28.086700) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:22:29.901883 run osmo-stp_10.42.42.5(pid=23815): stderr: | 20221209042228277 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042228277 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042228277 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042228278 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042228278 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042228278 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042228278 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:22:30.055736 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23815): Process ended prematurely: osmo-stp_10.42.42.5(pid=23815) [trial-2354↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23815)] [trial-2354↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 04:22:30.065731 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 04:22:30.094807 run osmo-hlr_10.42.42.2(pid=23812): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23812)] 04:22:30.146121 run osmo-hlr_10.42.42.2(pid=23812): stdout: | (launched: 2022-12-09_04:22:27.088626) 04:22:30.199047 run osmo-hlr_10.42.42.2(pid=23812): stderr: | 20221209042227287 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209042227287 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209042227287 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209042227287 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209042227287 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209042227287 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209042227300 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209042227308 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209042227308 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209042227308 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:22:30.272367 run osmo-msc_10.42.42.6(pid=23818): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23818)] 04:22:30.323396 run osmo-msc_10.42.42.6(pid=23818): stdout: | (launched: 2022-12-09_04:22:29.118773) 04:22:30.375969 run osmo-msc_10.42.42.6(pid=23818): stderr: | 20221209042229442 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209042229442 DLGLOBAL DEBUG validating counter group 0x7f2bdf023c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209042229442 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209042229442 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209042229442 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209042229442 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209042229444 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209042229444 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209042229444 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209042229445 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:22:30.429058 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23811): Terminating (SIGTERM) 04:22:30.471332 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23814): Terminating (SIGTERM) 04:22:30.513932 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23817): Terminating (SIGTERM) 04:22:30.556745 --- ParallelTerminationStrategy: PID 23811 died... 04:22:30.576841 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23811): Terminated: ok {rc=0} 04:22:30.624395 --- ParallelTerminationStrategy: PID 23814 died... 04:22:30.644381 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23814): Terminated: ok {rc=0} 04:22:30.691396 --- ParallelTerminationStrategy: PID 23817 died... 04:22:30.711522 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23817): Terminated: ok {rc=0} 04:22:30.800496 bus /sierra_3: Setting Powered False 04:22:31.914861 bus /sierra_3: Setting Powered False 04:22:33.045400 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 voice:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 04:22:34.293842 tst voice:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:22:34.299967 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 04:22:34.333006 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 04:22:34.359170 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 04:22:34.411225 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 04:22:34.443591 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 04:22:34.469806 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 04:22:35.017159 tst voice:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 04:22:35.064786 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:22:35.075660 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:22:35.144608 tst mo_mt_call.py: using LAC 19040 04:22:35.263646 tst mo_mt_call.py: using RAC 170 04:22:35.383065 tst mo_mt_call.py: using CellId 19040 04:22:35.500555 tst mo_mt_call.py: using BVCI 19041 04:22:35.609342 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:22:35.620016 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:22:35.630491 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:22:35.641019 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:22:35.651460 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:22:35.662035 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 04:22:35.783262 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 04:22:35.902349 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:22:36.399918 run create_hlr_db(pid=23824): Launched 04:22:36.523122 bus /sierra_2: Setting Powered False 04:22:37.586856 run create_hlr_db(pid=23824): Terminated: ok {rc=0} 04:22:38.015750 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23826): Launched 04:22:38.316783 run osmo-hlr_10.42.42.2(pid=23827): Launched 04:22:38.431324 run osmo-stp_10.42.42.5: Starting osmo-stp 04:22:38.945299 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23829): Launched 04:22:39.243778 run osmo-stp_10.42.42.5(pid=23830): Launched 04:22:39.358757 run osmo-msc_10.42.42.6: Starting osmo-msc 04:22:39.899751 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23832): Launched 04:22:40.199566 run osmo-msc_10.42.42.6(pid=23833): Launched 04:22:40.368137 run osmo-stp_10.42.42.5(pid=23830): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23830)] 04:22:40.494913 run osmo-stp_10.42.42.5(pid=23830): stdout: | (launched: 2022-12-09_04:22:39.189379) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:22:40.622006 run osmo-stp_10.42.42.5(pid=23830): stderr: | 20221209042239359 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042239359 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042239360 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042239360 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042239361 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042239361 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042239361 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:22:40.746944 run osmo-stp_10.42.42.5(pid=23830): stdout: | (launched: 2022-12-09_04:22:39.189379) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:22:40.866373 run osmo-stp_10.42.42.5(pid=23830): stderr: | 20221209042239359 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042239359 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042239360 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042239360 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042239361 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042239361 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042239361 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:22:41.009339 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23830): Process ended prematurely: osmo-stp_10.42.42.5(pid=23830) [trial-2354↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23830)] [trial-2354↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 04:22:41.018350 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 04:22:41.044828 run osmo-hlr_10.42.42.2(pid=23827): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23827)] 04:22:41.092317 run osmo-hlr_10.42.42.2(pid=23827): stdout: | (launched: 2022-12-09_04:22:38.262016) 04:22:41.141380 run osmo-hlr_10.42.42.2(pid=23827): stderr: | 20221209042238438 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209042238438 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209042238438 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209042238438 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209042238438 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209042238438 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209042238450 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209042238459 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209042238459 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209042238459 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:22:41.210280 run osmo-msc_10.42.42.6(pid=23833): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23833)] 04:22:41.257818 run osmo-msc_10.42.42.6(pid=23833): stdout: | (launched: 2022-12-09_04:22:40.144246) 04:22:41.306909 run osmo-msc_10.42.42.6(pid=23833): stderr: | 20221209042240415 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209042240415 DLGLOBAL DEBUG validating counter group 0x7feff9dc9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209042240415 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209042240415 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209042240415 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209042240415 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209042240417 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209042240419 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209042240419 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209042240419 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:22:41.356494 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23826): Terminating (SIGTERM) 04:22:41.395755 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23829): Terminating (SIGTERM) 04:22:41.435063 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23832): Terminating (SIGTERM) 04:22:41.474791 --- ParallelTerminationStrategy: PID 23826 died... 04:22:41.493979 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23826): Terminated: ok {rc=0} 04:22:41.537991 --- ParallelTerminationStrategy: PID 23829 died... 04:22:41.556655 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23829): Terminated: ok {rc=0} 04:22:41.600612 --- ParallelTerminationStrategy: PID 23832 died... 04:22:41.619367 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23832): Terminated: ok {rc=0} 04:22:41.702651 bus /sierra_3: Setting Powered False 04:22:42.798990 bus /sierra_3: Setting Powered False 04:22:43.913586 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2354 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 04:22:45.059196 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:22:45.070668 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:22:45.140603 tst mo_mt_call_osmux.py: using LAC 19041 04:22:45.257836 tst mo_mt_call_osmux.py: using RAC 171 04:22:45.374701 tst mo_mt_call_osmux.py: using CellId 19041 04:22:45.491819 tst mo_mt_call_osmux.py: using BVCI 19042 04:22:45.601617 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:22:45.612275 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:22:45.622728 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:22:45.633273 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:22:45.643847 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:22:45.654446 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 04:22:45.772395 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 04:22:45.910470 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:22:46.406115 run create_hlr_db(pid=23835): Launched 04:22:46.566922 bus /sierra_2: Setting Powered False 04:22:47.630576 run create_hlr_db(pid=23835): Terminated: ok {rc=0} 04:22:48.078279 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23837): Launched 04:22:48.400055 run osmo-hlr_10.42.42.2(pid=23838): Launched 04:22:48.523302 run osmo-stp_10.42.42.5: Starting osmo-stp 04:22:49.077118 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23840): Launched 04:22:49.397554 run osmo-stp_10.42.42.5(pid=23841): Launched 04:22:49.520517 run osmo-msc_10.42.42.6: Starting osmo-msc 04:22:50.102717 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23843): Launched 04:22:50.423624 run osmo-msc_10.42.42.6(pid=23844): Launched 04:22:50.603198 run osmo-stp_10.42.42.5(pid=23841): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23841)] 04:22:50.739365 run osmo-stp_10.42.42.5(pid=23841): stdout: | (launched: 2022-12-09_04:22:49.339218) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:22:50.875894 run osmo-stp_10.42.42.5(pid=23841): stderr: | 20221209042249530 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042249530 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042249530 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042249531 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042249531 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042249531 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042249531 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:22:51.011614 run osmo-stp_10.42.42.5(pid=23841): stdout: | (launched: 2022-12-09_04:22:49.339218) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:22:51.139906 run osmo-stp_10.42.42.5(pid=23841): stderr: | 20221209042249530 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042249530 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042249530 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042249531 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042249531 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042249531 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042249531 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:22:51.293451 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23841): Process ended prematurely: osmo-stp_10.42.42.5(pid=23841) [trial-2354↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23841)] [trial-2354↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 04:22:51.303109 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 04:22:51.332197 run osmo-hlr_10.42.42.2(pid=23838): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23838)] 04:22:51.383309 run osmo-hlr_10.42.42.2(pid=23838): stdout: | (launched: 2022-12-09_04:22:48.341761) 04:22:51.436196 run osmo-hlr_10.42.42.2(pid=23838): stderr: | 20221209042248540 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209042248540 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209042248540 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209042248540 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209042248540 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209042248540 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209042248552 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209042248560 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209042248560 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209042248560 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:22:51.510044 run osmo-msc_10.42.42.6(pid=23844): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23844)] 04:22:51.561354 run osmo-msc_10.42.42.6(pid=23844): stdout: | (launched: 2022-12-09_04:22:50.365318) 04:22:51.614373 run osmo-msc_10.42.42.6(pid=23844): stderr: | 20221209042250688 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209042250689 DLGLOBAL DEBUG validating counter group 0x7f0f1110dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209042250689 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209042250689 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209042250689 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209042250689 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209042250692 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209042250692 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209042250692 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209042250692 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:22:51.667853 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23837): Terminating (SIGTERM) 04:22:51.710852 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23840): Terminating (SIGTERM) 04:22:51.753375 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23843): Terminating (SIGTERM) 04:22:51.796324 --- ParallelTerminationStrategy: PID 23837 died... 04:22:51.816643 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23837): Terminated: ok {rc=0} 04:22:51.864077 --- ParallelTerminationStrategy: PID 23840 died... 04:22:51.883931 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23840): Terminated: ok {rc=0} 04:22:51.931389 --- ParallelTerminationStrategy: PID 23843 died... 04:22:51.951372 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23843): Terminated: ok {rc=0} 04:22:52.040668 bus /sierra_3: Setting Powered False 04:22:53.142030 bus /sierra_3: Setting Powered False 04:22:54.258583 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 voice:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 emergency:trx-lms --------------------------------------------------------------------- 04:22:55.504202 tst emergency:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:22:55.508451 tst emergency:trx-lms: Verifying 1 x bts (candidates: 11) 04:22:55.540868 tst emergency:trx-lms: Verifying 6 x ip_address (candidates: 9) 04:22:55.567168 tst emergency:trx-lms: Verifying 4 x modem (candidates: 12) 04:22:55.651457 tst emergency:trx-lms: Reserving 1 x bts (candidates: 11) 04:22:55.685278 tst emergency:trx-lms: Reserving 6 x ip_address (candidates: 9) 04:22:55.713464 tst emergency:trx-lms: Reserving 4 x modem (candidates: 12) 04:22:56.294199 tst emergency:trx-lms: RESERVED RESOURCES for emergency: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2354 emergency:trx-lms emergency_mo_mt_call.py ---------------------------------------------- 04:22:56.299148 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 04:22:56.309710 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 04:22:56.358427 tst emergency_mo_mt_call.py: using LAC 19042 04:22:56.473835 tst emergency_mo_mt_call.py: using RAC 172 04:22:56.587542 tst emergency_mo_mt_call.py: using CellId 19042 04:22:56.700721 tst emergency_mo_mt_call.py: using BVCI 19043 04:22:56.807999 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 04:22:56.818601 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 04:22:56.828886 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 04:22:56.839324 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 04:22:56.849711 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 04:22:56.860000 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 04:22:56.977425 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 04:22:57.094951 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:22:57.584764 run create_hlr_db(pid=23849): Launched 04:22:57.705930 bus /sierra_2: Setting Powered False 04:22:58.769110 run create_hlr_db(pid=23849): Terminated: ok {rc=0} 04:22:59.208105 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23851): Launched 04:22:59.522740 run osmo-hlr_10.42.42.2(pid=23852): Launched 04:22:59.644007 run osmo-stp_10.42.42.5: Starting osmo-stp 04:23:00.190523 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23854): Launched 04:23:00.506461 run osmo-stp_10.42.42.5(pid=23855): Launched 04:23:00.637210 tst emergency_mo_mt_call.py: using MSISDN 7022 04:23:00.803945 run osmo-msc_10.42.42.6: Starting osmo-msc 04:23:01.392399 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23857): Launched 04:23:01.768796 run osmo-msc_10.42.42.6(pid=23886): Launched 04:23:02.138360 run osmo-stp_10.42.42.5(pid=23855): ERR: Terminated: ERROR {rc=1} [trial-2354↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23855)] 04:23:02.418676 run osmo-stp_10.42.42.5(pid=23855): stdout: | (launched: 2022-12-09_04:23:00.448813) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:23:02.699141 run osmo-stp_10.42.42.5(pid=23855): stderr: | 20221209042300638 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042300638 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042300639 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042300639 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042300640 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042300640 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042300640 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:23:02.899899 run osmo-stp_10.42.42.5(pid=23855): stdout: | (launched: 2022-12-09_04:23:00.448813) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:23:03.035618 run osmo-stp_10.42.42.5(pid=23855): stderr: | 20221209042300638 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042300638 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042300639 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042300639 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042300640 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042300640 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042300640 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:23:03.203598 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=23855): Process ended prematurely: osmo-stp_10.42.42.5(pid=23855) [trial-2354↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23855)] [trial-2354↪emergency:trx-lms↪emergency_mo_mt_call.py:19] 04:23:03.212623 tst emergency_mo_mt_call.py:19: Test FAILED (6.9 sec) 04:23:03.247220 run osmo-hlr_10.42.42.2(pid=23852): ERR: Terminated: ERROR {rc=237} [trial-2354↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23852)] 04:23:03.304311 run osmo-hlr_10.42.42.2(pid=23852): stdout: | (launched: 2022-12-09_04:22:59.465666) 04:23:03.366291 run osmo-hlr_10.42.42.2(pid=23852): stderr: | 20221209042259662 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209042259662 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209042259662 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209042259663 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209042259663 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209042259663 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209042259674 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/emergency:trx-lms/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209042259683 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209042259683 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209042259683 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:23:03.445815 run osmo-msc_10.42.42.6(pid=23886): ERR: Terminated: ERROR {rc=2} [trial-2354↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23886)] 04:23:03.514646 run osmo-msc_10.42.42.6(pid=23886): stdout: | (launched: 2022-12-09_04:23:01.695013) 04:23:03.573384 run osmo-msc_10.42.42.6(pid=23886): stderr: | 20221209042302328 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209042302328 DLGLOBAL DEBUG validating counter group 0x7f1a6832bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209042302328 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209042302328 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209042302337 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209042302337 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209042302339 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209042302339 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209042302339 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209042302340 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:23:03.642072 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23851): Terminating (SIGTERM) 04:23:03.689601 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23854): Terminating (SIGTERM) 04:23:03.744301 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23857): Terminating (SIGTERM) 04:23:03.804315 --- ParallelTerminationStrategy: PID 23851 died... 04:23:03.823646 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23851): Terminated: ok {rc=0} 04:23:03.883386 --- ParallelTerminationStrategy: PID 23854 died... 04:23:03.904245 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23854): Terminated: ok {rc=0} 04:23:03.960188 --- ParallelTerminationStrategy: PID 23857 died... 04:23:03.984231 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23857): Terminated: ok {rc=0} 04:23:04.091461 bus /sierra_3: Setting Powered False 04:23:05.199404 bus /sierra_3: Setting Powered False 04:23:06.318220 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2354 emergency:trx-lms emergency_preemptive_call.py ---------------------------------------------- 04:23:07.407025 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 04:23:07.419030 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 04:23:07.469380 tst emergency_preemptive_call.py: using LAC 19043 04:23:07.589194 tst emergency_preemptive_call.py: using RAC 173 04:23:07.708140 tst emergency_preemptive_call.py: using CellId 19043 04:23:07.826565 tst emergency_preemptive_call.py: using BVCI 19044 04:23:07.935510 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 04:23:07.946594 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 04:23:07.957490 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 04:23:07.968922 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 04:23:07.980051 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 04:23:07.991028 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 04:23:08.107165 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 04:23:08.224831 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 04:23:08.341584 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 04:23:08.459562 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:23:08.938082 run create_hlr_db(pid=24131): Launched 04:23:09.095197 bus /sierra_2: Setting Powered False 04:23:10.155152 run create_hlr_db(pid=24131): Terminated: ok {rc=0} 04:23:10.591259 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24133): Launched 04:23:10.914554 run osmo-hlr_10.42.42.2(pid=24134): Launched 04:23:11.143857 run osmo-stp_10.42.42.5: Starting osmo-stp 04:23:11.881962 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24136): Launched 04:23:12.209126 run osmo-stp_10.42.42.5(pid=24137): Launched 04:23:12.459559 tst emergency_preemptive_call.py: using MSISDN 7023 04:23:12.773272 run osmo-msc_10.42.42.6: Starting osmo-msc 04:23:13.321341 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24139): Launched 04:23:13.654603 run osmo-msc_10.42.42.6(pid=24140): Launched 04:23:14.010928 run osmo-stp_10.42.42.5(pid=24137): ERR: Terminated: ERROR {rc=1} [trial-2354↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24137)] 04:23:14.281411 run osmo-stp_10.42.42.5(pid=24137): stdout: | (launched: 2022-12-09_04:23:12.144341) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:23:14.463708 run osmo-stp_10.42.42.5(pid=24137): stderr: | 20221209042312480 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042312480 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042312480 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042312485 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042312485 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042312485 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042312485 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:23:14.601462 run osmo-stp_10.42.42.5(pid=24137): stdout: | (launched: 2022-12-09_04:23:12.144341) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:23:14.732239 run osmo-stp_10.42.42.5(pid=24137): stderr: | 20221209042312480 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042312480 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042312480 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042312485 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042312485 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042312485 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042312485 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:23:14.888040 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=24137): Process ended prematurely: osmo-stp_10.42.42.5(pid=24137) [trial-2354↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24137)] [trial-2354↪emergency:trx-lms↪emergency_preemptive_call.py:32] 04:23:14.898222 tst emergency_preemptive_call.py:32: Test FAILED (7.5 sec) 04:23:14.930126 run osmo-hlr_10.42.42.2(pid=24134): ERR: Terminated: ERROR {rc=237} [trial-2354↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24134)] 04:23:14.984205 run osmo-hlr_10.42.42.2(pid=24134): stdout: | (launched: 2022-12-09_04:23:10.857435) 04:23:15.039891 run osmo-hlr_10.42.42.2(pid=24134): stderr: | 20221209042311200 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209042311200 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209042311200 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209042311200 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209042311200 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209042311200 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209042311223 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/emergency:trx-lms/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209042311232 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209042311232 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209042311232 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:23:15.117192 run osmo-msc_10.42.42.6(pid=24140): ERR: Terminated: ERROR {rc=2} [trial-2354↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24140)] 04:23:15.171331 run osmo-msc_10.42.42.6(pid=24140): stdout: | (launched: 2022-12-09_04:23:13.596242) 04:23:15.227063 run osmo-msc_10.42.42.6(pid=24140): stderr: | 20221209042314095 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209042314095 DLGLOBAL DEBUG validating counter group 0x7fefdb5c2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209042314095 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209042314095 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209042314095 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209042314095 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209042314106 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209042314106 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209042314106 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209042314106 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:23:15.283451 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24133): Terminating (SIGTERM) 04:23:15.328617 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24136): Terminating (SIGTERM) 04:23:15.373864 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24139): Terminating (SIGTERM) 04:23:15.419871 --- ParallelTerminationStrategy: PID 24133 died... 04:23:15.441179 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24133): Terminated: ok {rc=0} 04:23:15.493259 --- ParallelTerminationStrategy: PID 24136 died... 04:23:15.514457 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24136): Terminated: ok {rc=0} 04:23:15.565332 --- ParallelTerminationStrategy: PID 24139 died... 04:23:15.586385 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24139): Terminated: ok {rc=0} 04:23:15.680831 bus /sierra_9: Setting Powered False 04:23:16.789738 bus /sierra_9: Setting Powered False 04:23:17.930773 bus /sierra_8: Setting Powered False 04:23:19.035859 bus /sierra_8: Setting Powered False 04:23:20.158855 bus /sierra_3: Setting Powered False 04:23:21.263496 bus /sierra_3: Setting Powered False 04:23:22.387199 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 emergency:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 gprs:trx-lms --------------------------------------------------------------------- 04:23:23.679774 tst gprs:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:23:23.685279 tst gprs:trx-lms: Verifying 1 x bts (candidates: 11) 04:23:23.726183 tst gprs:trx-lms: Verifying 9 x ip_address (candidates: 9) 04:23:23.767890 tst gprs:trx-lms: Verifying 4 x modem (candidates: 12) 04:23:23.873160 tst gprs:trx-lms: Reserving 1 x bts (candidates: 11) 04:23:23.909404 tst gprs:trx-lms: Reserving 9 x ip_address (candidates: 9) 04:23:23.949182 tst gprs:trx-lms: Reserving 4 x modem (candidates: 12) 04:23:24.534977 tst gprs:trx-lms: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2354 gprs:trx-lms cs_paging_gprs_active.py ---------------------------------------------- 04:23:24.587978 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:23:24.599041 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 04:23:24.647050 tst cs_paging_gprs_active.py: using LAC 19044 04:23:24.774100 tst cs_paging_gprs_active.py: using RAC 174 04:23:24.898253 tst cs_paging_gprs_active.py: using CellId 19044 04:23:25.022522 tst cs_paging_gprs_active.py: using BVCI 19045 04:23:25.139867 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:23:25.151053 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:23:25.161899 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:23:25.173075 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:23:25.184184 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:23:25.195240 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:23:25.206512 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:23:25.217599 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:23:25.228675 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 04:23:25.344652 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 04:23:25.465478 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 04:23:25.683798 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:23:26.009619 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24146): Launched 04:23:26.291907 run iperf3-srv_10.42.42.10(pid=24147): Launched 04:23:26.413838 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 04:23:26.631835 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:23:26.957381 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24148): Launched 04:23:27.239535 run iperf3-srv_10.42.42.10(pid=24149): Launched 04:23:27.361544 tst cs_paging_gprs_active.py:38: start network... 04:23:27.579701 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:23:28.081739 run create_hlr_db(pid=24150): Launched 04:23:28.207374 bus /sierra_2: Setting Powered False 04:23:29.271329 run create_hlr_db(pid=24150): Terminated: ok {rc=0} 04:23:29.704087 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24152): Launched 04:23:30.007008 run osmo-hlr_10.42.42.2(pid=24153): Launched 04:23:30.122378 run osmo-stp_10.42.42.5: Starting osmo-stp 04:23:30.644781 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24155): Launched 04:23:30.957504 run osmo-stp_10.42.42.5(pid=24156): Launched 04:23:31.129623 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:23:31.814626 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24158): Launched 04:23:31.980841 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:23:32.273776 run patchelf(pid=24159): Launched 04:23:32.453716 run osmo-stp_10.42.42.5(pid=24156): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24156)] 04:23:32.581754 run osmo-stp_10.42.42.5(pid=24156): stdout: | (launched: 2022-12-09_04:23:30.901109) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:23:32.711060 run osmo-stp_10.42.42.5(pid=24156): stderr: | 20221209042331214 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042331214 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042331215 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042331215 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042331216 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042331216 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042331216 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:23:32.840314 run osmo-stp_10.42.42.5(pid=24156): stdout: | (launched: 2022-12-09_04:23:30.901109) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:23:32.964260 run osmo-stp_10.42.42.5(pid=24156): stderr: | 20221209042331214 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042331214 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042331215 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042331215 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042331216 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042331216 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042331216 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:23:33.111081 run patchelf(pid=24159): Terminating (SIGINT) 04:23:33.281460 run patchelf(pid=24159): Terminated: ok {rc=0} 04:23:33.403832 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=24156): Process ended prematurely: osmo-stp_10.42.42.5(pid=24156) [trial-2354↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24156)] [trial-2354↪gprs:trx-lms↪cs_paging_gprs_active.py:38] 04:23:33.413460 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 04:23:33.441055 run osmo-hlr_10.42.42.2(pid=24153): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-lms↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24153)] 04:23:33.489617 run osmo-hlr_10.42.42.2(pid=24153): stdout: | (launched: 2022-12-09_04:23:29.950940) 04:23:33.539995 run osmo-hlr_10.42.42.2(pid=24153): stderr: | 20221209042330130 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209042330130 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209042330130 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209042330130 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209042330130 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209042330130 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209042330142 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-lms/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209042330153 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209042330153 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209042330153 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:23:33.590500 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24146): Terminating (SIGTERM) 04:23:33.630493 run iperf3-srv_10.42.42.10(pid=24147): Terminating (SIGTERM) 04:23:33.670574 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24148): Terminating (SIGTERM) 04:23:33.711005 run iperf3-srv_10.42.42.10(pid=24149): Terminating (SIGTERM) 04:23:33.751280 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24152): Terminating (SIGTERM) 04:23:33.791453 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24155): Terminating (SIGTERM) 04:23:33.831439 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24158): Terminating (SIGTERM) 04:23:33.871785 --- ParallelTerminationStrategy: PID 24146 died... 04:23:33.891034 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24146): Terminated: ok {rc=0} 04:23:33.935361 --- ParallelTerminationStrategy: PID 24147 died... 04:23:33.954083 run iperf3-srv_10.42.42.10(pid=24147): Terminated {rc=256} 04:23:33.998331 --- ParallelTerminationStrategy: PID 24148 died... 04:23:34.017096 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24148): Terminated: ok {rc=0} 04:23:34.061077 --- ParallelTerminationStrategy: PID 24149 died... 04:23:34.079612 run iperf3-srv_10.42.42.10(pid=24149): Terminated {rc=256} 04:23:34.123706 --- ParallelTerminationStrategy: PID 24152 died... 04:23:34.142350 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24152): Terminated: ok {rc=0} 04:23:34.186230 --- ParallelTerminationStrategy: PID 24155 died... 04:23:34.204880 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24155): Terminated: ok {rc=0} 04:23:34.249137 --- ParallelTerminationStrategy: PID 24158 died... 04:23:34.267778 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24158): Terminated: ok {rc=0} 04:23:34.353677 bus /gobi_0: Setting Powered False 04:23:35.453907 bus /gobi_0: Setting Powered False 04:23:36.567369 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:trx-lms iperf3.py ---------------------------------------------- 04:23:37.717125 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:23:37.729145 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 04:23:37.782390 tst iperf3.py: using LAC 19045 04:23:37.910533 tst iperf3.py: using RAC 175 04:23:38.038184 tst iperf3.py: using CellId 19045 04:23:38.167437 tst iperf3.py: using BVCI 19046 04:23:38.286544 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:23:38.297678 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:23:38.308466 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:23:38.319578 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:23:38.330540 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:23:38.341573 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:23:38.352602 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:23:38.363610 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:23:38.374778 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 04:23:38.493484 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 04:23:38.712825 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:23:39.037743 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24160): Launched 04:23:39.322087 run iperf3-srv_10.42.42.10(pid=24161): Launched 04:23:39.446395 tst iperf3.py:8: start network... 04:23:39.664577 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:23:40.167246 run create_hlr_db(pid=24162): Launched 04:23:40.291057 bus /gobi_6: Setting Powered False 04:23:41.355559 run create_hlr_db(pid=24162): Terminated: ok {rc=0} 04:23:41.806680 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24164): Launched 04:23:42.132493 run osmo-hlr_10.42.42.2(pid=24165): Launched 04:23:42.256901 run osmo-stp_10.42.42.5: Starting osmo-stp 04:23:42.820657 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24167): Launched 04:23:43.145213 run osmo-stp_10.42.42.5(pid=24168): Launched 04:23:43.269486 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:23:43.827444 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24170): Launched 04:23:43.953274 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:23:44.226837 run patchelf(pid=24171): Launched 04:23:44.407998 run osmo-stp_10.42.42.5(pid=24168): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24168)] 04:23:44.544607 run osmo-stp_10.42.42.5(pid=24168): stdout: | (launched: 2022-12-09_04:23:43.085797) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:23:44.683133 run osmo-stp_10.42.42.5(pid=24168): stderr: | 20221209042343279 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042343279 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042343279 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042343280 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042343280 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042343280 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042343280 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:23:44.822271 run osmo-stp_10.42.42.5(pid=24168): stdout: | (launched: 2022-12-09_04:23:43.085797) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:23:44.954877 run osmo-stp_10.42.42.5(pid=24168): stderr: | 20221209042343279 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042343279 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042343279 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042343280 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042343280 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042343280 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042343280 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:23:45.111850 run patchelf(pid=24171): Terminating (SIGINT) 04:23:45.293562 run patchelf(pid=24171): Terminated: ok {rc=0} 04:23:45.424590 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24168): Process ended prematurely: osmo-stp_10.42.42.5(pid=24168) [trial-2354↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24168)] [trial-2354↪gprs:trx-lms↪iperf3.py:8] 04:23:45.434773 tst iperf3.py:8: Test FAILED (7.8 sec) 04:23:45.464235 run osmo-hlr_10.42.42.2(pid=24165): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-lms↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24165)] 04:23:45.515196 run osmo-hlr_10.42.42.2(pid=24165): stdout: | (launched: 2022-12-09_04:23:42.073378) 04:23:45.567793 run osmo-hlr_10.42.42.2(pid=24165): stderr: | 20221209042342271 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209042342271 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209042342271 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209042342271 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209042342272 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209042342272 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209042342284 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-lms/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209042342292 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209042342292 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209042342292 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:23:45.620869 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24160): Terminating (SIGTERM) 04:23:45.663344 run iperf3-srv_10.42.42.10(pid=24161): Terminating (SIGTERM) 04:23:45.705672 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24164): Terminating (SIGTERM) 04:23:45.748326 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24167): Terminating (SIGTERM) 04:23:45.790794 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24170): Terminating (SIGTERM) 04:23:45.844854 --- ParallelTerminationStrategy: PID 24160 died... 04:23:45.870889 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24160): Terminated: ok {rc=0} 04:23:45.920588 --- ParallelTerminationStrategy: PID 24161 died... 04:23:45.940563 run iperf3-srv_10.42.42.10(pid=24161): Terminated {rc=256} 04:23:45.988122 --- ParallelTerminationStrategy: PID 24164 died... 04:23:46.008499 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24164): Terminated: ok {rc=0} 04:23:46.056817 --- ParallelTerminationStrategy: PID 24167 died... 04:23:46.077404 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24167): Terminated: ok {rc=0} 04:23:46.127679 --- ParallelTerminationStrategy: PID 24170 died... 04:23:46.148583 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24170): Terminated: ok {rc=0} 04:23:46.241464 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:trx-lms iperf3m4.py ---------------------------------------------- 04:23:47.396752 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:23:47.408447 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 04:23:47.458597 tst iperf3m4.py: using LAC 19046 04:23:47.589464 tst iperf3m4.py: using RAC 176 04:23:47.715411 tst iperf3m4.py: using CellId 19046 04:23:47.841474 tst iperf3m4.py: using BVCI 19047 04:23:47.960528 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:23:47.971663 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:23:47.982508 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:23:47.993690 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:23:48.004587 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:23:48.015669 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:23:48.026827 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:23:48.037924 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:23:48.049082 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 04:23:48.169378 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 04:23:48.292330 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 04:23:48.406453 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 04:23:48.521603 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 04:23:48.724821 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:23:49.027238 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24172): Launched 04:23:49.290352 run iperf3-srv_10.42.42.10(pid=24173): Launched 04:23:49.406199 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 04:23:49.607072 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:23:49.909132 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24174): Launched 04:23:50.172328 run iperf3-srv_10.42.42.10(pid=24175): Launched 04:23:50.286638 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 04:23:50.487747 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:23:50.791281 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24176): Launched 04:23:51.053663 run iperf3-srv_10.42.42.10(pid=24177): Launched 04:23:51.166789 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 04:23:51.367988 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:23:51.670370 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24178): Launched 04:23:51.932638 run iperf3-srv_10.42.42.10(pid=24179): Launched 04:23:52.045833 tst iperf3m4.py:8: start network... 04:23:52.246924 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:23:52.712126 run create_hlr_db(pid=24180): Launched 04:23:52.839060 bus /gobi_6: Setting Powered False 04:23:53.899387 run create_hlr_db(pid=24180): Terminated: ok {rc=0} 04:23:54.319940 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24182): Launched 04:23:54.622043 run osmo-hlr_10.42.42.2(pid=24183): Launched 04:23:54.737037 run osmo-stp_10.42.42.5: Starting osmo-stp 04:23:55.273046 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24185): Launched 04:23:55.575425 run osmo-stp_10.42.42.5(pid=24186): Launched 04:23:55.689835 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:23:56.210849 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24188): Launched 04:23:56.325953 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:23:56.581606 run patchelf(pid=24189): Launched 04:23:56.749547 run osmo-stp_10.42.42.5(pid=24186): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24186)] 04:23:56.877429 run osmo-stp_10.42.42.5(pid=24186): stdout: | (launched: 2022-12-09_04:23:55.519617) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:23:57.006481 run osmo-stp_10.42.42.5(pid=24186): stderr: | 20221209042355690 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042355690 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042355690 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042355690 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042355691 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042355691 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042355691 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:23:57.135697 run osmo-stp_10.42.42.5(pid=24186): stdout: | (launched: 2022-12-09_04:23:55.519617) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:23:57.259192 run osmo-stp_10.42.42.5(pid=24186): stderr: | 20221209042355690 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042355690 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042355690 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042355690 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042355691 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042355691 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042355691 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:23:57.405688 run patchelf(pid=24189): Terminating (SIGINT) 04:23:57.576214 run patchelf(pid=24189): Terminated: ok {rc=0} 04:23:57.698796 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24186): Process ended prematurely: osmo-stp_10.42.42.5(pid=24186) [trial-2354↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24186)] [trial-2354↪gprs:trx-lms↪iperf3m4.py:8] 04:23:57.708149 tst iperf3m4.py:8: Test FAILED (10.4 sec) 04:23:57.735677 run osmo-hlr_10.42.42.2(pid=24183): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-lms↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24183)] 04:23:57.783792 run osmo-hlr_10.42.42.2(pid=24183): stdout: | (launched: 2022-12-09_04:23:54.566384) 04:23:57.833438 run osmo-hlr_10.42.42.2(pid=24183): stderr: | 20221209042354746 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209042354746 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209042354746 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209042354746 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209042354746 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209042354746 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209042354758 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-lms/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209042354769 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209042354769 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209042354769 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:23:57.883283 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24172): Terminating (SIGTERM) 04:23:57.923041 run iperf3-srv_10.42.42.10(pid=24173): Terminating (SIGTERM) 04:23:57.962657 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24174): Terminating (SIGTERM) 04:23:58.002397 run iperf3-srv_10.42.42.10(pid=24175): Terminating (SIGTERM) 04:23:58.042345 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24176): Terminating (SIGTERM) 04:23:58.082028 run iperf3-srv_10.42.42.10(pid=24177): Terminating (SIGTERM) 04:23:58.121794 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24178): Terminating (SIGTERM) 04:23:58.161611 run iperf3-srv_10.42.42.10(pid=24179): Terminating (SIGTERM) 04:23:58.201067 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24182): Terminating (SIGTERM) 04:23:58.240708 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24185): Terminating (SIGTERM) 04:23:58.280445 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24188): Terminating (SIGTERM) 04:23:58.320307 --- ParallelTerminationStrategy: PID 24172 died... 04:23:58.339297 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24172): Terminated: ok {rc=0} 04:23:58.383250 --- ParallelTerminationStrategy: PID 24173 died... 04:23:58.401794 run iperf3-srv_10.42.42.10(pid=24173): Terminated {rc=256} 04:23:58.445526 --- ParallelTerminationStrategy: PID 24174 died... 04:23:58.463926 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24174): Terminated: ok {rc=0} 04:23:58.508478 --- ParallelTerminationStrategy: PID 24175 died... 04:23:58.527180 run iperf3-srv_10.42.42.10(pid=24175): Terminated {rc=256} 04:23:58.570904 --- ParallelTerminationStrategy: PID 24176 died... 04:23:58.589462 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24176): Terminated: ok {rc=0} 04:23:58.633287 --- ParallelTerminationStrategy: PID 24177 died... 04:23:58.651898 run iperf3-srv_10.42.42.10(pid=24177): Terminated {rc=256} 04:23:58.695637 --- ParallelTerminationStrategy: PID 24178 died... 04:23:58.714330 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24178): Terminated: ok {rc=0} 04:23:58.758339 --- ParallelTerminationStrategy: PID 24179 died... 04:23:58.777510 run iperf3-srv_10.42.42.10(pid=24179): Terminated {rc=256} 04:23:58.821528 --- ParallelTerminationStrategy: PID 24182 died... 04:23:58.840220 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24182): Terminated: ok {rc=0} 04:23:58.883760 --- ParallelTerminationStrategy: PID 24185 died... 04:23:58.902426 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24185): Terminated: ok {rc=0} 04:23:58.946749 --- ParallelTerminationStrategy: PID 24188 died... 04:23:58.965571 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24188): Terminated: ok {rc=0} 04:23:59.051953 bus /gobi_4: Setting Powered False 04:24:00.153995 bus /gobi_4: Setting Powered False 04:24:01.270230 bus /gobi_1: Setting Powered False 04:24:02.370081 bus /gobi_1: Setting Powered False 04:24:03.486624 bus /gobi_0: Setting Powered False 04:24:04.585971 bus /gobi_0: Setting Powered False 04:24:05.702115 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:trx-lms ping.py ---------------------------------------------- 04:24:06.808254 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:24:06.820031 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 04:24:06.871494 tst ping.py: using LAC 19047 04:24:06.997066 tst ping.py: using RAC 177 04:24:07.122645 tst ping.py: using CellId 19047 04:24:07.246434 tst ping.py: using BVCI 19048 04:24:07.362940 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:24:07.374040 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:24:07.384916 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:24:07.396148 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:24:07.407184 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:24:07.418276 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:24:07.429420 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:24:07.440482 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 04:24:07.557126 tst ping.py:19: start network... 04:24:07.756137 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:24:08.216356 run create_hlr_db(pid=24191): Launched 04:24:08.338687 bus /gobi_6: Setting Powered False 04:24:09.398664 run create_hlr_db(pid=24191): Terminated: ok {rc=0} 04:24:09.834210 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24193): Launched 04:24:10.151917 run osmo-hlr_10.42.42.2(pid=24194): Launched 04:24:10.275059 run osmo-stp_10.42.42.5: Starting osmo-stp 04:24:10.830349 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24196): Launched 04:24:11.150474 run osmo-stp_10.42.42.5(pid=24197): Launched 04:24:11.272504 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:24:11.792806 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24199): Launched 04:24:11.907260 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:24:12.157485 run patchelf(pid=24200): Launched 04:24:12.322920 run osmo-stp_10.42.42.5(pid=24197): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24197)] 04:24:12.449206 run osmo-stp_10.42.42.5(pid=24197): stdout: | (launched: 2022-12-09_04:24:11.092043) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:24:12.576519 run osmo-stp_10.42.42.5(pid=24197): stderr: | 20221209042411282 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042411282 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042411282 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042411283 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042411285 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042411285 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042411285 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:24:12.704331 run osmo-stp_10.42.42.5(pid=24197): stdout: | (launched: 2022-12-09_04:24:11.092043) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:24:12.826761 run osmo-stp_10.42.42.5(pid=24197): stderr: | 20221209042411282 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042411282 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042411282 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042411283 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042411285 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042411285 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042411285 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:24:12.972021 run patchelf(pid=24200): Terminating (SIGINT) 04:24:13.140692 run patchelf(pid=24200): Terminated: ok {rc=0} 04:24:13.261698 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=24197): Process ended prematurely: osmo-stp_10.42.42.5(pid=24197) [trial-2354↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24197)] [trial-2354↪gprs:trx-lms↪ping.py:22] 04:24:13.270580 tst ping.py:22: Test FAILED (6.5 sec) 04:24:13.297489 run osmo-hlr_10.42.42.2(pid=24194): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-lms↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24194)] 04:24:13.345685 run osmo-hlr_10.42.42.2(pid=24194): stdout: | (launched: 2022-12-09_04:24:10.094266) 04:24:13.395404 run osmo-hlr_10.42.42.2(pid=24194): stderr: | 20221209042410294 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209042410294 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209042410294 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209042410294 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209042410294 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209042410294 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209042410306 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-lms/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209042410314 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209042410314 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209042410315 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:24:13.445563 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24193): Terminating (SIGTERM) 04:24:13.485644 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24196): Terminating (SIGTERM) 04:24:13.525631 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24199): Terminating (SIGTERM) 04:24:13.565818 --- ParallelTerminationStrategy: PID 24193 died... 04:24:13.585259 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24193): Terminated: ok {rc=0} 04:24:13.629867 --- ParallelTerminationStrategy: PID 24196 died... 04:24:13.648620 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24196): Terminated: ok {rc=0} 04:24:13.693257 --- ParallelTerminationStrategy: PID 24199 died... 04:24:13.712245 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24199): Terminated: ok {rc=0} 04:24:13.799612 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:trx-lms ping_idle_ping.py ---------------------------------------------- 04:24:14.889653 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:24:14.901590 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 04:24:14.952898 tst ping_idle_ping.py: using LAC 19048 04:24:15.071801 tst ping_idle_ping.py: using RAC 178 04:24:15.188815 tst ping_idle_ping.py: using CellId 19048 04:24:15.305404 tst ping_idle_ping.py: using BVCI 19049 04:24:15.412852 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:24:15.423649 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:24:15.434369 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:24:15.444902 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:24:15.455512 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:24:15.465871 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:24:15.476285 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:24:15.487056 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 04:24:15.605562 tst ping_idle_ping.py:24: start network... 04:24:15.820229 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:24:16.343680 run create_hlr_db(pid=24201): Launched 04:24:16.533898 bus /gobi_6: Setting Powered False 04:24:17.593812 run create_hlr_db(pid=24201): Terminated: ok {rc=0} 04:24:18.098289 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24203): Launched 04:24:18.418980 run osmo-hlr_10.42.42.2(pid=24204): Launched 04:24:18.542915 run osmo-stp_10.42.42.5: Starting osmo-stp 04:24:19.097135 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24206): Launched 04:24:19.415541 run osmo-stp_10.42.42.5(pid=24207): Launched 04:24:19.537898 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:24:20.090568 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24209): Launched 04:24:20.214835 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:24:20.484679 run patchelf(pid=24210): Launched 04:24:20.664108 run osmo-stp_10.42.42.5(pid=24207): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24207)] 04:24:20.799365 run osmo-stp_10.42.42.5(pid=24207): stdout: | (launched: 2022-12-09_04:24:19.357542) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:24:20.936194 run osmo-stp_10.42.42.5(pid=24207): stderr: | 20221209042419551 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042419551 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042419551 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042419551 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042419552 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042419552 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042419552 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:24:21.072873 run osmo-stp_10.42.42.5(pid=24207): stdout: | (launched: 2022-12-09_04:24:19.357542) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:24:21.203762 run osmo-stp_10.42.42.5(pid=24207): stderr: | 20221209042419551 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042419551 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042419551 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042419551 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042419552 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042419552 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042419552 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:24:21.359102 run patchelf(pid=24210): Terminating (SIGINT) 04:24:21.538022 run patchelf(pid=24210): Terminated: ok {rc=0} 04:24:21.667215 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=24207): Process ended prematurely: osmo-stp_10.42.42.5(pid=24207) [trial-2354↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24207)] [trial-2354↪gprs:trx-lms↪ping_idle_ping.py:27] 04:24:21.676842 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 04:24:21.706194 run osmo-hlr_10.42.42.2(pid=24204): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-lms↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24204)] 04:24:21.757682 run osmo-hlr_10.42.42.2(pid=24204): stdout: | (launched: 2022-12-09_04:24:18.360813) 04:24:21.810804 run osmo-hlr_10.42.42.2(pid=24204): stderr: | 20221209042418561 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209042418561 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209042418561 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209042418561 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209042418561 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209042418561 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209042418573 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-lms/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209042418582 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209042418582 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209042418582 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:24:21.864260 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24203): Terminating (SIGTERM) 04:24:21.907221 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24206): Terminating (SIGTERM) 04:24:21.950151 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24209): Terminating (SIGTERM) 04:24:21.993344 --- ParallelTerminationStrategy: PID 24203 died... 04:24:22.013648 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24203): Terminated: ok {rc=0} 04:24:22.061332 --- ParallelTerminationStrategy: PID 24206 died... 04:24:22.081425 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24206): Terminated: ok {rc=0} 04:24:22.128656 --- ParallelTerminationStrategy: PID 24209 died... 04:24:22.148608 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24209): Terminated: ok {rc=0} 04:24:22.238305 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2354 gprs:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 gprs:trx-lms+mod-bts0-egprs --------------------------------------------------------------------- 04:24:23.545325 tst gprs:trx-lms+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:24:23.551596 tst gprs:trx-lms+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 04:24:23.586661 tst gprs:trx-lms+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 04:24:23.626548 tst gprs:trx-lms+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 04:24:23.714847 tst gprs:trx-lms+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 04:24:23.749441 tst gprs:trx-lms+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 04:24:23.789162 tst gprs:trx-lms+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 04:24:24.382751 tst gprs:trx-lms+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2354 gprs:trx-lms+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 04:24:24.435510 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:24:24.447075 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:24:24.499169 tst cs_paging_gprs_active.py: using LAC 19049 04:24:24.626961 tst cs_paging_gprs_active.py: using RAC 179 04:24:24.755403 tst cs_paging_gprs_active.py: using CellId 19049 04:24:24.883369 tst cs_paging_gprs_active.py: using BVCI 19050 04:24:25.000917 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:24:25.012321 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:24:25.023433 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:24:25.034816 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:24:25.046191 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:24:25.057569 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:24:25.068921 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:24:25.080935 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:24:25.092610 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:24:25.210077 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:24:25.331665 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 04:24:25.550419 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:24:25.877150 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24214): Launched 04:24:26.160328 run iperf3-srv_10.42.42.10(pid=24215): Launched 04:24:26.282603 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 04:24:26.501140 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:24:26.827761 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24216): Launched 04:24:27.110908 run iperf3-srv_10.42.42.10(pid=24217): Launched 04:24:27.232914 tst cs_paging_gprs_active.py:38: start network... 04:24:27.451529 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:24:27.954493 run create_hlr_db(pid=24218): Launched 04:24:28.079878 bus /gobi_6: Setting Powered False 04:24:29.143457 run create_hlr_db(pid=24218): Terminated: ok {rc=0} 04:24:29.576596 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24220): Launched 04:24:29.881664 run osmo-hlr_10.42.42.2(pid=24221): Launched 04:24:29.997508 run osmo-stp_10.42.42.5: Starting osmo-stp 04:24:30.532853 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24223): Launched 04:24:30.843887 run osmo-stp_10.42.42.5(pid=24224): Launched 04:24:31.044916 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:24:31.713749 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24226): Launched 04:24:31.868114 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:24:32.190854 run patchelf(pid=24227): Launched 04:24:32.390091 run osmo-stp_10.42.42.5(pid=24224): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24224)] 04:24:32.528567 run osmo-stp_10.42.42.5(pid=24224): stdout: | (launched: 2022-12-09_04:24:30.780089) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:24:32.668052 run osmo-stp_10.42.42.5(pid=24224): stderr: | 20221209042431082 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042431083 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042431084 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042431084 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042431085 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042431085 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042431086 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:24:32.808017 run osmo-stp_10.42.42.5(pid=24224): stdout: | (launched: 2022-12-09_04:24:30.780089) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:24:32.942065 run osmo-stp_10.42.42.5(pid=24224): stderr: | 20221209042431082 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042431083 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042431084 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042431084 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042431085 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042431085 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042431086 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:24:33.101411 run patchelf(pid=24227): Terminating (SIGINT) 04:24:33.285421 run patchelf(pid=24227): Terminated: ok {rc=0} 04:24:33.417905 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=24224): Process ended prematurely: osmo-stp_10.42.42.5(pid=24224) [trial-2354↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24224)] [trial-2354↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 04:24:33.428329 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 04:24:33.458000 run osmo-hlr_10.42.42.2(pid=24221): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24221)] 04:24:33.509196 run osmo-hlr_10.42.42.2(pid=24221): stdout: | (launched: 2022-12-09_04:24:29.826112) 04:24:33.562003 run osmo-hlr_10.42.42.2(pid=24221): stderr: | 20221209042430002 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209042430002 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209042430002 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209042430002 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209042430002 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209042430002 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209042430014 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-lms+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209042430023 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209042430023 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209042430023 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:24:33.615104 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24214): Terminating (SIGTERM) 04:24:33.657637 run iperf3-srv_10.42.42.10(pid=24215): Terminating (SIGTERM) 04:24:33.699994 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24216): Terminating (SIGTERM) 04:24:33.743193 run iperf3-srv_10.42.42.10(pid=24217): Terminating (SIGTERM) 04:24:33.785915 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24220): Terminating (SIGTERM) 04:24:33.828449 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24223): Terminating (SIGTERM) 04:24:33.870911 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24226): Terminating (SIGTERM) 04:24:33.913445 --- ParallelTerminationStrategy: PID 24214 died... 04:24:33.933379 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24214): Terminated: ok {rc=0} 04:24:33.980873 --- ParallelTerminationStrategy: PID 24215 died... 04:24:34.000429 run iperf3-srv_10.42.42.10(pid=24215): Terminated {rc=256} 04:24:34.047512 --- ParallelTerminationStrategy: PID 24216 died... 04:24:34.067238 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24216): Terminated: ok {rc=0} 04:24:34.114248 --- ParallelTerminationStrategy: PID 24217 died... 04:24:34.133933 run iperf3-srv_10.42.42.10(pid=24217): Terminated {rc=256} 04:24:34.180732 --- ParallelTerminationStrategy: PID 24220 died... 04:24:34.200481 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24220): Terminated: ok {rc=0} 04:24:34.247528 --- ParallelTerminationStrategy: PID 24223 died... 04:24:34.267272 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24223): Terminated: ok {rc=0} 04:24:34.314359 --- ParallelTerminationStrategy: PID 24226 died... 04:24:34.334128 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24226): Terminated: ok {rc=0} 04:24:34.423319 bus /gobi_0: Setting Powered False 04:24:35.523512 bus /gobi_0: Setting Powered False 04:24:36.641398 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:trx-lms+mod-bts0-egprs iperf3.py ---------------------------------------------- 04:24:37.790550 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:24:37.802634 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:24:37.855115 tst iperf3.py: using LAC 19050 04:24:37.981570 tst iperf3.py: using RAC 180 04:24:38.110175 tst iperf3.py: using CellId 19050 04:24:38.239943 tst iperf3.py: using BVCI 19051 04:24:38.358707 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:24:38.370148 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:24:38.381245 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:24:38.392694 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:24:38.404118 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:24:38.415435 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:24:38.427123 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:24:38.438648 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:24:38.450180 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:24:38.568719 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 04:24:38.788380 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:24:39.115472 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24228): Launched 04:24:39.399941 run iperf3-srv_10.42.42.10(pid=24229): Launched 04:24:39.522360 tst iperf3.py:8: start network... 04:24:39.740620 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:24:40.242620 run create_hlr_db(pid=24230): Launched 04:24:40.365930 bus /gobi_6: Setting Powered False 04:24:41.429998 run create_hlr_db(pid=24230): Terminated: ok {rc=0} 04:24:41.865979 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24232): Launched 04:24:42.169760 run osmo-hlr_10.42.42.2(pid=24233): Launched 04:24:42.286010 run osmo-stp_10.42.42.5: Starting osmo-stp 04:24:42.808113 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24235): Launched 04:24:43.109783 run osmo-stp_10.42.42.5(pid=24236): Launched 04:24:43.225067 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:24:43.747768 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24238): Launched 04:24:43.863409 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:24:44.118287 run patchelf(pid=24239): Launched 04:24:44.287742 run osmo-stp_10.42.42.5(pid=24236): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24236)] 04:24:44.414917 run osmo-stp_10.42.42.5(pid=24236): stdout: | (launched: 2022-12-09_04:24:43.053531) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:24:44.543849 run osmo-stp_10.42.42.5(pid=24236): stderr: | 20221209042443225 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042443225 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042443226 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042443226 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042443226 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042443226 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042443227 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:24:44.672764 run osmo-stp_10.42.42.5(pid=24236): stdout: | (launched: 2022-12-09_04:24:43.053531) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:24:44.796250 run osmo-stp_10.42.42.5(pid=24236): stderr: | 20221209042443225 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042443225 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042443226 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042443226 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042443226 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042443226 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042443227 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:24:44.942349 run patchelf(pid=24239): Terminating (SIGINT) 04:24:45.112785 run patchelf(pid=24239): Terminated: ok {rc=0} 04:24:45.236045 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24236): Process ended prematurely: osmo-stp_10.42.42.5(pid=24236) [trial-2354↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24236)] [trial-2354↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8] 04:24:45.245507 tst iperf3.py:8: Test FAILED (7.5 sec) 04:24:45.272836 run osmo-hlr_10.42.42.2(pid=24233): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24233)] 04:24:45.321176 run osmo-hlr_10.42.42.2(pid=24233): stdout: | (launched: 2022-12-09_04:24:42.114127) 04:24:45.370853 run osmo-hlr_10.42.42.2(pid=24233): stderr: | 20221209042442289 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209042442289 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209042442289 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209042442289 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209042442289 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209042442289 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209042442301 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-lms+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209042442311 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209042442311 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209042442311 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:24:45.421194 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24228): Terminating (SIGTERM) 04:24:45.461137 run iperf3-srv_10.42.42.10(pid=24229): Terminating (SIGTERM) 04:24:45.500907 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24232): Terminating (SIGTERM) 04:24:45.540852 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24235): Terminating (SIGTERM) 04:24:45.581070 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24238): Terminating (SIGTERM) 04:24:45.621284 --- ParallelTerminationStrategy: PID 24228 died... 04:24:45.640420 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24228): Terminated: ok {rc=0} 04:24:45.684537 --- ParallelTerminationStrategy: PID 24229 died... 04:24:45.703353 run iperf3-srv_10.42.42.10(pid=24229): Terminated {rc=256} 04:24:45.747176 --- ParallelTerminationStrategy: PID 24232 died... 04:24:45.765873 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24232): Terminated: ok {rc=0} 04:24:45.810024 --- ParallelTerminationStrategy: PID 24235 died... 04:24:45.831072 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24235): Terminated: ok {rc=0} 04:24:45.878194 --- ParallelTerminationStrategy: PID 24238 died... 04:24:45.915288 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24238): Terminated: ok {rc=0} 04:24:46.000460 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:trx-lms+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 04:24:47.155317 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:24:47.168431 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:24:47.222667 tst iperf3m4.py: using LAC 19051 04:24:47.354015 tst iperf3m4.py: using RAC 181 04:24:47.494560 tst iperf3m4.py: using CellId 19051 04:24:47.621788 tst iperf3m4.py: using BVCI 19052 04:24:47.739476 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:24:47.750994 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:24:47.762558 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:24:47.774150 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:24:47.785379 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:24:47.796529 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:24:47.807964 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:24:47.819201 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:24:47.830764 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:24:47.950350 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:24:48.070931 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:24:48.190936 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:24:48.309871 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 04:24:48.512318 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:24:48.816499 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24240): Launched 04:24:49.081399 run iperf3-srv_10.42.42.10(pid=24241): Launched 04:24:49.195781 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 04:24:49.397533 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:24:49.701253 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24242): Launched 04:24:49.965698 run iperf3-srv_10.42.42.10(pid=24243): Launched 04:24:50.079529 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 04:24:50.281971 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:24:50.585793 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24244): Launched 04:24:50.850362 run iperf3-srv_10.42.42.10(pid=24245): Launched 04:24:50.963709 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 04:24:51.165437 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:24:51.469467 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24246): Launched 04:24:51.733228 run iperf3-srv_10.42.42.10(pid=24247): Launched 04:24:51.847119 tst iperf3m4.py:8: start network... 04:24:52.048593 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:24:52.517724 run create_hlr_db(pid=24248): Launched 04:24:52.643014 bus /gobi_6: Setting Powered False 04:24:53.703566 run create_hlr_db(pid=24248): Terminated: ok {rc=0} 04:24:54.145605 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24250): Launched 04:24:54.469962 run osmo-hlr_10.42.42.2(pid=24251): Launched 04:24:54.594745 run osmo-stp_10.42.42.5: Starting osmo-stp 04:24:55.159797 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24253): Launched 04:24:55.485774 run osmo-stp_10.42.42.5(pid=24254): Launched 04:24:55.610818 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:24:56.169861 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24256): Launched 04:24:56.295066 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:24:56.569233 run patchelf(pid=24257): Launched 04:24:56.750230 run osmo-stp_10.42.42.5(pid=24254): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24254)] 04:24:56.888119 run osmo-stp_10.42.42.5(pid=24254): stdout: | (launched: 2022-12-09_04:24:55.426074) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:24:57.027250 run osmo-stp_10.42.42.5(pid=24254): stderr: | 20221209042455621 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042455621 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042455621 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042455622 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042455622 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042455622 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042455622 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:24:57.166552 run osmo-stp_10.42.42.5(pid=24254): stdout: | (launched: 2022-12-09_04:24:55.426074) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:24:57.299823 run osmo-stp_10.42.42.5(pid=24254): stderr: | 20221209042455621 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042455621 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042455621 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042455622 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042455622 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042455622 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042455622 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:24:57.457884 run patchelf(pid=24257): Terminating (SIGINT) 04:24:57.640716 run patchelf(pid=24257): Terminated: ok {rc=0} 04:24:57.772632 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24254): Process ended prematurely: osmo-stp_10.42.42.5(pid=24254) [trial-2354↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24254)] [trial-2354↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8] 04:24:57.782934 tst iperf3m4.py:8: Test FAILED (10.7 sec) 04:24:57.812849 run osmo-hlr_10.42.42.2(pid=24251): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24251)] 04:24:57.864027 run osmo-hlr_10.42.42.2(pid=24251): stdout: | (launched: 2022-12-09_04:24:54.410302) 04:24:57.916758 run osmo-hlr_10.42.42.2(pid=24251): stderr: | 20221209042454611 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209042454611 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209042454611 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209042454611 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209042454611 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209042454611 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209042454623 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-lms+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209042454632 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209042454632 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209042454632 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:24:57.969952 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24240): Terminating (SIGTERM) 04:24:58.012403 run iperf3-srv_10.42.42.10(pid=24241): Terminating (SIGTERM) 04:24:58.056151 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24242): Terminating (SIGTERM) 04:24:58.099322 run iperf3-srv_10.42.42.10(pid=24243): Terminating (SIGTERM) 04:24:58.141639 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24244): Terminating (SIGTERM) 04:24:58.184047 run iperf3-srv_10.42.42.10(pid=24245): Terminating (SIGTERM) 04:24:58.226416 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24246): Terminating (SIGTERM) 04:24:58.268862 run iperf3-srv_10.42.42.10(pid=24247): Terminating (SIGTERM) 04:24:58.311215 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24250): Terminating (SIGTERM) 04:24:58.353413 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24253): Terminating (SIGTERM) 04:24:58.395584 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24256): Terminating (SIGTERM) 04:24:58.437964 --- ParallelTerminationStrategy: PID 24240 died... 04:24:58.458110 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24240): Terminated: ok {rc=0} 04:24:58.505255 --- ParallelTerminationStrategy: PID 24241 died... 04:24:58.525036 run iperf3-srv_10.42.42.10(pid=24241): Terminated {rc=256} 04:24:58.571884 --- ParallelTerminationStrategy: PID 24242 died... 04:24:58.591600 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24242): Terminated: ok {rc=0} 04:24:58.639000 --- ParallelTerminationStrategy: PID 24243 died... 04:24:58.658726 run iperf3-srv_10.42.42.10(pid=24243): Terminated {rc=256} 04:24:58.705581 --- ParallelTerminationStrategy: PID 24244 died... 04:24:58.725427 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24244): Terminated: ok {rc=0} 04:24:58.772745 --- ParallelTerminationStrategy: PID 24245 died... 04:24:58.792518 run iperf3-srv_10.42.42.10(pid=24245): Terminated {rc=256} 04:24:58.839483 --- ParallelTerminationStrategy: PID 24246 died... 04:24:58.859312 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24246): Terminated: ok {rc=0} 04:24:58.906314 --- ParallelTerminationStrategy: PID 24247 died... 04:24:58.926236 run iperf3-srv_10.42.42.10(pid=24247): Terminated {rc=256} 04:24:58.973263 --- ParallelTerminationStrategy: PID 24250 died... 04:24:58.993157 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24250): Terminated: ok {rc=0} 04:24:59.040079 --- ParallelTerminationStrategy: PID 24253 died... 04:24:59.059860 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24253): Terminated: ok {rc=0} 04:24:59.107104 --- ParallelTerminationStrategy: PID 24256 died... 04:24:59.126933 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24256): Terminated: ok {rc=0} 04:24:59.215659 bus /gobi_4: Setting Powered False 04:25:00.315679 bus /gobi_4: Setting Powered False 04:25:01.433827 bus /gobi_1: Setting Powered False 04:25:02.556110 bus /gobi_1: Setting Powered False 04:25:03.674378 bus /gobi_0: Setting Powered False 04:25:04.773865 bus /gobi_0: Setting Powered False 04:25:05.892082 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:trx-lms+mod-bts0-egprs ping.py ---------------------------------------------- 04:25:06.996862 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:25:07.009507 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:25:07.061708 tst ping.py: using LAC 19052 04:25:07.191434 tst ping.py: using RAC 182 04:25:07.315435 tst ping.py: using CellId 19052 04:25:07.432922 tst ping.py: using BVCI 19053 04:25:07.541318 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:25:07.552277 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:25:07.563138 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:25:07.574035 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:25:07.584601 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:25:07.595302 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:25:07.606080 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:25:07.616624 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:25:07.730164 tst ping.py:19: start network... 04:25:07.928810 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:25:08.389997 run create_hlr_db(pid=24261): Launched 04:25:08.512780 bus /gobi_6: Setting Powered False 04:25:09.570895 run create_hlr_db(pid=24261): Terminated: ok {rc=0} 04:25:10.005388 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24263): Launched 04:25:10.324595 run osmo-hlr_10.42.42.2(pid=24264): Launched 04:25:10.448045 run osmo-stp_10.42.42.5: Starting osmo-stp 04:25:11.000928 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24266): Launched 04:25:11.319463 run osmo-stp_10.42.42.5(pid=24267): Launched 04:25:11.443353 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:25:11.993720 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24269): Launched 04:25:12.118478 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:25:12.387740 run patchelf(pid=24270): Launched 04:25:12.566364 run osmo-stp_10.42.42.5(pid=24267): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24267)] 04:25:12.701091 run osmo-stp_10.42.42.5(pid=24267): stdout: | (launched: 2022-12-09_04:25:11.261291) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:25:12.838413 run osmo-stp_10.42.42.5(pid=24267): stderr: | 20221209042511453 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042511453 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042511453 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042511454 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042511454 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042511454 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042511454 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:25:12.975142 run osmo-stp_10.42.42.5(pid=24267): stdout: | (launched: 2022-12-09_04:25:11.261291) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:25:13.105884 run osmo-stp_10.42.42.5(pid=24267): stderr: | 20221209042511453 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042511453 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042511453 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042511454 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042511454 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042511454 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042511454 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:25:13.261239 run patchelf(pid=24270): Terminating (SIGINT) 04:25:13.440359 run patchelf(pid=24270): Terminated: ok {rc=0} 04:25:13.569304 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=24267): Process ended prematurely: osmo-stp_10.42.42.5(pid=24267) [trial-2354↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24267)] [trial-2354↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22] 04:25:13.578936 tst ping.py:22: Test FAILED (6.6 sec) 04:25:13.608145 run osmo-hlr_10.42.42.2(pid=24264): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-lms+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24264)] 04:25:13.659155 run osmo-hlr_10.42.42.2(pid=24264): stdout: | (launched: 2022-12-09_04:25:10.266609) 04:25:13.712041 run osmo-hlr_10.42.42.2(pid=24264): stderr: | 20221209042510463 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209042510463 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209042510463 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209042510463 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209042510463 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209042510463 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209042510475 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-lms+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209042510483 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209042510484 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209042510484 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:25:13.765425 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24263): Terminating (SIGTERM) 04:25:13.808361 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24266): Terminating (SIGTERM) 04:25:13.851037 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24269): Terminating (SIGTERM) 04:25:13.894129 --- ParallelTerminationStrategy: PID 24263 died... 04:25:13.914471 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24263): Terminated: ok {rc=0} 04:25:13.961905 --- ParallelTerminationStrategy: PID 24266 died... 04:25:13.981823 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24266): Terminated: ok {rc=0} 04:25:14.028918 --- ParallelTerminationStrategy: PID 24269 died... 04:25:14.048892 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24269): Terminated: ok {rc=0} 04:25:14.138048 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:trx-lms+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 04:25:15.225766 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:25:15.237789 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:25:15.289159 tst ping_idle_ping.py: using LAC 19053 04:25:15.408171 tst ping_idle_ping.py: using RAC 183 04:25:15.524679 tst ping_idle_ping.py: using CellId 19053 04:25:15.641323 tst ping_idle_ping.py: using BVCI 19054 04:25:15.749578 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:25:15.760384 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:25:15.771041 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:25:15.781777 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:25:15.792265 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:25:15.802929 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:25:15.813766 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:25:15.824371 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:25:15.956081 tst ping_idle_ping.py:24: start network... 04:25:16.162760 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:25:16.635369 run create_hlr_db(pid=24271): Launched 04:25:16.780024 bus /gobi_6: Setting Powered False 04:25:17.843728 run create_hlr_db(pid=24271): Terminated: ok {rc=0} 04:25:18.288893 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24273): Launched 04:25:18.608033 run osmo-hlr_10.42.42.2(pid=24274): Launched 04:25:18.730438 run osmo-stp_10.42.42.5: Starting osmo-stp 04:25:19.247334 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24276): Launched 04:25:19.545433 run osmo-stp_10.42.42.5(pid=24277): Launched 04:25:19.659524 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:25:20.172873 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24279): Launched 04:25:20.287157 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:25:20.539214 run patchelf(pid=24280): Launched 04:25:20.704738 run osmo-stp_10.42.42.5(pid=24277): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24277)] 04:25:20.830565 run osmo-stp_10.42.42.5(pid=24277): stdout: | (launched: 2022-12-09_04:25:19.490504) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:25:20.958201 run osmo-stp_10.42.42.5(pid=24277): stderr: | 20221209042519660 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042519660 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042519661 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042519661 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042519661 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042519661 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042519662 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:25:21.085944 run osmo-stp_10.42.42.5(pid=24277): stdout: | (launched: 2022-12-09_04:25:19.490504) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:25:21.207993 run osmo-stp_10.42.42.5(pid=24277): stderr: | 20221209042519660 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042519660 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042519661 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042519661 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042519661 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042519661 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042519662 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:25:21.352452 run patchelf(pid=24280): Terminating (SIGINT) 04:25:21.521254 run patchelf(pid=24280): Terminated: ok {rc=0} 04:25:21.642667 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=24277): Process ended prematurely: osmo-stp_10.42.42.5(pid=24277) [trial-2354↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24277)] [trial-2354↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27] 04:25:21.651581 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 04:25:21.678558 run osmo-hlr_10.42.42.2(pid=24274): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24274)] 04:25:21.726700 run osmo-hlr_10.42.42.2(pid=24274): stdout: | (launched: 2022-12-09_04:25:18.549683) 04:25:21.776487 run osmo-hlr_10.42.42.2(pid=24274): stderr: | 20221209042518750 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209042518750 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209042518750 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209042518750 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209042518750 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209042518750 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209042518764 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-lms+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209042518774 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209042518774 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209042518774 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:25:21.826704 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24273): Terminating (SIGTERM) 04:25:21.866719 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24276): Terminating (SIGTERM) 04:25:21.906786 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24279): Terminating (SIGTERM) 04:25:21.947105 --- ParallelTerminationStrategy: PID 24273 died... 04:25:21.966372 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24273): Terminated: ok {rc=0} 04:25:22.010548 --- ParallelTerminationStrategy: PID 24276 died... 04:25:22.029414 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24276): Terminated: ok {rc=0} 04:25:22.073442 --- ParallelTerminationStrategy: PID 24279 died... 04:25:22.091998 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24279): Terminated: ok {rc=0} 04:25:22.178740 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2354 gprs:trx-lms+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 gprs:trx-lms+mod-bts0-dynts-ipa --------------------------------------------------------------------- 04:25:23.482528 tst gprs:trx-lms+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:25:23.489111 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 04:25:23.522393 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 04:25:23.560635 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 04:25:23.646613 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 04:25:23.679645 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 04:25:23.717806 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 04:25:24.315532 tst gprs:trx-lms+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2354 gprs:trx-lms+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 04:25:24.370283 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:25:24.381897 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:25:24.453391 tst cs_paging_gprs_active.py: using LAC 19054 04:25:24.582521 tst cs_paging_gprs_active.py: using RAC 184 04:25:24.709462 tst cs_paging_gprs_active.py: using CellId 19054 04:25:24.837800 tst cs_paging_gprs_active.py: using BVCI 19055 04:25:24.957514 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:25:24.968753 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:25:24.979935 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:25:24.991292 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:25:25.002639 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:25:25.014105 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:25:25.025666 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:25:25.036734 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:25:25.048373 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:25:25.170797 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:25:25.292234 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 04:25:25.511644 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:25:25.837726 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24286): Launched 04:25:26.121554 run iperf3-srv_10.42.42.10(pid=24287): Launched 04:25:26.243349 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 04:25:26.461775 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:25:26.788523 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24288): Launched 04:25:27.071585 run iperf3-srv_10.42.42.10(pid=24289): Launched 04:25:27.195193 tst cs_paging_gprs_active.py:38: start network... 04:25:27.413493 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:25:27.917760 run create_hlr_db(pid=24290): Launched 04:25:28.042983 bus /gobi_6: Setting Powered False 04:25:29.107525 run create_hlr_db(pid=24290): Terminated: ok {rc=0} 04:25:29.541981 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24292): Launched 04:25:29.845703 run osmo-hlr_10.42.42.2(pid=24293): Launched 04:25:29.961158 run osmo-stp_10.42.42.5: Starting osmo-stp 04:25:30.481504 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24295): Launched 04:25:30.784294 run osmo-stp_10.42.42.5(pid=24296): Launched 04:25:31.007402 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:25:31.664852 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24298): Launched 04:25:31.823221 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:25:32.116018 run patchelf(pid=24299): Launched 04:25:32.312940 run osmo-stp_10.42.42.5(pid=24296): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24296)] 04:25:32.451713 run osmo-stp_10.42.42.5(pid=24296): stdout: | (launched: 2022-12-09_04:25:30.728280) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:25:32.591486 run osmo-stp_10.42.42.5(pid=24296): stderr: | 20221209042530963 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042530963 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042530964 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042530964 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042530969 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042530969 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042530969 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:25:32.731601 run osmo-stp_10.42.42.5(pid=24296): stdout: | (launched: 2022-12-09_04:25:30.728280) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:25:32.866185 run osmo-stp_10.42.42.5(pid=24296): stderr: | 20221209042530963 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042530963 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042530964 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042530964 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042530969 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042530969 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042530969 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:25:33.025065 run patchelf(pid=24299): Terminating (SIGINT) 04:25:33.208903 run patchelf(pid=24299): Terminated: ok {rc=0} 04:25:33.342241 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=24296): Process ended prematurely: osmo-stp_10.42.42.5(pid=24296) [trial-2354↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24296)] [trial-2354↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 04:25:33.352757 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 04:25:33.383589 run osmo-hlr_10.42.42.2(pid=24293): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24293)] 04:25:33.435138 run osmo-hlr_10.42.42.2(pid=24293): stdout: | (launched: 2022-12-09_04:25:29.789789) 04:25:33.488514 run osmo-hlr_10.42.42.2(pid=24293): stderr: | 20221209042529966 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209042529966 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209042529967 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209042529967 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209042529967 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209042529967 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209042529983 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-lms+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209042529992 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209042529992 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209042529992 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:25:33.542562 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24286): Terminating (SIGTERM) 04:25:33.586067 run iperf3-srv_10.42.42.10(pid=24287): Terminating (SIGTERM) 04:25:33.629758 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24288): Terminating (SIGTERM) 04:25:33.673456 run iperf3-srv_10.42.42.10(pid=24289): Terminating (SIGTERM) 04:25:33.716838 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24292): Terminating (SIGTERM) 04:25:33.760274 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24295): Terminating (SIGTERM) 04:25:33.804090 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24298): Terminating (SIGTERM) 04:25:33.847931 --- ParallelTerminationStrategy: PID 24286 died... 04:25:33.868105 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24286): Terminated: ok {rc=0} 04:25:33.916887 --- ParallelTerminationStrategy: PID 24287 died... 04:25:33.937012 run iperf3-srv_10.42.42.10(pid=24287): Terminated {rc=256} 04:25:33.985644 --- ParallelTerminationStrategy: PID 24288 died... 04:25:34.005689 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24288): Terminated: ok {rc=0} 04:25:34.054613 --- ParallelTerminationStrategy: PID 24289 died... 04:25:34.075061 run iperf3-srv_10.42.42.10(pid=24289): Terminated {rc=256} 04:25:34.123702 --- ParallelTerminationStrategy: PID 24292 died... 04:25:34.143807 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24292): Terminated: ok {rc=0} 04:25:34.192359 --- ParallelTerminationStrategy: PID 24295 died... 04:25:34.212495 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24295): Terminated: ok {rc=0} 04:25:34.261076 --- ParallelTerminationStrategy: PID 24298 died... 04:25:34.281174 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24298): Terminated: ok {rc=0} 04:25:34.370918 bus /gobi_0: Setting Powered False 04:25:35.470776 bus /gobi_0: Setting Powered False 04:25:36.589328 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:trx-lms+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 04:25:37.739252 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:25:37.751385 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:25:37.824629 tst iperf3.py: using LAC 19055 04:25:37.951040 tst iperf3.py: using RAC 185 04:25:38.077648 tst iperf3.py: using CellId 19055 04:25:38.205731 tst iperf3.py: using BVCI 19056 04:25:38.317863 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:25:38.328580 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:25:38.339290 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:25:38.350588 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:25:38.361817 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:25:38.372887 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:25:38.384153 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:25:38.395307 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:25:38.406680 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:25:38.526634 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 04:25:38.745916 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:25:39.071791 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24300): Launched 04:25:39.356451 run iperf3-srv_10.42.42.10(pid=24301): Launched 04:25:39.478925 tst iperf3.py:8: start network... 04:25:39.697998 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:25:40.201123 run create_hlr_db(pid=24302): Launched 04:25:40.327461 bus /gobi_6: Setting Powered False 04:25:41.392265 run create_hlr_db(pid=24302): Terminated: ok {rc=0} 04:25:41.826055 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24304): Launched 04:25:42.129179 run osmo-hlr_10.42.42.2(pid=24305): Launched 04:25:42.244581 run osmo-stp_10.42.42.5: Starting osmo-stp 04:25:42.767222 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24307): Launched 04:25:43.069545 run osmo-stp_10.42.42.5(pid=24308): Launched 04:25:43.186320 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:25:43.709721 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24310): Launched 04:25:43.825150 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:25:44.081065 run patchelf(pid=24311): Launched 04:25:44.248498 run osmo-stp_10.42.42.5(pid=24308): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24308)] 04:25:44.375796 run osmo-stp_10.42.42.5(pid=24308): stdout: | (launched: 2022-12-09_04:25:43.013295) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:25:44.505126 run osmo-stp_10.42.42.5(pid=24308): stderr: | 20221209042543186 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042543186 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042543187 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042543187 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042543188 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042543188 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042543188 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:25:44.634138 run osmo-stp_10.42.42.5(pid=24308): stdout: | (launched: 2022-12-09_04:25:43.013295) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:25:44.757497 run osmo-stp_10.42.42.5(pid=24308): stderr: | 20221209042543186 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042543186 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042543187 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042543187 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042543188 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042543188 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042543188 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:25:44.904172 run patchelf(pid=24311): Terminating (SIGINT) 04:25:45.074639 run patchelf(pid=24311): Terminated: ok {rc=0} 04:25:45.197459 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24308): Process ended prematurely: osmo-stp_10.42.42.5(pid=24308) [trial-2354↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24308)] [trial-2354↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8] 04:25:45.206828 tst iperf3.py:8: Test FAILED (7.5 sec) 04:25:45.234335 run osmo-hlr_10.42.42.2(pid=24305): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24305)] 04:25:45.281960 run osmo-hlr_10.42.42.2(pid=24305): stdout: | (launched: 2022-12-09_04:25:42.073390) 04:25:45.331423 run osmo-hlr_10.42.42.2(pid=24305): stderr: | 20221209042542248 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209042542248 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209042542248 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209042542248 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209042542248 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209042542248 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209042542261 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209042542270 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209042542270 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209042542270 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:25:45.381326 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24300): Terminating (SIGTERM) 04:25:45.421156 run iperf3-srv_10.42.42.10(pid=24301): Terminating (SIGTERM) 04:25:45.461035 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24304): Terminating (SIGTERM) 04:25:45.500851 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24307): Terminating (SIGTERM) 04:25:45.540625 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24310): Terminating (SIGTERM) 04:25:45.580639 --- ParallelTerminationStrategy: PID 24300 died... 04:25:45.599827 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24300): Terminated: ok {rc=0} 04:25:45.644501 --- ParallelTerminationStrategy: PID 24301 died... 04:25:45.663310 run iperf3-srv_10.42.42.10(pid=24301): Terminated {rc=256} 04:25:45.707099 --- ParallelTerminationStrategy: PID 24304 died... 04:25:45.725791 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24304): Terminated: ok {rc=0} 04:25:45.769587 --- ParallelTerminationStrategy: PID 24307 died... 04:25:45.788254 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24307): Terminated: ok {rc=0} 04:25:45.836339 --- ParallelTerminationStrategy: PID 24310 died... 04:25:45.856705 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24310): Terminated: ok {rc=0} 04:25:45.957188 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:trx-lms+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 04:25:47.109196 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:25:47.122260 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:25:47.198473 tst iperf3m4.py: using LAC 19056 04:25:47.329402 tst iperf3m4.py: using RAC 186 04:25:47.462938 tst iperf3m4.py: using CellId 19056 04:25:47.590015 tst iperf3m4.py: using BVCI 19057 04:25:47.708177 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:25:47.719747 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:25:47.731140 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:25:47.742835 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:25:47.754412 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:25:47.766021 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:25:47.777560 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:25:47.789270 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:25:47.801048 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:25:47.921550 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:25:48.045045 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:25:48.166353 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:25:48.284222 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 04:25:48.486977 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:25:48.791402 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24312): Launched 04:25:49.055462 run iperf3-srv_10.42.42.10(pid=24313): Launched 04:25:49.169877 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 04:25:49.371596 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:25:49.676103 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24314): Launched 04:25:49.940086 run iperf3-srv_10.42.42.10(pid=24315): Launched 04:25:50.053633 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 04:25:50.254765 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:25:50.558226 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24316): Launched 04:25:50.824583 run iperf3-srv_10.42.42.10(pid=24317): Launched 04:25:50.938418 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 04:25:51.139675 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:25:51.443286 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24318): Launched 04:25:51.708699 run iperf3-srv_10.42.42.10(pid=24319): Launched 04:25:51.822818 tst iperf3m4.py:8: start network... 04:25:52.024450 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:25:52.494236 run create_hlr_db(pid=24320): Launched 04:25:52.621844 bus /gobi_6: Setting Powered False 04:25:53.682693 run create_hlr_db(pid=24320): Terminated: ok {rc=0} 04:25:54.126904 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24322): Launched 04:25:54.450839 run osmo-hlr_10.42.42.2(pid=24323): Launched 04:25:54.576454 run osmo-stp_10.42.42.5: Starting osmo-stp 04:25:55.138051 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24325): Launched 04:25:55.463482 run osmo-stp_10.42.42.5(pid=24326): Launched 04:25:55.588026 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:25:56.145703 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24328): Launched 04:25:56.271745 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:25:56.545662 run patchelf(pid=24329): Launched 04:25:56.725941 run osmo-stp_10.42.42.5(pid=24326): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24326)] 04:25:56.863630 run osmo-stp_10.42.42.5(pid=24326): stdout: | (launched: 2022-12-09_04:25:55.404058) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:25:57.002725 run osmo-stp_10.42.42.5(pid=24326): stderr: | 20221209042555598 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042555598 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042555598 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042555599 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042555599 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042555599 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042555599 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:25:57.141954 run osmo-stp_10.42.42.5(pid=24326): stdout: | (launched: 2022-12-09_04:25:55.404058) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:25:57.274948 run osmo-stp_10.42.42.5(pid=24326): stderr: | 20221209042555598 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042555598 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042555598 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042555599 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042555599 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042555599 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042555599 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:25:57.432213 run patchelf(pid=24329): Terminating (SIGINT) 04:25:57.614643 run patchelf(pid=24329): Terminated: ok {rc=0} 04:25:57.745963 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24326): Process ended prematurely: osmo-stp_10.42.42.5(pid=24326) [trial-2354↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24326)] [trial-2354↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8] 04:25:57.756167 tst iperf3m4.py:8: Test FAILED (10.7 sec) 04:25:57.786200 run osmo-hlr_10.42.42.2(pid=24323): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24323)] 04:25:57.837866 run osmo-hlr_10.42.42.2(pid=24323): stdout: | (launched: 2022-12-09_04:25:54.391792) 04:25:57.890944 run osmo-hlr_10.42.42.2(pid=24323): stderr: | 20221209042554591 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209042554591 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209042554591 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209042554591 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209042554591 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209042554591 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209042554605 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209042554613 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209042554613 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209042554613 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:25:57.944420 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24312): Terminating (SIGTERM) 04:25:57.987372 run iperf3-srv_10.42.42.10(pid=24313): Terminating (SIGTERM) 04:25:58.030174 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24314): Terminating (SIGTERM) 04:25:58.073036 run iperf3-srv_10.42.42.10(pid=24315): Terminating (SIGTERM) 04:25:58.115625 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24316): Terminating (SIGTERM) 04:25:58.158458 run iperf3-srv_10.42.42.10(pid=24317): Terminating (SIGTERM) 04:25:58.201036 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24318): Terminating (SIGTERM) 04:25:58.243690 run iperf3-srv_10.42.42.10(pid=24319): Terminating (SIGTERM) 04:25:58.286624 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24322): Terminating (SIGTERM) 04:25:58.329255 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24325): Terminating (SIGTERM) 04:25:58.371946 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24328): Terminating (SIGTERM) 04:25:58.414589 --- ParallelTerminationStrategy: PID 24312 died... 04:25:58.434573 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24312): Terminated: ok {rc=0} 04:25:58.482057 --- ParallelTerminationStrategy: PID 24313 died... 04:25:58.502137 run iperf3-srv_10.42.42.10(pid=24313): Terminated {rc=256} 04:25:58.550020 --- ParallelTerminationStrategy: PID 24314 died... 04:25:58.569899 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24314): Terminated: ok {rc=0} 04:25:58.617275 --- ParallelTerminationStrategy: PID 24315 died... 04:25:58.636869 run iperf3-srv_10.42.42.10(pid=24315): Terminated {rc=256} 04:25:58.684254 --- ParallelTerminationStrategy: PID 24316 died... 04:25:58.704134 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24316): Terminated: ok {rc=0} 04:25:58.751599 --- ParallelTerminationStrategy: PID 24317 died... 04:25:58.771535 run iperf3-srv_10.42.42.10(pid=24317): Terminated {rc=256} 04:25:58.819439 --- ParallelTerminationStrategy: PID 24318 died... 04:25:58.839440 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24318): Terminated: ok {rc=0} 04:25:58.887212 --- ParallelTerminationStrategy: PID 24319 died... 04:25:58.907281 run iperf3-srv_10.42.42.10(pid=24319): Terminated {rc=256} 04:25:58.954556 --- ParallelTerminationStrategy: PID 24322 died... 04:25:58.974600 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24322): Terminated: ok {rc=0} 04:25:59.021964 --- ParallelTerminationStrategy: PID 24325 died... 04:25:59.042043 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24325): Terminated: ok {rc=0} 04:25:59.089498 --- ParallelTerminationStrategy: PID 24328 died... 04:25:59.109609 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24328): Terminated: ok {rc=0} 04:25:59.199397 bus /gobi_4: Setting Powered False 04:26:00.300081 bus /gobi_4: Setting Powered False 04:26:01.417216 bus /gobi_1: Setting Powered False 04:26:02.514317 bus /gobi_1: Setting Powered False 04:26:03.629897 bus /gobi_0: Setting Powered False 04:26:04.728017 bus /gobi_0: Setting Powered False 04:26:05.845226 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:trx-lms+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 04:26:06.948340 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:26:06.960036 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:26:07.030618 tst ping.py: using LAC 19057 04:26:07.149399 tst ping.py: using RAC 187 04:26:07.265832 tst ping.py: using CellId 19057 04:26:07.384801 tst ping.py: using BVCI 19058 04:26:07.492459 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:26:07.503384 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:26:07.514050 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:26:07.525232 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:26:07.536243 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:26:07.547386 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:26:07.558587 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:26:07.569708 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:26:07.687191 tst ping.py:19: start network... 04:26:07.901345 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:26:08.393782 run create_hlr_db(pid=24330): Launched 04:26:08.515427 bus /gobi_6: Setting Powered False 04:26:09.578529 run create_hlr_db(pid=24330): Terminated: ok {rc=0} 04:26:10.005409 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24332): Launched 04:26:10.302534 run osmo-hlr_10.42.42.2(pid=24333): Launched 04:26:10.418712 run osmo-stp_10.42.42.5: Starting osmo-stp 04:26:10.934019 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24335): Launched 04:26:11.230527 run osmo-stp_10.42.42.5(pid=24336): Launched 04:26:11.343327 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:26:11.857560 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24338): Launched 04:26:11.971365 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:26:12.221872 run patchelf(pid=24339): Launched 04:26:12.387212 run osmo-stp_10.42.42.5(pid=24336): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24336)] 04:26:12.512222 run osmo-stp_10.42.42.5(pid=24336): stdout: | (launched: 2022-12-09_04:26:11.175356) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:26:12.639164 run osmo-stp_10.42.42.5(pid=24336): stderr: | 20221209042611346 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042611346 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042611347 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042611347 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042611348 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042611348 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042611348 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:26:12.766440 run osmo-stp_10.42.42.5(pid=24336): stdout: | (launched: 2022-12-09_04:26:11.175356) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:26:12.887869 run osmo-stp_10.42.42.5(pid=24336): stderr: | 20221209042611346 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042611346 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042611347 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042611347 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042611348 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042611348 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042611348 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:26:13.031207 run patchelf(pid=24339): Terminating (SIGINT) 04:26:13.198717 run patchelf(pid=24339): Terminated: ok {rc=0} 04:26:13.318756 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=24336): Process ended prematurely: osmo-stp_10.42.42.5(pid=24336) [trial-2354↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24336)] [trial-2354↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22] 04:26:13.327637 tst ping.py:22: Test FAILED (6.4 sec) 04:26:13.354739 run osmo-hlr_10.42.42.2(pid=24333): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24333)] 04:26:13.402715 run osmo-hlr_10.42.42.2(pid=24333): stdout: | (launched: 2022-12-09_04:26:10.247797) 04:26:13.452310 run osmo-hlr_10.42.42.2(pid=24333): stderr: | 20221209042610424 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209042610424 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209042610424 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209042610424 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209042610424 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209042610424 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209042610436 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-lms+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209042610445 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209042610445 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209042610445 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:26:13.502387 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24332): Terminating (SIGTERM) 04:26:13.542251 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24335): Terminating (SIGTERM) 04:26:13.582235 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24338): Terminating (SIGTERM) 04:26:13.622281 --- ParallelTerminationStrategy: PID 24332 died... 04:26:13.641535 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24332): Terminated: ok {rc=0} 04:26:13.685821 --- ParallelTerminationStrategy: PID 24335 died... 04:26:13.704621 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24335): Terminated: ok {rc=0} 04:26:13.748742 --- ParallelTerminationStrategy: PID 24338 died... 04:26:13.767635 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24338): Terminated: ok {rc=0} 04:26:13.852686 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:trx-lms+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 04:26:14.937845 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:26:14.949373 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:26:15.020438 tst ping_idle_ping.py: using LAC 19058 04:26:15.140019 tst ping_idle_ping.py: using RAC 188 04:26:15.267850 tst ping_idle_ping.py: using CellId 19058 04:26:15.385440 tst ping_idle_ping.py: using BVCI 19059 04:26:15.495773 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:26:15.506790 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:26:15.517522 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:26:15.528218 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:26:15.538904 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:26:15.549678 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:26:15.560443 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:26:15.571162 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:26:15.689632 tst ping_idle_ping.py:24: start network... 04:26:15.907152 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:26:16.421289 run create_hlr_db(pid=24341): Launched 04:26:16.567338 bus /gobi_6: Setting Powered False 04:26:17.627434 run create_hlr_db(pid=24341): Terminated: ok {rc=0} 04:26:18.064643 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24343): Launched 04:26:18.383824 run osmo-hlr_10.42.42.2(pid=24344): Launched 04:26:18.506028 run osmo-stp_10.42.42.5: Starting osmo-stp 04:26:19.060842 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24346): Launched 04:26:19.379945 run osmo-stp_10.42.42.5(pid=24347): Launched 04:26:19.501958 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:26:20.055092 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24349): Launched 04:26:20.178967 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:26:20.449098 run patchelf(pid=24350): Launched 04:26:20.627198 run osmo-stp_10.42.42.5(pid=24347): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24347)] 04:26:20.762981 run osmo-stp_10.42.42.5(pid=24347): stdout: | (launched: 2022-12-09_04:26:19.321836) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:26:20.901344 run osmo-stp_10.42.42.5(pid=24347): stderr: | 20221209042619514 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042619514 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042619514 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042619515 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042619515 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042619515 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042619515 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:26:21.039270 run osmo-stp_10.42.42.5(pid=24347): stdout: | (launched: 2022-12-09_04:26:19.321836) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:26:21.171101 run osmo-stp_10.42.42.5(pid=24347): stderr: | 20221209042619514 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042619514 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042619514 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042619515 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042619515 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042619515 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042619515 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:26:21.327104 run patchelf(pid=24350): Terminating (SIGINT) 04:26:21.507387 run patchelf(pid=24350): Terminated: ok {rc=0} 04:26:21.637271 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=24347): Process ended prematurely: osmo-stp_10.42.42.5(pid=24347) [trial-2354↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24347)] [trial-2354↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 04:26:21.646946 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 04:26:21.676243 run osmo-hlr_10.42.42.2(pid=24344): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24344)] 04:26:21.727536 run osmo-hlr_10.42.42.2(pid=24344): stdout: | (launched: 2022-12-09_04:26:18.324894) 04:26:21.780474 run osmo-hlr_10.42.42.2(pid=24344): stderr: | 20221209042618524 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209042618524 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209042618524 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209042618524 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209042618524 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209042618525 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209042618539 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-lms+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209042618547 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209042618548 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209042618548 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:26:21.834269 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24343): Terminating (SIGTERM) 04:26:21.877137 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24346): Terminating (SIGTERM) 04:26:21.920244 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24349): Terminating (SIGTERM) 04:26:21.963201 --- ParallelTerminationStrategy: PID 24343 died... 04:26:21.983713 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24343): Terminated: ok {rc=0} 04:26:22.031517 --- ParallelTerminationStrategy: PID 24346 died... 04:26:22.051678 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24346): Terminated: ok {rc=0} 04:26:22.099331 --- ParallelTerminationStrategy: PID 24349 died... 04:26:22.119414 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24349): Terminated: ok {rc=0} 04:26:22.208877 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2354 gprs:trx-lms+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 gprs:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 04:26:23.520675 tst gprs:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:26:23.527331 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 04:26:23.562036 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 04:26:23.601832 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 04:26:23.691984 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 04:26:23.726240 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 04:26:23.764923 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 04:26:24.358829 tst gprs:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2354 gprs:trx-lms+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 04:26:24.412407 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:26:24.423878 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:26:24.496248 tst cs_paging_gprs_active.py: using LAC 19059 04:26:24.618530 tst cs_paging_gprs_active.py: using RAC 189 04:26:24.739235 tst cs_paging_gprs_active.py: using CellId 19059 04:26:24.860305 tst cs_paging_gprs_active.py: using BVCI 19060 04:26:24.971315 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:26:24.982390 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:26:24.993274 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:26:25.004480 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:26:25.015765 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:26:25.026939 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:26:25.038190 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:26:25.049336 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:26:25.060579 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:26:25.181421 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:26:25.303711 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 04:26:25.508213 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:26:25.813298 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24354): Launched 04:26:26.079301 run iperf3-srv_10.42.42.10(pid=24355): Launched 04:26:26.194345 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 04:26:26.397597 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:26:26.703179 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24356): Launched 04:26:26.968379 run iperf3-srv_10.42.42.10(pid=24357): Launched 04:26:27.082045 tst cs_paging_gprs_active.py:38: start network... 04:26:27.283585 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:26:27.752567 run create_hlr_db(pid=24358): Launched 04:26:27.876583 bus /gobi_6: Setting Powered False 04:26:28.938275 run create_hlr_db(pid=24358): Terminated: ok {rc=0} 04:26:29.381565 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24360): Launched 04:26:29.709404 run osmo-hlr_10.42.42.2(pid=24361): Launched 04:26:29.834929 run osmo-stp_10.42.42.5: Starting osmo-stp 04:26:30.400079 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24363): Launched 04:26:30.725529 run osmo-stp_10.42.42.5(pid=24364): Launched 04:26:30.899723 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:26:31.585752 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24366): Launched 04:26:31.723347 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:26:32.010052 run patchelf(pid=24367): Launched 04:26:32.230618 run osmo-stp_10.42.42.5(pid=24364): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24364)] 04:26:32.360261 run osmo-stp_10.42.42.5(pid=24364): stdout: | (launched: 2022-12-09_04:26:30.666097) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:26:32.490781 run osmo-stp_10.42.42.5(pid=24364): stderr: | 20221209042630898 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042630899 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042630899 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042630899 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042630900 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042630900 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042630900 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:26:32.621662 run osmo-stp_10.42.42.5(pid=24364): stdout: | (launched: 2022-12-09_04:26:30.666097) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:26:32.746729 run osmo-stp_10.42.42.5(pid=24364): stderr: | 20221209042630898 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042630899 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042630899 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042630899 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042630900 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042630900 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042630900 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:26:32.894652 run patchelf(pid=24367): Terminating (SIGINT) 04:26:33.066696 run patchelf(pid=24367): Terminated: ok {rc=0} 04:26:33.191335 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=24364): Process ended prematurely: osmo-stp_10.42.42.5(pid=24364) [trial-2354↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24364)] [trial-2354↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 04:26:33.200817 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 04:26:33.228566 run osmo-hlr_10.42.42.2(pid=24361): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24361)] 04:26:33.277280 run osmo-hlr_10.42.42.2(pid=24361): stdout: | (launched: 2022-12-09_04:26:29.649367) 04:26:33.327877 run osmo-hlr_10.42.42.2(pid=24361): stderr: | 20221209042629848 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209042629848 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209042629849 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209042629849 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209042629849 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209042629849 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209042629861 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-lms+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209042629869 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209042629869 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209042629869 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:26:33.378912 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24354): Terminating (SIGTERM) 04:26:33.419385 run iperf3-srv_10.42.42.10(pid=24355): Terminating (SIGTERM) 04:26:33.459673 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24356): Terminating (SIGTERM) 04:26:33.500000 run iperf3-srv_10.42.42.10(pid=24357): Terminating (SIGTERM) 04:26:33.540141 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24360): Terminating (SIGTERM) 04:26:33.580432 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24363): Terminating (SIGTERM) 04:26:33.620754 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24366): Terminating (SIGTERM) 04:26:33.661327 --- ParallelTerminationStrategy: PID 24354 died... 04:26:33.680711 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24354): Terminated: ok {rc=0} 04:26:33.725486 --- ParallelTerminationStrategy: PID 24355 died... 04:26:33.744359 run iperf3-srv_10.42.42.10(pid=24355): Terminated {rc=256} 04:26:33.788753 --- ParallelTerminationStrategy: PID 24356 died... 04:26:33.807836 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24356): Terminated: ok {rc=0} 04:26:33.852164 --- ParallelTerminationStrategy: PID 24357 died... 04:26:33.871017 run iperf3-srv_10.42.42.10(pid=24357): Terminated {rc=256} 04:26:33.915088 --- ParallelTerminationStrategy: PID 24360 died... 04:26:33.933962 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24360): Terminated: ok {rc=0} 04:26:33.978256 --- ParallelTerminationStrategy: PID 24363 died... 04:26:33.997600 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24363): Terminated: ok {rc=0} 04:26:34.042434 --- ParallelTerminationStrategy: PID 24366 died... 04:26:34.061488 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24366): Terminated: ok {rc=0} 04:26:34.148160 bus /gobi_0: Setting Powered False 04:26:35.249434 bus /gobi_0: Setting Powered False 04:26:36.366573 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:trx-lms+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 04:26:37.517444 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:26:37.529735 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:26:37.602683 tst iperf3.py: using LAC 19060 04:26:37.730708 tst iperf3.py: using RAC 190 04:26:37.858327 tst iperf3.py: using CellId 19060 04:26:37.985886 tst iperf3.py: using BVCI 19061 04:26:38.106366 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:26:38.117754 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:26:38.128934 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:26:38.140856 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:26:38.152324 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:26:38.163704 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:26:38.175267 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:26:38.186687 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:26:38.198272 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:26:38.316863 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 04:26:38.519958 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:26:38.824385 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24368): Launched 04:26:39.089154 run iperf3-srv_10.42.42.10(pid=24369): Launched 04:26:39.203173 tst iperf3.py:8: start network... 04:26:39.406059 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:26:39.876269 run create_hlr_db(pid=24370): Launched 04:26:40.001424 bus /gobi_6: Setting Powered False 04:26:41.062286 run create_hlr_db(pid=24370): Terminated: ok {rc=0} 04:26:41.506652 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24372): Launched 04:26:41.832810 run osmo-hlr_10.42.42.2(pid=24373): Launched 04:26:41.958691 run osmo-stp_10.42.42.5: Starting osmo-stp 04:26:42.486279 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24375): Launched 04:26:42.788824 run osmo-stp_10.42.42.5(pid=24376): Launched 04:26:42.904114 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:26:43.425586 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24378): Launched 04:26:43.541057 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:26:43.796577 run patchelf(pid=24379): Launched 04:26:43.964564 run osmo-stp_10.42.42.5(pid=24376): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24376)] 04:26:44.092921 run osmo-stp_10.42.42.5(pid=24376): stdout: | (launched: 2022-12-09_04:26:42.732899) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:26:44.222479 run osmo-stp_10.42.42.5(pid=24376): stderr: | 20221209042642906 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042642906 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042642906 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042642907 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042642907 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042642908 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042642908 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:26:44.352073 run osmo-stp_10.42.42.5(pid=24376): stdout: | (launched: 2022-12-09_04:26:42.732899) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:26:44.475825 run osmo-stp_10.42.42.5(pid=24376): stderr: | 20221209042642906 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042642906 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042642906 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042642907 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042642907 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042642908 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042642908 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:26:44.622562 run patchelf(pid=24379): Terminating (SIGINT) 04:26:44.792862 run patchelf(pid=24379): Terminated: ok {rc=0} 04:26:44.915692 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24376): Process ended prematurely: osmo-stp_10.42.42.5(pid=24376) [trial-2354↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24376)] [trial-2354↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8] 04:26:44.925239 tst iperf3.py:8: Test FAILED (7.4 sec) 04:26:44.952692 run osmo-hlr_10.42.42.2(pid=24373): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24373)] 04:26:45.000583 run osmo-hlr_10.42.42.2(pid=24373): stdout: | (launched: 2022-12-09_04:26:41.773111) 04:26:45.050198 run osmo-hlr_10.42.42.2(pid=24373): stderr: | 20221209042641973 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209042641973 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209042641973 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209042641973 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209042641973 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209042641973 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209042641986 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209042641994 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209042641994 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209042641994 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:26:45.100263 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24368): Terminating (SIGTERM) 04:26:45.140069 run iperf3-srv_10.42.42.10(pid=24369): Terminating (SIGTERM) 04:26:45.179974 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24372): Terminating (SIGTERM) 04:26:45.219758 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24375): Terminating (SIGTERM) 04:26:45.259551 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24378): Terminating (SIGTERM) 04:26:45.299699 --- ParallelTerminationStrategy: PID 24368 died... 04:26:45.318950 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24368): Terminated: ok {rc=0} 04:26:45.363720 --- ParallelTerminationStrategy: PID 24369 died... 04:26:45.382706 run iperf3-srv_10.42.42.10(pid=24369): Terminated {rc=256} 04:26:45.428279 --- ParallelTerminationStrategy: PID 24372 died... 04:26:45.447244 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24372): Terminated: ok {rc=0} 04:26:45.491300 --- ParallelTerminationStrategy: PID 24375 died... 04:26:45.510074 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24375): Terminated: ok {rc=0} 04:26:45.554091 --- ParallelTerminationStrategy: PID 24378 died... 04:26:45.573023 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24378): Terminated: ok {rc=0} 04:26:45.659471 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:trx-lms+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 04:26:46.806976 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:26:46.819712 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:26:46.891920 tst iperf3m4.py: using LAC 19061 04:26:47.027593 tst iperf3m4.py: using RAC 191 04:26:47.156415 tst iperf3m4.py: using CellId 19061 04:26:47.284743 tst iperf3m4.py: using BVCI 19062 04:26:47.403427 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:26:47.414987 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:26:47.426316 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:26:47.437839 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:26:47.449210 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:26:47.460683 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:26:47.472361 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:26:47.483692 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:26:47.495326 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:26:47.613667 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:26:47.733778 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:26:47.852137 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:26:47.970550 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 04:26:48.174398 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:26:48.479125 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24380): Launched 04:26:48.744584 run iperf3-srv_10.42.42.10(pid=24381): Launched 04:26:48.858652 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 04:26:49.060417 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:26:49.364782 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24382): Launched 04:26:49.629118 run iperf3-srv_10.42.42.10(pid=24383): Launched 04:26:49.742821 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 04:26:49.944311 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:26:50.248902 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24384): Launched 04:26:50.513462 run iperf3-srv_10.42.42.10(pid=24385): Launched 04:26:50.627764 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 04:26:50.830029 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:26:51.135066 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24386): Launched 04:26:51.399880 run iperf3-srv_10.42.42.10(pid=24387): Launched 04:26:51.513972 tst iperf3m4.py:8: start network... 04:26:51.715838 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:26:52.187657 run create_hlr_db(pid=24388): Launched 04:26:52.315941 bus /gobi_6: Setting Powered False 04:26:53.380837 run create_hlr_db(pid=24388): Terminated: ok {rc=0} 04:26:53.833539 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24390): Launched 04:26:54.160012 run osmo-hlr_10.42.42.2(pid=24391): Launched 04:26:54.285179 run osmo-stp_10.42.42.5: Starting osmo-stp 04:26:54.849506 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24393): Launched 04:26:55.158938 run osmo-stp_10.42.42.5(pid=24394): Launched 04:26:55.274749 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:26:55.797339 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24396): Launched 04:26:55.913236 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:26:56.170407 run patchelf(pid=24397): Launched 04:26:56.338499 run osmo-stp_10.42.42.5(pid=24394): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24394)] 04:26:56.466010 run osmo-stp_10.42.42.5(pid=24394): stdout: | (launched: 2022-12-09_04:26:55.102870) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:26:56.595235 run osmo-stp_10.42.42.5(pid=24394): stderr: | 20221209042655272 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042655272 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042655273 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042655273 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042655275 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042655276 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042655276 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:26:56.724345 run osmo-stp_10.42.42.5(pid=24394): stdout: | (launched: 2022-12-09_04:26:55.102870) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:26:56.848067 run osmo-stp_10.42.42.5(pid=24394): stderr: | 20221209042655272 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042655272 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042655273 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042655273 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042655275 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042655276 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042655276 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:26:56.994421 run patchelf(pid=24397): Terminating (SIGINT) 04:26:57.165133 run patchelf(pid=24397): Terminated: ok {rc=0} 04:26:57.287832 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24394): Process ended prematurely: osmo-stp_10.42.42.5(pid=24394) [trial-2354↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24394)] [trial-2354↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8] 04:26:57.297422 tst iperf3m4.py:8: Test FAILED (10.5 sec) 04:26:57.325241 run osmo-hlr_10.42.42.2(pid=24391): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24391)] 04:26:57.372858 run osmo-hlr_10.42.42.2(pid=24391): stdout: | (launched: 2022-12-09_04:26:54.099935) 04:26:57.422521 run osmo-hlr_10.42.42.2(pid=24391): stderr: | 20221209042654301 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209042654301 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209042654301 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209042654301 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209042654301 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209042654301 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209042654317 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209042654327 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209042654327 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209042654327 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:26:57.472746 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24380): Terminating (SIGTERM) 04:26:57.513796 run iperf3-srv_10.42.42.10(pid=24381): Terminating (SIGTERM) 04:26:57.554116 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24382): Terminating (SIGTERM) 04:26:57.593928 run iperf3-srv_10.42.42.10(pid=24383): Terminating (SIGTERM) 04:26:57.633465 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24384): Terminating (SIGTERM) 04:26:57.673221 run iperf3-srv_10.42.42.10(pid=24385): Terminating (SIGTERM) 04:26:57.713213 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24386): Terminating (SIGTERM) 04:26:57.752793 run iperf3-srv_10.42.42.10(pid=24387): Terminating (SIGTERM) 04:26:57.792523 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24390): Terminating (SIGTERM) 04:26:57.831995 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24393): Terminating (SIGTERM) 04:26:57.871445 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24396): Terminating (SIGTERM) 04:26:57.911539 --- ParallelTerminationStrategy: PID 24380 died... 04:26:57.930838 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24380): Terminated: ok {rc=0} 04:26:57.975226 --- ParallelTerminationStrategy: PID 24381 died... 04:26:57.994074 run iperf3-srv_10.42.42.10(pid=24381): Terminated {rc=256} 04:26:58.038365 --- ParallelTerminationStrategy: PID 24382 died... 04:26:58.057253 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24382): Terminated: ok {rc=0} 04:26:58.102023 --- ParallelTerminationStrategy: PID 24383 died... 04:26:58.120786 run iperf3-srv_10.42.42.10(pid=24383): Terminated {rc=256} 04:26:58.164853 --- ParallelTerminationStrategy: PID 24384 died... 04:26:58.184038 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24384): Terminated: ok {rc=0} 04:26:58.228873 --- ParallelTerminationStrategy: PID 24385 died... 04:26:58.248046 run iperf3-srv_10.42.42.10(pid=24385): Terminated {rc=256} 04:26:58.292825 --- ParallelTerminationStrategy: PID 24386 died... 04:26:58.311988 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24386): Terminated: ok {rc=0} 04:26:58.356587 --- ParallelTerminationStrategy: PID 24387 died... 04:26:58.375382 run iperf3-srv_10.42.42.10(pid=24387): Terminated {rc=256} 04:26:58.419481 --- ParallelTerminationStrategy: PID 24390 died... 04:26:58.438372 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24390): Terminated: ok {rc=0} 04:26:58.482482 --- ParallelTerminationStrategy: PID 24393 died... 04:26:58.501453 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24393): Terminated: ok {rc=0} 04:26:58.546038 --- ParallelTerminationStrategy: PID 24396 died... 04:26:58.565015 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24396): Terminated: ok {rc=0} 04:26:58.649663 bus /gobi_4: Setting Powered False 04:26:59.748263 bus /gobi_4: Setting Powered False 04:27:00.884380 bus /gobi_1: Setting Powered False 04:27:02.000328 bus /gobi_1: Setting Powered False 04:27:03.116621 bus /gobi_0: Setting Powered False 04:27:04.215143 bus /gobi_0: Setting Powered False 04:27:05.333795 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:trx-lms+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 04:27:06.435736 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:27:06.447274 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:27:06.515923 tst ping.py: using LAC 19062 04:27:06.631539 tst ping.py: using RAC 192 04:27:06.746492 tst ping.py: using CellId 19062 04:27:06.862154 tst ping.py: using BVCI 19063 04:27:06.970286 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:27:06.981254 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:27:06.991985 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:27:07.002662 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:27:07.013209 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:27:07.023847 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:27:07.034644 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:27:07.045401 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:27:07.161050 tst ping.py:19: start network... 04:27:07.359854 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:27:07.822971 run create_hlr_db(pid=24398): Launched 04:27:07.946924 bus /gobi_6: Setting Powered False 04:27:09.007350 run create_hlr_db(pid=24398): Terminated: ok {rc=0} 04:27:09.444875 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24400): Launched 04:27:09.765319 run osmo-hlr_10.42.42.2(pid=24401): Launched 04:27:09.889911 run osmo-stp_10.42.42.5: Starting osmo-stp 04:27:10.446278 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24403): Launched 04:27:10.767781 run osmo-stp_10.42.42.5(pid=24404): Launched 04:27:10.893622 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:27:11.448607 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24406): Launched 04:27:11.572811 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:27:11.843792 run patchelf(pid=24407): Launched 04:27:12.023437 run osmo-stp_10.42.42.5(pid=24404): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24404)] 04:27:12.159071 run osmo-stp_10.42.42.5(pid=24404): stdout: | (launched: 2022-12-09_04:27:10.708844) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:27:12.296292 run osmo-stp_10.42.42.5(pid=24404): stderr: | 20221209042710901 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042710901 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042710901 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042710902 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042710902 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042710902 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042710902 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:27:12.433841 run osmo-stp_10.42.42.5(pid=24404): stdout: | (launched: 2022-12-09_04:27:10.708844) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:27:12.565264 run osmo-stp_10.42.42.5(pid=24404): stderr: | 20221209042710901 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042710901 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042710901 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042710902 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042710902 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042710902 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042710902 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:27:12.720905 run patchelf(pid=24407): Terminating (SIGINT) 04:27:12.901890 run patchelf(pid=24407): Terminated: ok {rc=0} 04:27:13.031489 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=24404): Process ended prematurely: osmo-stp_10.42.42.5(pid=24404) [trial-2354↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24404)] [trial-2354↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22] 04:27:13.041041 tst ping.py:22: Test FAILED (6.6 sec) 04:27:13.070255 run osmo-hlr_10.42.42.2(pid=24401): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24401)] 04:27:13.121364 run osmo-hlr_10.42.42.2(pid=24401): stdout: | (launched: 2022-12-09_04:27:09.706498) 04:27:13.174246 run osmo-hlr_10.42.42.2(pid=24401): stderr: | 20221209042709903 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209042709903 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209042709903 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209042709903 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209042709903 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209042709903 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209042709916 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-lms+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209042709927 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209042709927 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209042709927 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:27:13.227490 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24400): Terminating (SIGTERM) 04:27:13.269996 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24403): Terminating (SIGTERM) 04:27:13.312568 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24406): Terminating (SIGTERM) 04:27:13.355459 --- ParallelTerminationStrategy: PID 24400 died... 04:27:13.375778 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24400): Terminated: ok {rc=0} 04:27:13.423253 --- ParallelTerminationStrategy: PID 24403 died... 04:27:13.443138 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24403): Terminated: ok {rc=0} 04:27:13.490289 --- ParallelTerminationStrategy: PID 24406 died... 04:27:13.510173 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24406): Terminated: ok {rc=0} 04:27:13.598592 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:trx-lms+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 04:27:14.686024 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:27:14.697901 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:27:14.769398 tst ping_idle_ping.py: using LAC 19063 04:27:14.886274 tst ping_idle_ping.py: using RAC 193 04:27:15.003134 tst ping_idle_ping.py: using CellId 19063 04:27:15.119689 tst ping_idle_ping.py: using BVCI 19064 04:27:15.228206 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:27:15.239272 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:27:15.250239 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:27:15.261100 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:27:15.271849 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:27:15.282553 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:27:15.293630 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:27:15.304396 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:27:15.422302 tst ping_idle_ping.py:24: start network... 04:27:15.636893 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:27:16.165561 run create_hlr_db(pid=24408): Launched 04:27:16.328138 bus /gobi_6: Setting Powered False 04:27:17.389570 run create_hlr_db(pid=24408): Terminated: ok {rc=0} 04:27:17.836570 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24410): Launched 04:27:18.135252 run osmo-hlr_10.42.42.2(pid=24411): Launched 04:27:18.249275 run osmo-stp_10.42.42.5: Starting osmo-stp 04:27:18.776374 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24413): Launched 04:27:19.074630 run osmo-stp_10.42.42.5(pid=24414): Launched 04:27:19.189729 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:27:19.703561 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24416): Launched 04:27:19.818191 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:27:20.070225 run patchelf(pid=24417): Launched 04:27:20.238139 run osmo-stp_10.42.42.5(pid=24414): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24414)] 04:27:20.364276 run osmo-stp_10.42.42.5(pid=24414): stdout: | (launched: 2022-12-09_04:27:19.019482) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:27:20.492022 run osmo-stp_10.42.42.5(pid=24414): stderr: | 20221209042719190 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042719190 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042719190 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042719191 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042719191 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042719191 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042719191 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:27:20.619725 run osmo-stp_10.42.42.5(pid=24414): stdout: | (launched: 2022-12-09_04:27:19.019482) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:27:20.741721 run osmo-stp_10.42.42.5(pid=24414): stderr: | 20221209042719190 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042719190 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042719190 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042719191 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042719191 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042719191 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042719191 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:27:20.886567 run patchelf(pid=24417): Terminating (SIGINT) 04:27:21.054875 run patchelf(pid=24417): Terminated: ok {rc=0} 04:27:21.175695 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=24414): Process ended prematurely: osmo-stp_10.42.42.5(pid=24414) [trial-2354↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24414)] [trial-2354↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 04:27:21.184653 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 04:27:21.211801 run osmo-hlr_10.42.42.2(pid=24411): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24411)] 04:27:21.260245 run osmo-hlr_10.42.42.2(pid=24411): stdout: | (launched: 2022-12-09_04:27:18.079875) 04:27:21.311150 run osmo-hlr_10.42.42.2(pid=24411): stderr: | 20221209042718254 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209042718254 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209042718254 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209042718255 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209042718255 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209042718255 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209042718267 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-lms+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209042718277 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209042718277 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209042718277 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:27:21.361960 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24410): Terminating (SIGTERM) 04:27:21.401908 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24413): Terminating (SIGTERM) 04:27:21.441945 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24416): Terminating (SIGTERM) 04:27:21.482273 --- ParallelTerminationStrategy: PID 24410 died... 04:27:21.501624 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24410): Terminated: ok {rc=0} 04:27:21.546033 --- ParallelTerminationStrategy: PID 24413 died... 04:27:21.564704 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24413): Terminated: ok {rc=0} 04:27:21.609100 --- ParallelTerminationStrategy: PID 24416 died... 04:27:21.627980 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24416): Terminated: ok {rc=0} 04:27:21.713352 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2354 gprs:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 04:27:23.015050 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:27:23.021517 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 04:27:23.054018 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 04:27:23.088033 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 04:27:23.142514 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 04:27:23.175627 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 04:27:23.209543 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 04:27:23.764524 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2354 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 04:27:23.769573 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:27:23.780572 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 04:27:23.849324 tst switch_tch_pdch.py: using LAC 19064 04:27:23.967710 tst switch_tch_pdch.py: using RAC 194 04:27:24.085480 tst switch_tch_pdch.py: using CellId 19064 04:27:24.206388 tst switch_tch_pdch.py: using BVCI 19065 04:27:24.315778 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:27:24.326960 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:27:24.337985 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:27:24.348861 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:27:24.359796 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:27:24.370719 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:27:24.381817 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:27:24.392717 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:27:24.511284 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:27:24.633419 tst switch_tch_pdch.py:51: start network... 04:27:24.832919 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:27:25.294383 run create_hlr_db(pid=24422): Launched 04:27:25.417134 bus /gobi_6: Setting Powered False 04:27:26.477368 run create_hlr_db(pid=24422): Terminated: ok {rc=0} 04:27:26.893232 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24424): Launched 04:27:27.190986 run osmo-hlr_10.42.42.2(pid=24425): Launched 04:27:27.304892 run osmo-stp_10.42.42.5: Starting osmo-stp 04:27:27.834506 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24427): Launched 04:27:28.133584 run osmo-stp_10.42.42.5(pid=24428): Launched 04:27:28.247876 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:27:28.762709 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24430): Launched 04:27:28.877087 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:27:29.129026 run patchelf(pid=24431): Launched 04:27:29.294260 run osmo-stp_10.42.42.5(pid=24428): ERR: Terminated: ERROR {rc=1} [trial-2354↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24428)] 04:27:29.419853 run osmo-stp_10.42.42.5(pid=24428): stdout: | (launched: 2022-12-09_04:27:28.078544) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:27:29.547091 run osmo-stp_10.42.42.5(pid=24428): stderr: | 20221209042728250 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042728250 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042728250 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042728250 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042728251 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042728251 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042728251 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:27:29.674518 run osmo-stp_10.42.42.5(pid=24428): stdout: | (launched: 2022-12-09_04:27:28.078544) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:27:29.796378 run osmo-stp_10.42.42.5(pid=24428): stderr: | 20221209042728250 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042728250 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042728250 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042728250 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042728251 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042728251 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042728251 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:27:29.941277 run patchelf(pid=24431): Terminating (SIGINT) 04:27:30.109424 run patchelf(pid=24431): Terminated: ok {rc=0} 04:27:30.230452 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=24428): Process ended prematurely: osmo-stp_10.42.42.5(pid=24428) [trial-2354↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24428)] [trial-2354↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 04:27:30.239263 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 04:27:30.266308 run osmo-hlr_10.42.42.2(pid=24425): ERR: Terminated: ERROR {rc=237} [trial-2354↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24425)] 04:27:30.314071 run osmo-hlr_10.42.42.2(pid=24425): stdout: | (launched: 2022-12-09_04:27:27.135926) 04:27:30.363523 run osmo-hlr_10.42.42.2(pid=24425): stderr: | 20221209042727312 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209042727312 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209042727312 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209042727312 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209042727312 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209042727313 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209042727323 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209042727332 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209042727332 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209042727332 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:27:30.413427 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24424): Terminating (SIGTERM) 04:27:30.453545 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24427): Terminating (SIGTERM) 04:27:30.493662 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24430): Terminating (SIGTERM) 04:27:30.533665 --- ParallelTerminationStrategy: PID 24424 died... 04:27:30.552851 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24424): Terminated: ok {rc=0} 04:27:30.596866 --- ParallelTerminationStrategy: PID 24427 died... 04:27:30.615584 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24427): Terminated: ok {rc=0} 04:27:30.659458 --- ParallelTerminationStrategy: PID 24430 died... 04:27:30.678180 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24430): Terminated: ok {rc=0} 04:27:30.761595 bus /gobi_0: Setting Powered False 04:27:31.857287 bus /gobi_0: Setting Powered False 04:27:32.972593 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2354 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 dynts:trx-lms+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 04:27:34.225881 tst dynts:trx-lms+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:27:34.231415 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 04:27:34.264045 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 04:27:34.298115 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 04:27:34.349200 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 04:27:34.381766 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 04:27:34.415661 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 04:27:34.971104 tst dynts:trx-lms+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2354 dynts:trx-lms+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 04:27:34.976086 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:27:34.987275 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 04:27:35.054094 tst switch_tch_pdch.py: using LAC 19065 04:27:35.169293 tst switch_tch_pdch.py: using RAC 195 04:27:35.284532 tst switch_tch_pdch.py: using CellId 19065 04:27:35.410471 tst switch_tch_pdch.py: using BVCI 19066 04:27:35.519763 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:27:35.530699 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:27:35.541484 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:27:35.551960 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:27:35.562524 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:27:35.573226 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:27:35.583886 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:27:35.594565 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 04:27:35.713233 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 04:27:35.837785 tst switch_tch_pdch.py:51: start network... 04:27:36.052431 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:27:36.519875 run create_hlr_db(pid=24438): Launched 04:27:36.644025 bus /gobi_6: Setting Powered False 04:27:37.706845 run create_hlr_db(pid=24438): Terminated: ok {rc=0} 04:27:38.126098 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24440): Launched 04:27:38.446496 run osmo-hlr_10.42.42.2(pid=24441): Launched 04:27:38.569983 run osmo-stp_10.42.42.5: Starting osmo-stp 04:27:39.096301 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24443): Launched 04:27:39.417676 run osmo-stp_10.42.42.5(pid=24444): Launched 04:27:39.540856 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:27:40.067100 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24446): Launched 04:27:40.192050 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:27:40.463335 run patchelf(pid=24447): Launched 04:27:40.643201 run osmo-stp_10.42.42.5(pid=24444): ERR: Terminated: ERROR {rc=1} [trial-2354↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24444)] 04:27:40.778409 run osmo-stp_10.42.42.5(pid=24444): stdout: | (launched: 2022-12-09_04:27:39.359153) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:27:40.915825 run osmo-stp_10.42.42.5(pid=24444): stderr: | 20221209042739552 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042739552 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042739552 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042739553 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042739553 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042739553 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042739553 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:27:41.053070 run osmo-stp_10.42.42.5(pid=24444): stdout: | (launched: 2022-12-09_04:27:39.359153) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:27:41.184781 run osmo-stp_10.42.42.5(pid=24444): stderr: | 20221209042739552 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042739552 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042739552 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042739553 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042739553 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042739553 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042739553 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:27:41.340299 run patchelf(pid=24447): Terminating (SIGINT) 04:27:41.520618 run patchelf(pid=24447): Terminated: ok {rc=0} 04:27:41.650473 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=24444): Process ended prematurely: osmo-stp_10.42.42.5(pid=24444) [trial-2354↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24444)] [trial-2354↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 04:27:41.660051 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 04:27:41.689149 run osmo-hlr_10.42.42.2(pid=24441): ERR: Terminated: ERROR {rc=237} [trial-2354↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24441)] 04:27:41.739997 run osmo-hlr_10.42.42.2(pid=24441): stdout: | (launched: 2022-12-09_04:27:38.387652) 04:27:41.792512 run osmo-hlr_10.42.42.2(pid=24441): stderr: | 20221209042738587 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209042738587 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209042738588 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209042738588 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209042738588 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209042738588 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209042738601 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/dynts:trx-lms+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209042738609 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209042738609 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209042738609 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:27:41.845750 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24440): Terminating (SIGTERM) 04:27:41.888445 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24443): Terminating (SIGTERM) 04:27:41.930960 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24446): Terminating (SIGTERM) 04:27:41.973576 --- ParallelTerminationStrategy: PID 24440 died... 04:27:41.993741 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24440): Terminated: ok {rc=0} 04:27:42.040652 --- ParallelTerminationStrategy: PID 24443 died... 04:27:42.060526 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24443): Terminated: ok {rc=0} 04:27:42.107787 --- ParallelTerminationStrategy: PID 24446 died... 04:27:42.127644 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24446): Terminated: ok {rc=0} 04:27:42.216803 bus /gobi_0: Setting Powered False 04:27:43.316026 bus /gobi_0: Setting Powered False 04:27:44.434920 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2354 dynts:trx-lms+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 nitb_sms:trx-lms-limenet-micro --------------------------------------------------------------------- 04:27:45.685897 tst nitb_sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:27:45.689733 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 04:27:45.718499 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 04:27:45.725806 tst nitb_sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 04:27:45.776848 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 04:27:45.805484 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 04:27:45.812077 tst nitb_sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 04:27:46.364697 tst nitb_sms:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_sms: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 nitb_sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 04:27:46.372592 tst nitb_sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 04:27:46.388558 tst nitb_sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 04:27:46.444145 tst mo_mt_sms.py: using LAC 19066 04:27:46.565998 tst mo_mt_sms.py: using RAC 196 04:27:46.705545 tst mo_mt_sms.py: using CellId 19066 04:27:46.837827 tst mo_mt_sms.py: using BVCI 19067 04:27:46.949545 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 04:27:47.066442 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 04:27:47.195019 tst mo_mt_sms.py:9: start nitb and bts... 04:27:47.395084 run osmo-nitb_10.42.42.2: Starting osmo-nitb 04:27:48.003511 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24451): Launched 04:27:48.304336 run osmo-nitb_10.42.42.2(pid=24452): Launched 04:27:48.470092 run osmo-nitb_10.42.42.2(pid=24452): ERR: Terminated: ERROR {rc=2} [trial-2354↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24452)] 04:27:48.604107 run osmo-nitb_10.42.42.2(pid=24452): stdout: | (launched: 2022-12-09_04:27:48.248750) 04:27:48.739135 run osmo-nitb_10.42.42.2(pid=24452): stderr: | (launched: 2022-12-09_04:27:48.293016) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:27:48.874138 run osmo-nitb_10.42.42.2(pid=24452): stdout: | (launched: 2022-12-09_04:27:48.248750) 04:27:49.003525 run osmo-nitb_10.42.42.2(pid=24452): stderr: | (launched: 2022-12-09_04:27:48.293016) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f4d467d3268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=24452): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24452) [trial-2354↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24452)] 04:27:49.416795 tst osmo-nitb_10.42.42.2(pid=24452): stdout: | (launched: 2022-12-09_04:27:48.248750) 04:27:49.535436 tst osmo-nitb_10.42.42.2(pid=24452): stderr: | (launched: 2022-12-09_04:27:48.293016) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:27:49.676898 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=24452): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24452) [trial-2354↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24452)] [trial-2354↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11] 04:27:49.685444 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 04:27:49.692083 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24451): Terminating (SIGTERM) 04:27:49.900729 --- ParallelTerminationStrategy: PID 24451 died... 04:27:49.921198 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24451): Terminated: ok {rc=0} 04:27:50.004854 bus /sierra_3: Setting Powered False 04:27:51.101474 bus /sierra_3: Setting Powered False 04:27:52.217621 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 nitb_sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 sms:trx-lms-limenet-micro --------------------------------------------------------------------- 04:27:53.414408 tst sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:27:53.418654 tst sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 04:27:53.449711 tst sms:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 04:27:53.477477 tst sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 04:27:53.532566 tst sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 04:27:53.561925 tst sms:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 04:27:53.588497 tst sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 04:27:54.135474 tst sms:trx-lms-limenet-micro: RESERVED RESOURCES for sms: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 04:27:54.140871 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:27:54.152554 tst sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 04:27:54.197884 tst mo_mt_sms.py: using LAC 19067 04:27:54.324629 tst mo_mt_sms.py: using RAC 197 04:27:54.449303 tst mo_mt_sms.py: using CellId 19067 04:27:54.575637 tst mo_mt_sms.py: using BVCI 19068 04:27:54.691761 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:27:54.703087 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:27:54.714402 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:27:54.725681 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:27:54.737423 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:27:54.748698 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 04:27:54.866427 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 04:27:54.980605 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:27:55.442076 run create_hlr_db(pid=24456): Launched 04:27:55.566091 bus /sierra_2: Setting Powered False 04:27:56.625914 run create_hlr_db(pid=24456): Terminated: ok {rc=0} 04:27:57.064219 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24458): Launched 04:27:57.383722 run osmo-hlr_10.42.42.2(pid=24459): Launched 04:27:57.506925 run osmo-stp_10.42.42.5: Starting osmo-stp 04:27:58.060312 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24461): Launched 04:27:58.381387 run osmo-stp_10.42.42.5(pid=24462): Launched 04:27:58.504598 run osmo-msc_10.42.42.6: Starting osmo-msc 04:27:59.087091 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24464): Launched 04:27:59.407831 run osmo-msc_10.42.42.6(pid=24465): Launched 04:27:59.587374 run osmo-stp_10.42.42.5(pid=24462): ERR: Terminated: ERROR {rc=1} [trial-2354↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24462)] 04:27:59.722671 run osmo-stp_10.42.42.5(pid=24462): stdout: | (launched: 2022-12-09_04:27:58.322761) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:27:59.859525 run osmo-stp_10.42.42.5(pid=24462): stderr: | 20221209042758513 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042758513 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042758513 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042758514 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042758514 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042758514 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042758514 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:27:59.995420 run osmo-stp_10.42.42.5(pid=24462): stdout: | (launched: 2022-12-09_04:27:58.322761) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:28:00.122692 run osmo-stp_10.42.42.5(pid=24462): stderr: | 20221209042758513 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042758513 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042758513 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042758514 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042758514 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042758514 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042758514 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:28:00.275092 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=24462): Process ended prematurely: osmo-stp_10.42.42.5(pid=24462) [trial-2354↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24462)] [trial-2354↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16] 04:28:00.283724 tst mo_mt_sms.py:16: Test FAILED (6.1 sec) 04:28:00.311751 run osmo-hlr_10.42.42.2(pid=24459): ERR: Terminated: ERROR {rc=237} [trial-2354↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24459)] 04:28:00.363092 run osmo-hlr_10.42.42.2(pid=24459): stdout: | (launched: 2022-12-09_04:27:57.325004) 04:28:00.415621 run osmo-hlr_10.42.42.2(pid=24459): stderr: | 20221209042757522 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209042757522 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209042757522 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209042757522 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209042757522 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209042757523 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209042757535 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/sms:trx-lms-limenet-micro/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209042757545 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209042757545 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209042757545 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:28:00.489011 run osmo-msc_10.42.42.6(pid=24465): ERR: Terminated: ERROR {rc=2} [trial-2354↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24465)] 04:28:00.539975 run osmo-msc_10.42.42.6(pid=24465): stdout: | (launched: 2022-12-09_04:27:59.349005) 04:28:00.592752 run osmo-msc_10.42.42.6(pid=24465): stderr: | 20221209042759671 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209042759671 DLGLOBAL DEBUG validating counter group 0x7f52ac30cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209042759671 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209042759671 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209042759671 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209042759672 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209042759673 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209042759674 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209042759674 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209042759674 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:28:00.645834 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24458): Terminating (SIGTERM) 04:28:00.688068 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24461): Terminating (SIGTERM) 04:28:00.730369 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24464): Terminating (SIGTERM) 04:28:00.773100 --- ParallelTerminationStrategy: PID 24458 died... 04:28:00.793287 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24458): Terminated: ok {rc=0} 04:28:00.843486 --- ParallelTerminationStrategy: PID 24461 died... 04:28:00.866361 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24461): Terminated: ok {rc=0} 04:28:00.912055 --- ParallelTerminationStrategy: PID 24464 died... 04:28:00.932515 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24464): Terminated: ok {rc=0} 04:28:01.021348 bus /sierra_3: Setting Powered False 04:28:02.119088 bus /sierra_3: Setting Powered False 04:28:03.234346 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 nitb_ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 04:28:04.463860 tst nitb_ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:28:04.468223 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 04:28:04.499099 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 04:28:04.506863 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 04:28:04.544224 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 04:28:04.575153 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 04:28:04.582138 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 04:28:05.101054 tst nitb_ussd:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_ussd: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2354 nitb_ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 04:28:05.106436 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 04:28:05.118275 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 04:28:05.165723 tst assert_extension.py: using LAC 19068 04:28:05.293421 tst assert_extension.py: using RAC 198 04:28:05.419687 tst assert_extension.py: using CellId 19068 04:28:05.544621 tst assert_extension.py: using BVCI 19069 04:28:05.661207 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 04:28:05.777495 tst assert_extension.py:10: start nitb and bts... 04:28:05.978503 run osmo-nitb_10.42.42.2: Starting osmo-nitb 04:28:06.590048 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24470): Launched 04:28:06.891807 run osmo-nitb_10.42.42.2(pid=24471): Launched 04:28:07.058135 run osmo-nitb_10.42.42.2(pid=24471): ERR: Terminated: ERROR {rc=2} [trial-2354↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24471)] 04:28:07.191908 run osmo-nitb_10.42.42.2(pid=24471): stdout: | (launched: 2022-12-09_04:28:06.836632) 04:28:07.327139 run osmo-nitb_10.42.42.2(pid=24471): stderr: | (launched: 2022-12-09_04:28:06.881118) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:28:07.463118 run osmo-nitb_10.42.42.2(pid=24471): stdout: | (launched: 2022-12-09_04:28:06.836632) 04:28:07.592770 run osmo-nitb_10.42.42.2(pid=24471): stderr: | (launched: 2022-12-09_04:28:06.881118) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f4d467d3268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=24471): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24471) [trial-2354↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24471)] 04:28:08.005529 tst osmo-nitb_10.42.42.2(pid=24471): stdout: | (launched: 2022-12-09_04:28:06.836632) 04:28:08.124916 tst osmo-nitb_10.42.42.2(pid=24471): stderr: | (launched: 2022-12-09_04:28:06.881118) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:28:08.266582 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=24471): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24471) [trial-2354↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24471)] [trial-2354↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12] 04:28:08.274841 tst assert_extension.py:12: Test FAILED (3.2 sec) 04:28:08.281526 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24470): Terminating (SIGTERM) 04:28:08.490070 --- ParallelTerminationStrategy: PID 24470 died... 04:28:08.511312 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24470): Terminated: ok {rc=0} 04:28:08.598776 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 nitb_ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 04:28:09.780718 tst ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:28:09.785438 tst ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 04:28:09.817381 tst ussd:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 04:28:09.845610 tst ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 04:28:09.881778 tst ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 04:28:09.912788 tst ussd:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 04:28:09.941352 tst ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 04:28:10.471942 tst ussd:trx-lms-limenet-micro: RESERVED RESOURCES for ussd: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2354 ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 04:28:10.479176 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:28:10.490785 tst ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 04:28:10.538434 tst assert_extension.py: using LAC 19069 04:28:10.664565 tst assert_extension.py: using RAC 199 04:28:10.791635 tst assert_extension.py: using CellId 19069 04:28:10.917572 tst assert_extension.py: using BVCI 19070 04:28:11.028207 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:28:11.039204 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:28:11.050138 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:28:11.060843 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:28:11.071608 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:28:11.082384 tst ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 04:28:11.199961 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:28:11.697747 run create_hlr_db(pid=24475): Launched 04:28:11.826050 bus /sierra_2: Setting Powered False 04:28:12.885481 run create_hlr_db(pid=24475): Terminated: ok {rc=0} 04:28:13.301572 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24477): Launched 04:28:13.601395 run osmo-hlr_10.42.42.2(pid=24478): Launched 04:28:13.714812 run osmo-stp_10.42.42.5: Starting osmo-stp 04:28:14.230798 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24480): Launched 04:28:14.530017 run osmo-stp_10.42.42.5(pid=24481): Launched 04:28:14.644080 run osmo-msc_10.42.42.6: Starting osmo-msc 04:28:15.184346 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24483): Launched 04:28:15.482786 run osmo-msc_10.42.42.6(pid=24484): Launched 04:28:15.650118 run osmo-stp_10.42.42.5(pid=24481): ERR: Terminated: ERROR {rc=1} [trial-2354↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24481)] 04:28:15.776535 run osmo-stp_10.42.42.5(pid=24481): stdout: | (launched: 2022-12-09_04:28:14.474701) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:28:15.921845 run osmo-stp_10.42.42.5(pid=24481): stderr: | 20221209042814643 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042814643 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042814644 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042814644 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042814645 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042814645 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042814645 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:28:16.056137 run osmo-stp_10.42.42.5(pid=24481): stdout: | (launched: 2022-12-09_04:28:14.474701) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:28:16.177921 run osmo-stp_10.42.42.5(pid=24481): stderr: | 20221209042814643 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042814643 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042814644 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042814644 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042814645 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042814645 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042814645 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:28:16.323895 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=24481): Process ended prematurely: osmo-stp_10.42.42.5(pid=24481) [trial-2354↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24481)] [trial-2354↪ussd:trx-lms-limenet-micro↪assert_extension.py:17] 04:28:16.333114 tst assert_extension.py:17: Test FAILED (5.8 sec) 04:28:16.360808 run osmo-hlr_10.42.42.2(pid=24478): ERR: Terminated: ERROR {rc=237} [trial-2354↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24478)] 04:28:16.410123 run osmo-hlr_10.42.42.2(pid=24478): stdout: | (launched: 2022-12-09_04:28:13.545966) 04:28:16.461066 run osmo-hlr_10.42.42.2(pid=24478): stderr: | 20221209042813722 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209042813722 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209042813722 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209042813722 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209042813723 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209042813723 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209042813735 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/ussd:trx-lms-limenet-micro/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209042813745 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209042813746 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209042813746 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:28:16.531305 run osmo-msc_10.42.42.6(pid=24484): ERR: Terminated: ERROR {rc=2} [trial-2354↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24484)] 04:28:16.581150 run osmo-msc_10.42.42.6(pid=24484): stdout: | (launched: 2022-12-09_04:28:15.427409) 04:28:16.631856 run osmo-msc_10.42.42.6(pid=24484): stderr: | 20221209042815698 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209042815699 DLGLOBAL DEBUG validating counter group 0x7f3416de5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209042815699 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209042815699 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209042815700 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209042815700 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209042815702 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209042815702 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209042815703 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209042815703 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:28:16.682808 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24477): Terminating (SIGTERM) 04:28:16.724167 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24480): Terminating (SIGTERM) 04:28:16.766854 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24483): Terminating (SIGTERM) 04:28:16.808137 --- ParallelTerminationStrategy: PID 24477 died... 04:28:16.828014 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24477): Terminated: ok {rc=0} 04:28:16.873371 --- ParallelTerminationStrategy: PID 24480 died... 04:28:16.892713 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24480): Terminated: ok {rc=0} 04:28:16.937880 --- ParallelTerminationStrategy: PID 24483 died... 04:28:16.956925 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24483): Terminated: ok {rc=0} 04:28:17.043281 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 04:28:18.245022 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:28:18.251416 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 04:28:18.280327 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 04:28:18.306873 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 04:28:18.359168 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 04:28:18.388270 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 04:28:18.414597 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 04:28:18.965962 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 04:28:19.015224 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:28:19.026563 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 04:28:19.091612 tst mo_mt_call.py: using LAC 19070 04:28:19.212167 tst mo_mt_call.py: using RAC 200 04:28:19.333036 tst mo_mt_call.py: using CellId 19070 04:28:19.451916 tst mo_mt_call.py: using BVCI 19071 04:28:19.561875 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:28:19.573176 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:28:19.584364 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:28:19.595537 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:28:19.606707 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:28:19.617808 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 04:28:19.738665 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 04:28:19.858978 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:28:20.363376 run create_hlr_db(pid=24489): Launched 04:28:20.487630 bus /sierra_2: Setting Powered False 04:28:21.552769 run create_hlr_db(pid=24489): Terminated: ok {rc=0} 04:28:21.986375 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24491): Launched 04:28:22.292369 run osmo-hlr_10.42.42.2(pid=24492): Launched 04:28:22.409889 run osmo-stp_10.42.42.5: Starting osmo-stp 04:28:22.936010 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24494): Launched 04:28:23.239952 run osmo-stp_10.42.42.5(pid=24495): Launched 04:28:23.355933 run osmo-msc_10.42.42.6: Starting osmo-msc 04:28:23.903570 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24497): Launched 04:28:24.208601 run osmo-msc_10.42.42.6(pid=24498): Launched 04:28:24.378668 run osmo-stp_10.42.42.5(pid=24495): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24495)] 04:28:24.506935 run osmo-stp_10.42.42.5(pid=24495): stdout: | (launched: 2022-12-09_04:28:23.184146) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:28:24.634326 run osmo-stp_10.42.42.5(pid=24495): stderr: | 20221209042823356 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042823356 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042823356 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042823357 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042823357 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042823357 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042823357 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:28:24.760278 run osmo-stp_10.42.42.5(pid=24495): stdout: | (launched: 2022-12-09_04:28:23.184146) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:28:24.880813 run osmo-stp_10.42.42.5(pid=24495): stderr: | 20221209042823356 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042823356 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042823356 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042823357 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042823357 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042823357 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042823357 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:28:25.025313 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24495): Process ended prematurely: osmo-stp_10.42.42.5(pid=24495) [trial-2354↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24495)] [trial-2354↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 04:28:25.034129 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 04:28:25.060835 run osmo-hlr_10.42.42.2(pid=24492): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24492)] 04:28:25.108822 run osmo-hlr_10.42.42.2(pid=24492): stdout: | (launched: 2022-12-09_04:28:22.236086) 04:28:25.158692 run osmo-hlr_10.42.42.2(pid=24492): stderr: | 20221209042822414 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209042822414 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209042822414 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209042822414 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209042822414 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209042822414 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209042822427 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209042822436 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209042822436 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209042822436 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:28:25.227932 run osmo-msc_10.42.42.6(pid=24498): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24498)] 04:28:25.275592 run osmo-msc_10.42.42.6(pid=24498): stdout: | (launched: 2022-12-09_04:28:24.152573) 04:28:25.325319 run osmo-msc_10.42.42.6(pid=24498): stderr: | 20221209042824427 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209042824427 DLGLOBAL DEBUG validating counter group 0x7f678cc5fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209042824427 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209042824427 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209042824427 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209042824427 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209042824430 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209042824430 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209042824430 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209042824430 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:28:25.374915 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24491): Terminating (SIGTERM) 04:28:25.414544 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24494): Terminating (SIGTERM) 04:28:25.454036 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24497): Terminating (SIGTERM) 04:28:25.493961 --- ParallelTerminationStrategy: PID 24491 died... 04:28:25.512908 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24491): Terminated: ok {rc=0} 04:28:25.557370 --- ParallelTerminationStrategy: PID 24494 died... 04:28:25.576325 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24494): Terminated: ok {rc=0} 04:28:25.620492 --- ParallelTerminationStrategy: PID 24497 died... 04:28:25.639282 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24497): Terminated: ok {rc=0} 04:28:25.723082 bus /sierra_3: Setting Powered False 04:28:26.819627 bus /sierra_3: Setting Powered False 04:28:27.933782 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2354 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 04:28:29.082524 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:28:29.095039 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 04:28:29.164801 tst mo_mt_call_osmux.py: using LAC 19071 04:28:29.291882 tst mo_mt_call_osmux.py: using RAC 201 04:28:29.419300 tst mo_mt_call_osmux.py: using CellId 19071 04:28:29.546591 tst mo_mt_call_osmux.py: using BVCI 19072 04:28:29.664942 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:28:29.676920 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:28:29.688452 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:28:29.700286 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:28:29.712183 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:28:29.723888 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 04:28:29.845698 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 04:28:29.966946 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:28:30.472580 run create_hlr_db(pid=24500): Launched 04:28:30.598295 bus /sierra_2: Setting Powered False 04:28:31.663313 run create_hlr_db(pid=24500): Terminated: ok {rc=0} 04:28:32.128235 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24502): Launched 04:28:32.466597 run osmo-hlr_10.42.42.2(pid=24503): Launched 04:28:32.595135 run osmo-stp_10.42.42.5: Starting osmo-stp 04:28:33.162283 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24505): Launched 04:28:33.488790 run osmo-stp_10.42.42.5(pid=24506): Launched 04:28:33.614056 run osmo-msc_10.42.42.6: Starting osmo-msc 04:28:34.207917 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24508): Launched 04:28:34.533086 run osmo-msc_10.42.42.6(pid=24509): Launched 04:28:34.715539 run osmo-stp_10.42.42.5(pid=24506): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24506)] 04:28:34.852399 run osmo-stp_10.42.42.5(pid=24506): stdout: | (launched: 2022-12-09_04:28:33.429078) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:28:34.991082 run osmo-stp_10.42.42.5(pid=24506): stderr: | 20221209042833622 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042833622 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042833622 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042833623 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042833623 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042833623 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042833623 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:28:35.128752 run osmo-stp_10.42.42.5(pid=24506): stdout: | (launched: 2022-12-09_04:28:33.429078) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:28:35.258480 run osmo-stp_10.42.42.5(pid=24506): stderr: | 20221209042833622 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042833622 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042833622 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042833623 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042833623 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042833623 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042833623 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:28:35.413686 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24506): Process ended prematurely: osmo-stp_10.42.42.5(pid=24506) [trial-2354↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24506)] [trial-2354↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 04:28:35.423082 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 04:28:35.451526 run osmo-hlr_10.42.42.2(pid=24503): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24503)] 04:28:35.502067 run osmo-hlr_10.42.42.2(pid=24503): stdout: | (launched: 2022-12-09_04:28:32.406810) 04:28:35.554496 run osmo-hlr_10.42.42.2(pid=24503): stderr: | 20221209042832604 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209042832604 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209042832604 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209042832604 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209042832604 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209042832604 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209042832621 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209042832630 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209042832631 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209042832631 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:28:35.627615 run osmo-msc_10.42.42.6(pid=24509): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24509)] 04:28:35.678037 run osmo-msc_10.42.42.6(pid=24509): stdout: | (launched: 2022-12-09_04:28:34.473389) 04:28:35.730318 run osmo-msc_10.42.42.6(pid=24509): stderr: | 20221209042834796 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209042834796 DLGLOBAL DEBUG validating counter group 0x7f4cf2957c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209042834796 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209042834796 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209042834796 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209042834796 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209042834798 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209042834798 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209042834799 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209042834799 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:28:35.783105 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24502): Terminating (SIGTERM) 04:28:35.825633 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24505): Terminating (SIGTERM) 04:28:35.867869 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24508): Terminating (SIGTERM) 04:28:35.910952 --- ParallelTerminationStrategy: PID 24502 died... 04:28:35.931234 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24502): Terminated: ok {rc=0} 04:28:35.978156 --- ParallelTerminationStrategy: PID 24505 died... 04:28:35.997767 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24505): Terminated: ok {rc=0} 04:28:36.044693 --- ParallelTerminationStrategy: PID 24508 died... 04:28:36.064621 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24508): Terminated: ok {rc=0} 04:28:36.154149 bus /sierra_3: Setting Powered False 04:28:37.254156 bus /sierra_3: Setting Powered False 04:28:38.370905 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 04:28:39.623630 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:28:39.630776 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 04:28:39.661471 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 04:28:39.690358 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 04:28:39.743620 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 04:28:39.774190 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 04:28:39.802307 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 04:28:40.354111 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 04:28:40.407556 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:28:40.419259 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 04:28:40.491421 tst mo_mt_call.py: using LAC 19072 04:28:40.618626 tst mo_mt_call.py: using RAC 202 04:28:40.744444 tst mo_mt_call.py: using CellId 19072 04:28:40.870345 tst mo_mt_call.py: using BVCI 19073 04:28:40.989524 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:28:41.001225 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:28:41.013329 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:28:41.026562 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:28:41.038293 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:28:41.050517 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 04:28:41.170214 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 04:28:41.287174 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:28:41.759436 run create_hlr_db(pid=24514): Launched 04:28:41.884398 bus /sierra_2: Setting Powered False 04:28:42.945241 run create_hlr_db(pid=24514): Terminated: ok {rc=0} 04:28:43.370359 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24516): Launched 04:28:43.674333 run osmo-hlr_10.42.42.2(pid=24517): Launched 04:28:43.789974 run osmo-stp_10.42.42.5: Starting osmo-stp 04:28:44.312595 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24519): Launched 04:28:44.617309 run osmo-stp_10.42.42.5(pid=24520): Launched 04:28:44.733843 run osmo-msc_10.42.42.6: Starting osmo-msc 04:28:45.285801 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24522): Launched 04:28:45.590538 run osmo-msc_10.42.42.6(pid=24523): Launched 04:28:45.762218 run osmo-stp_10.42.42.5(pid=24520): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24520)] 04:28:45.950658 run osmo-stp_10.42.42.5(pid=24520): stdout: | (launched: 2022-12-09_04:28:44.561313) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:28:46.132823 run osmo-stp_10.42.42.5(pid=24520): stderr: | 20221209042844734 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042844734 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042844734 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042844735 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042844735 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042844735 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042844735 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:28:46.262767 run osmo-stp_10.42.42.5(pid=24520): stdout: | (launched: 2022-12-09_04:28:44.561313) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:28:46.387267 run osmo-stp_10.42.42.5(pid=24520): stderr: | 20221209042844734 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042844734 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042844734 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042844735 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042844735 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042844735 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042844735 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:28:46.536453 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24520): Process ended prematurely: osmo-stp_10.42.42.5(pid=24520) [trial-2354↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24520)] [trial-2354↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 04:28:46.546039 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 04:28:46.573927 run osmo-hlr_10.42.42.2(pid=24517): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24517)] 04:28:46.623193 run osmo-hlr_10.42.42.2(pid=24517): stdout: | (launched: 2022-12-09_04:28:43.618393) 04:28:46.674515 run osmo-hlr_10.42.42.2(pid=24517): stderr: | 20221209042843798 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209042843798 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209042843798 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209042843798 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209042843798 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209042843798 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209042843810 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209042843821 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209042843821 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209042843821 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:28:46.745713 run osmo-msc_10.42.42.6(pid=24523): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24523)] 04:28:46.794900 run osmo-msc_10.42.42.6(pid=24523): stdout: | (launched: 2022-12-09_04:28:45.534229) 04:28:46.846431 run osmo-msc_10.42.42.6(pid=24523): stderr: | 20221209042845806 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209042845806 DLGLOBAL DEBUG validating counter group 0x7f5874c31c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209042845806 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209042845806 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209042845806 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209042845807 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209042845808 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209042845809 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209042845809 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209042845809 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:28:46.898335 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24516): Terminating (SIGTERM) 04:28:46.939222 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24519): Terminating (SIGTERM) 04:28:46.980608 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24522): Terminating (SIGTERM) 04:28:47.023665 --- ParallelTerminationStrategy: PID 24516 died... 04:28:47.043377 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24516): Terminated: ok {rc=0} 04:28:47.089145 --- ParallelTerminationStrategy: PID 24519 died... 04:28:47.108676 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24519): Terminated: ok {rc=0} 04:28:47.154152 --- ParallelTerminationStrategy: PID 24522 died... 04:28:47.173636 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24522): Terminated: ok {rc=0} 04:28:47.261540 bus /sierra_3: Setting Powered False 04:28:48.363255 bus /sierra_3: Setting Powered False 04:28:49.480398 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2354 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 04:28:50.628913 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:28:50.641517 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 04:28:50.709083 tst mo_mt_call_osmux.py: using LAC 19073 04:28:50.838255 tst mo_mt_call_osmux.py: using RAC 203 04:28:50.967676 tst mo_mt_call_osmux.py: using CellId 19073 04:28:51.094103 tst mo_mt_call_osmux.py: using BVCI 19074 04:28:51.213089 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:28:51.224920 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:28:51.236472 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:28:51.248341 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:28:51.260240 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:28:51.272369 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 04:28:51.391663 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 04:28:51.510210 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:28:51.983790 run create_hlr_db(pid=24525): Launched 04:28:52.108694 bus /sierra_2: Setting Powered False 04:28:53.170694 run create_hlr_db(pid=24525): Terminated: ok {rc=0} 04:28:53.615887 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24527): Launched 04:28:53.943136 run osmo-hlr_10.42.42.2(pid=24528): Launched 04:28:54.067496 run osmo-stp_10.42.42.5: Starting osmo-stp 04:28:54.628630 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24530): Launched 04:28:54.958318 run osmo-stp_10.42.42.5(pid=24531): Launched 04:28:55.085414 run osmo-msc_10.42.42.6: Starting osmo-msc 04:28:55.676216 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24533): Launched 04:28:56.005997 run osmo-msc_10.42.42.6(pid=24534): Launched 04:28:56.189734 run osmo-stp_10.42.42.5(pid=24531): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24531)] 04:28:56.327622 run osmo-stp_10.42.42.5(pid=24531): stdout: | (launched: 2022-12-09_04:28:54.898095) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:28:56.466134 run osmo-stp_10.42.42.5(pid=24531): stderr: | 20221209042855094 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042855094 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042855094 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042855095 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042855095 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042855095 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042855095 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:28:56.603856 run osmo-stp_10.42.42.5(pid=24531): stdout: | (launched: 2022-12-09_04:28:54.898095) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:28:56.734209 run osmo-stp_10.42.42.5(pid=24531): stderr: | 20221209042855094 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042855094 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042855094 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042855095 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042855095 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042855095 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042855095 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:28:56.890231 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24531): Process ended prematurely: osmo-stp_10.42.42.5(pid=24531) [trial-2354↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24531)] [trial-2354↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 04:28:56.899959 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 04:28:56.929175 run osmo-hlr_10.42.42.2(pid=24528): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24528)] 04:28:56.980464 run osmo-hlr_10.42.42.2(pid=24528): stdout: | (launched: 2022-12-09_04:28:53.883287) 04:28:57.033533 run osmo-hlr_10.42.42.2(pid=24528): stderr: | 20221209042854082 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209042854082 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209042854082 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209042854082 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209042854082 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209042854082 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209042854095 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209042854104 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209042854104 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209042854104 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:28:57.107487 run osmo-msc_10.42.42.6(pid=24534): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24534)] 04:28:57.158945 run osmo-msc_10.42.42.6(pid=24534): stdout: | (launched: 2022-12-09_04:28:55.945854) 04:28:57.211958 run osmo-msc_10.42.42.6(pid=24534): stderr: | 20221209042856270 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209042856270 DLGLOBAL DEBUG validating counter group 0x7ff915dc3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209042856270 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209042856270 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209042856270 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209042856271 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209042856272 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209042856273 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209042856273 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209042856273 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:28:57.265237 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24527): Terminating (SIGTERM) 04:28:57.307676 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24530): Terminating (SIGTERM) 04:28:57.350710 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24533): Terminating (SIGTERM) 04:28:57.394008 --- ParallelTerminationStrategy: PID 24527 died... 04:28:57.414457 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24527): Terminated: ok {rc=0} 04:28:57.462080 --- ParallelTerminationStrategy: PID 24530 died... 04:28:57.482264 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24530): Terminated: ok {rc=0} 04:28:57.529504 --- ParallelTerminationStrategy: PID 24533 died... 04:28:57.549566 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24533): Terminated: ok {rc=0} 04:28:57.638891 bus /sierra_3: Setting Powered False 04:28:58.739911 bus /sierra_3: Setting Powered False 04:28:59.857192 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 04:29:01.142034 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:29:01.152092 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 04:29:01.182756 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 04:29:01.211241 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 04:29:01.270282 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 04:29:01.312031 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 04:29:01.350343 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 04:29:01.890337 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 04:29:01.958599 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:29:01.973481 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 04:29:02.051837 tst mo_mt_call.py: using LAC 19074 04:29:02.210507 tst mo_mt_call.py: using RAC 204 04:29:02.340279 tst mo_mt_call.py: using CellId 19074 04:29:02.469989 tst mo_mt_call.py: using BVCI 19075 04:29:02.589968 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:29:02.602029 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:29:02.613805 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:29:02.625916 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:29:02.639128 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:29:02.650985 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 04:29:02.770522 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 04:29:02.886630 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:29:03.359203 run create_hlr_db(pid=24539): Launched 04:29:03.484114 bus /sierra_2: Setting Powered False 04:29:04.545824 run create_hlr_db(pid=24539): Terminated: ok {rc=0} 04:29:04.996016 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24541): Launched 04:29:05.323119 run osmo-hlr_10.42.42.2(pid=24542): Launched 04:29:05.448034 run osmo-stp_10.42.42.5: Starting osmo-stp 04:29:06.013102 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24544): Launched 04:29:06.337602 run osmo-stp_10.42.42.5(pid=24545): Launched 04:29:06.461810 run osmo-msc_10.42.42.6: Starting osmo-msc 04:29:07.053092 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24547): Launched 04:29:07.379174 run osmo-msc_10.42.42.6(pid=24548): Launched 04:29:07.561278 run osmo-stp_10.42.42.5(pid=24545): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24545)] 04:29:07.698457 run osmo-stp_10.42.42.5(pid=24545): stdout: | (launched: 2022-12-09_04:29:06.277996) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:29:07.835747 run osmo-stp_10.42.42.5(pid=24545): stderr: | 20221209042906471 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042906471 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042906471 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042906471 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042906472 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042906472 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042906472 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:29:07.972912 run osmo-stp_10.42.42.5(pid=24545): stdout: | (launched: 2022-12-09_04:29:06.277996) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:29:08.102721 run osmo-stp_10.42.42.5(pid=24545): stderr: | 20221209042906471 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042906471 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042906471 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042906471 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042906472 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042906472 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042906472 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:29:08.257949 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24545): Process ended prematurely: osmo-stp_10.42.42.5(pid=24545) [trial-2354↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24545)] [trial-2354↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 04:29:08.267724 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 04:29:08.296882 run osmo-hlr_10.42.42.2(pid=24542): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24542)] 04:29:08.347746 run osmo-hlr_10.42.42.2(pid=24542): stdout: | (launched: 2022-12-09_04:29:05.263364) 04:29:08.400212 run osmo-hlr_10.42.42.2(pid=24542): stderr: | 20221209042905461 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209042905461 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209042905461 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209042905461 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209042905461 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209042905462 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209042905478 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209042905487 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209042905487 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209042905487 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:29:08.473397 run osmo-msc_10.42.42.6(pid=24548): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24548)] 04:29:08.524269 run osmo-msc_10.42.42.6(pid=24548): stdout: | (launched: 2022-12-09_04:29:07.319426) 04:29:08.576471 run osmo-msc_10.42.42.6(pid=24548): stderr: | 20221209042907642 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209042907642 DLGLOBAL DEBUG validating counter group 0x7f36d55ebc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209042907642 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209042907642 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209042907642 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209042907643 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209042907644 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209042907645 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209042907645 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209042907645 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:29:08.629127 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24541): Terminating (SIGTERM) 04:29:08.671695 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24544): Terminating (SIGTERM) 04:29:08.714275 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24547): Terminating (SIGTERM) 04:29:08.757425 --- ParallelTerminationStrategy: PID 24541 died... 04:29:08.777784 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24541): Terminated: ok {rc=0} 04:29:08.825311 --- ParallelTerminationStrategy: PID 24544 died... 04:29:08.845170 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24544): Terminated: ok {rc=0} 04:29:08.892364 --- ParallelTerminationStrategy: PID 24547 died... 04:29:08.912556 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24547): Terminated: ok {rc=0} 04:29:09.000940 bus /sierra_3: Setting Powered False 04:29:10.101185 bus /sierra_3: Setting Powered False 04:29:11.216404 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2354 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 04:29:12.366383 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:29:12.378881 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 04:29:12.446451 tst mo_mt_call_osmux.py: using LAC 19075 04:29:12.575849 tst mo_mt_call_osmux.py: using RAC 205 04:29:12.700259 tst mo_mt_call_osmux.py: using CellId 19075 04:29:12.825251 tst mo_mt_call_osmux.py: using BVCI 19076 04:29:12.943007 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:29:12.954844 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:29:12.966784 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:29:12.978611 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:29:12.990404 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:29:13.002125 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 04:29:13.118972 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 04:29:13.238861 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:29:13.744570 run create_hlr_db(pid=24550): Launched 04:29:13.868827 bus /sierra_2: Setting Powered False 04:29:14.938426 run create_hlr_db(pid=24550): Terminated: ok {rc=0} 04:29:15.371574 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24552): Launched 04:29:15.672848 run osmo-hlr_10.42.42.2(pid=24553): Launched 04:29:15.787787 run osmo-stp_10.42.42.5: Starting osmo-stp 04:29:16.445711 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24555): Launched 04:29:16.788294 run osmo-stp_10.42.42.5(pid=24556): Launched 04:29:17.031663 run osmo-msc_10.42.42.6: Starting osmo-msc 04:29:17.664008 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24558): Launched 04:29:17.965333 run osmo-msc_10.42.42.6(pid=24559): Launched 04:29:18.136836 run osmo-stp_10.42.42.5(pid=24556): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24556)] 04:29:18.263870 run osmo-stp_10.42.42.5(pid=24556): stdout: | (launched: 2022-12-09_04:29:16.723343) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:29:18.391006 run osmo-stp_10.42.42.5(pid=24556): stderr: | 20221209042917033 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042917033 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042917033 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042917034 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042917036 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042917036 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042917036 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:29:18.516106 run osmo-stp_10.42.42.5(pid=24556): stdout: | (launched: 2022-12-09_04:29:16.723343) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:29:18.635916 run osmo-stp_10.42.42.5(pid=24556): stderr: | 20221209042917033 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042917033 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042917033 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042917034 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042917036 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042917036 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042917036 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:29:18.778917 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24556): Process ended prematurely: osmo-stp_10.42.42.5(pid=24556) [trial-2354↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24556)] [trial-2354↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 04:29:18.787782 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 04:29:18.814750 run osmo-hlr_10.42.42.2(pid=24553): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24553)] 04:29:18.862656 run osmo-hlr_10.42.42.2(pid=24553): stdout: | (launched: 2022-12-09_04:29:15.617224) 04:29:18.912201 run osmo-hlr_10.42.42.2(pid=24553): stderr: | 20221209042915797 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209042915797 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209042915797 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209042915798 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209042915798 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209042915798 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209042915810 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209042915820 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209042915821 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209042915821 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:29:18.981451 run osmo-msc_10.42.42.6(pid=24559): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24559)] 04:29:19.029573 run osmo-msc_10.42.42.6(pid=24559): stdout: | (launched: 2022-12-09_04:29:17.909582) 04:29:19.079282 run osmo-msc_10.42.42.6(pid=24559): stderr: | 20221209042918183 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209042918183 DLGLOBAL DEBUG validating counter group 0x7f5058971c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209042918183 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209042918183 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209042918183 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209042918184 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209042918186 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209042918187 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209042918187 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209042918187 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:29:19.129670 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24552): Terminating (SIGTERM) 04:29:19.169384 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24555): Terminating (SIGTERM) 04:29:19.209154 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24558): Terminating (SIGTERM) 04:29:19.249256 --- ParallelTerminationStrategy: PID 24552 died... 04:29:19.268333 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24552): Terminated: ok {rc=0} 04:29:19.312611 --- ParallelTerminationStrategy: PID 24555 died... 04:29:19.331734 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24555): Terminated: ok {rc=0} 04:29:19.375730 --- ParallelTerminationStrategy: PID 24558 died... 04:29:19.394592 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24558): Terminated: ok {rc=0} 04:29:19.480139 bus /sierra_3: Setting Powered False 04:29:20.579239 bus /sierra_3: Setting Powered False 04:29:21.694131 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 04:29:22.939300 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:29:22.945566 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 04:29:22.974498 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 04:29:23.001307 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 04:29:23.054009 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 04:29:23.083181 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 04:29:23.109531 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 04:29:23.660288 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 04:29:23.708176 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:29:23.719362 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 04:29:23.784076 tst mo_mt_call.py: using LAC 19076 04:29:23.912632 tst mo_mt_call.py: using RAC 206 04:29:24.040421 tst mo_mt_call.py: using CellId 19076 04:29:24.171767 tst mo_mt_call.py: using BVCI 19077 04:29:24.288922 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:29:24.300610 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:29:24.312366 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:29:24.324139 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:29:24.336309 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:29:24.348231 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 04:29:24.464725 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 04:29:24.582105 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:29:25.049833 run create_hlr_db(pid=24564): Launched 04:29:25.174295 bus /sierra_2: Setting Powered False 04:29:26.235006 run create_hlr_db(pid=24564): Terminated: ok {rc=0} 04:29:26.655578 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24566): Launched 04:29:26.957708 run osmo-hlr_10.42.42.2(pid=24567): Launched 04:29:27.071698 run osmo-stp_10.42.42.5: Starting osmo-stp 04:29:27.588041 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24569): Launched 04:29:27.889648 run osmo-stp_10.42.42.5(pid=24570): Launched 04:29:28.004341 run osmo-msc_10.42.42.6: Starting osmo-msc 04:29:28.548030 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24572): Launched 04:29:28.849188 run osmo-msc_10.42.42.6(pid=24573): Launched 04:29:29.018649 run osmo-stp_10.42.42.5(pid=24570): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24570)] 04:29:29.146541 run osmo-stp_10.42.42.5(pid=24570): stdout: | (launched: 2022-12-09_04:29:27.834114) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:29:29.274754 run osmo-stp_10.42.42.5(pid=24570): stderr: | 20221209042928004 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042928004 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042928004 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042928005 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042928005 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042928005 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042928005 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:29:29.401121 run osmo-stp_10.42.42.5(pid=24570): stdout: | (launched: 2022-12-09_04:29:27.834114) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:29:29.521509 run osmo-stp_10.42.42.5(pid=24570): stderr: | 20221209042928004 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042928004 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042928004 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042928005 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042928005 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042928005 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042928005 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:29:29.665347 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24570): Process ended prematurely: osmo-stp_10.42.42.5(pid=24570) [trial-2354↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24570)] [trial-2354↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 04:29:29.674266 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 04:29:29.700841 run osmo-hlr_10.42.42.2(pid=24567): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24567)] 04:29:29.748591 run osmo-hlr_10.42.42.2(pid=24567): stdout: | (launched: 2022-12-09_04:29:26.901978) 04:29:29.797954 run osmo-hlr_10.42.42.2(pid=24567): stderr: | 20221209042927080 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209042927080 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209042927080 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209042927081 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209042927081 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209042927081 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209042927092 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209042927102 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209042927102 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209042927102 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:29:29.867362 run osmo-msc_10.42.42.6(pid=24573): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24573)] 04:29:29.914744 run osmo-msc_10.42.42.6(pid=24573): stdout: | (launched: 2022-12-09_04:29:28.793572) 04:29:29.963850 run osmo-msc_10.42.42.6(pid=24573): stderr: | 20221209042929069 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209042929069 DLGLOBAL DEBUG validating counter group 0x7f46aebc6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209042929069 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209042929070 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209042929070 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209042929070 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209042929072 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209042929072 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209042929072 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209042929072 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:29:30.013333 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24566): Terminating (SIGTERM) 04:29:30.052744 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24569): Terminating (SIGTERM) 04:29:30.092174 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24572): Terminating (SIGTERM) 04:29:30.131873 --- ParallelTerminationStrategy: PID 24566 died... 04:29:30.151009 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24566): Terminated: ok {rc=0} 04:29:30.195030 --- ParallelTerminationStrategy: PID 24569 died... 04:29:30.213700 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24569): Terminated: ok {rc=0} 04:29:30.257423 --- ParallelTerminationStrategy: PID 24572 died... 04:29:30.276013 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24572): Terminated: ok {rc=0} 04:29:30.359355 bus /sierra_3: Setting Powered False 04:29:31.458915 bus /sierra_3: Setting Powered False 04:29:32.571946 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2354 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 04:29:33.720942 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:29:33.733420 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 04:29:33.807793 tst mo_mt_call_osmux.py: using LAC 19077 04:29:33.927379 tst mo_mt_call_osmux.py: using RAC 207 04:29:34.047171 tst mo_mt_call_osmux.py: using CellId 19077 04:29:34.167336 tst mo_mt_call_osmux.py: using BVCI 19078 04:29:34.278144 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:29:34.289347 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:29:34.300210 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:29:34.311142 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:29:34.322292 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:29:34.333201 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 04:29:34.452921 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 04:29:34.571918 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:29:35.039560 run create_hlr_db(pid=24575): Launched 04:29:35.163076 bus /sierra_2: Setting Powered False 04:29:36.223175 run create_hlr_db(pid=24575): Terminated: ok {rc=0} 04:29:36.659403 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24577): Launched 04:29:36.979809 run osmo-hlr_10.42.42.2(pid=24578): Launched 04:29:37.103185 run osmo-stp_10.42.42.5: Starting osmo-stp 04:29:37.650967 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24580): Launched 04:29:37.971535 run osmo-stp_10.42.42.5(pid=24581): Launched 04:29:38.094025 run osmo-msc_10.42.42.6: Starting osmo-msc 04:29:38.670588 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24583): Launched 04:29:38.990386 run osmo-msc_10.42.42.6(pid=24584): Launched 04:29:39.168600 run osmo-stp_10.42.42.5(pid=24581): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24581)] 04:29:39.307468 run osmo-stp_10.42.42.5(pid=24581): stdout: | (launched: 2022-12-09_04:29:37.913279) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:29:39.439495 run osmo-stp_10.42.42.5(pid=24581): stderr: | 20221209042938104 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042938104 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042938104 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042938104 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042938105 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042938105 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042938105 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:29:39.573164 run osmo-stp_10.42.42.5(pid=24581): stdout: | (launched: 2022-12-09_04:29:37.913279) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:29:39.701114 run osmo-stp_10.42.42.5(pid=24581): stderr: | 20221209042938104 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042938104 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042938104 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042938104 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042938105 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042938105 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042938105 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:29:39.853889 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24581): Process ended prematurely: osmo-stp_10.42.42.5(pid=24581) [trial-2354↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24581)] [trial-2354↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 04:29:39.863474 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 04:29:39.892348 run osmo-hlr_10.42.42.2(pid=24578): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24578)] 04:29:39.943606 run osmo-hlr_10.42.42.2(pid=24578): stdout: | (launched: 2022-12-09_04:29:36.921548) 04:29:39.996644 run osmo-hlr_10.42.42.2(pid=24578): stderr: | 20221209042937119 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209042937119 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209042937119 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209042937120 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209042937120 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209042937120 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209042937132 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209042937140 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209042937141 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209042937141 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:29:40.069994 run osmo-msc_10.42.42.6(pid=24584): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24584)] 04:29:40.120631 run osmo-msc_10.42.42.6(pid=24584): stdout: | (launched: 2022-12-09_04:29:38.932154) 04:29:40.173601 run osmo-msc_10.42.42.6(pid=24584): stderr: | 20221209042939252 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209042939252 DLGLOBAL DEBUG validating counter group 0x7f32bdc1cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209042939252 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209042939253 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209042939253 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209042939253 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209042939255 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209042939255 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209042939255 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209042939255 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:29:40.226739 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24577): Terminating (SIGTERM) 04:29:40.269100 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24580): Terminating (SIGTERM) 04:29:40.311571 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24583): Terminating (SIGTERM) 04:29:40.354407 --- ParallelTerminationStrategy: PID 24577 died... 04:29:40.374661 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24577): Terminated: ok {rc=0} 04:29:40.422170 --- ParallelTerminationStrategy: PID 24580 died... 04:29:40.442005 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24580): Terminated: ok {rc=0} 04:29:40.489279 --- ParallelTerminationStrategy: PID 24583 died... 04:29:40.509264 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24583): Terminated: ok {rc=0} 04:29:40.598802 bus /sierra_3: Setting Powered False 04:29:41.698288 bus /sierra_3: Setting Powered False 04:29:42.815227 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 04:29:44.062006 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:29:44.070426 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 04:29:44.099599 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 04:29:44.125473 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 04:29:44.175883 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 04:29:44.204043 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 04:29:44.229818 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 04:29:44.786816 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 04:29:44.834482 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:29:44.845602 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 04:29:44.910243 tst mo_mt_call.py: using LAC 19078 04:29:45.026937 tst mo_mt_call.py: using RAC 208 04:29:45.145609 tst mo_mt_call.py: using CellId 19078 04:29:45.262013 tst mo_mt_call.py: using BVCI 19079 04:29:45.369725 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:29:45.380674 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:29:45.391613 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:29:45.402548 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:29:45.413533 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:29:45.424409 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 04:29:45.540324 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 04:29:45.656126 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:29:46.140804 run create_hlr_db(pid=24591): Launched 04:29:46.270063 bus /sierra_2: Setting Powered False 04:29:47.338202 run create_hlr_db(pid=24591): Terminated: ok {rc=0} 04:29:47.760293 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24593): Launched 04:29:48.058464 run osmo-hlr_10.42.42.2(pid=24594): Launched 04:29:48.171617 run osmo-stp_10.42.42.5: Starting osmo-stp 04:29:48.701505 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24596): Launched 04:29:48.999153 run osmo-stp_10.42.42.5(pid=24597): Launched 04:29:49.111736 run osmo-msc_10.42.42.6: Starting osmo-msc 04:29:49.649843 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24599): Launched 04:29:49.947218 run osmo-msc_10.42.42.6(pid=24600): Launched 04:29:50.114357 run osmo-stp_10.42.42.5(pid=24597): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24597)] 04:29:50.240060 run osmo-stp_10.42.42.5(pid=24597): stdout: | (launched: 2022-12-09_04:29:48.944702) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:29:50.366149 run osmo-stp_10.42.42.5(pid=24597): stderr: | 20221209042949113 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042949113 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042949114 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042949114 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042949114 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042949115 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042949115 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:29:50.489919 run osmo-stp_10.42.42.5(pid=24597): stdout: | (launched: 2022-12-09_04:29:48.944702) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:29:50.608196 run osmo-stp_10.42.42.5(pid=24597): stderr: | 20221209042949113 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042949113 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042949114 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042949114 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042949114 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042949115 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042949115 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:29:50.750023 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24597): Process ended prematurely: osmo-stp_10.42.42.5(pid=24597) [trial-2354↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24597)] [trial-2354↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 04:29:50.758753 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 04:29:50.785237 run osmo-hlr_10.42.42.2(pid=24594): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24594)] 04:29:50.833740 run osmo-hlr_10.42.42.2(pid=24594): stdout: | (launched: 2022-12-09_04:29:48.004019) 04:29:50.902568 run osmo-hlr_10.42.42.2(pid=24594): stderr: | 20221209042948183 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209042948183 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209042948183 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209042948183 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209042948183 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209042948183 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209042948196 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209042948204 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209042948204 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209042948204 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:29:50.973346 run osmo-msc_10.42.42.6(pid=24600): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24600)] 04:29:51.020560 run osmo-msc_10.42.42.6(pid=24600): stdout: | (launched: 2022-12-09_04:29:49.892467) 04:29:51.069489 run osmo-msc_10.42.42.6(pid=24600): stderr: | 20221209042950162 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209042950163 DLGLOBAL DEBUG validating counter group 0x7f395e7b2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209042950163 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209042950163 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209042950163 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209042950163 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209042950165 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209042950166 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209042950167 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209042950167 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:29:51.118871 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24593): Terminating (SIGTERM) 04:29:51.158360 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24596): Terminating (SIGTERM) 04:29:51.197826 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24599): Terminating (SIGTERM) 04:29:51.237590 --- ParallelTerminationStrategy: PID 24593 died... 04:29:51.256519 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24593): Terminated: ok {rc=0} 04:29:51.300242 --- ParallelTerminationStrategy: PID 24596 died... 04:29:51.318941 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24596): Terminated: ok {rc=0} 04:29:51.362626 --- ParallelTerminationStrategy: PID 24599 died... 04:29:51.380890 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24599): Terminated: ok {rc=0} 04:29:51.467679 bus /sierra_3: Setting Powered False 04:29:52.566738 bus /sierra_3: Setting Powered False 04:29:53.682234 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2354 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 04:29:54.828019 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:29:54.839671 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 04:29:54.904063 tst mo_mt_call_osmux.py: using LAC 19079 04:29:55.027382 tst mo_mt_call_osmux.py: using RAC 209 04:29:55.144227 tst mo_mt_call_osmux.py: using CellId 19079 04:29:55.259432 tst mo_mt_call_osmux.py: using BVCI 19080 04:29:55.366702 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:29:55.377888 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:29:55.388864 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:29:55.399812 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:29:55.410757 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:29:55.421672 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 04:29:55.541636 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 04:29:55.660867 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:29:56.157990 run create_hlr_db(pid=24602): Launched 04:29:56.280663 bus /sierra_2: Setting Powered False 04:29:57.344625 run create_hlr_db(pid=24602): Terminated: ok {rc=0} 04:29:57.773488 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24604): Launched 04:29:58.070958 run osmo-hlr_10.42.42.2(pid=24605): Launched 04:29:58.183776 run osmo-stp_10.42.42.5: Starting osmo-stp 04:29:58.710254 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24607): Launched 04:29:59.007502 run osmo-stp_10.42.42.5(pid=24608): Launched 04:29:59.120807 run osmo-msc_10.42.42.6: Starting osmo-msc 04:29:59.659191 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24610): Launched 04:29:59.957223 run osmo-msc_10.42.42.6(pid=24611): Launched 04:30:00.124925 run osmo-stp_10.42.42.5(pid=24608): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24608)] 04:30:00.252159 run osmo-stp_10.42.42.5(pid=24608): stdout: | (launched: 2022-12-09_04:29:58.952929) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:30:00.378390 run osmo-stp_10.42.42.5(pid=24608): stderr: | 20221209042959123 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042959123 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042959123 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042959124 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042959124 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042959124 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042959124 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:30:00.502575 run osmo-stp_10.42.42.5(pid=24608): stdout: | (launched: 2022-12-09_04:29:58.952929) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:30:00.621164 run osmo-stp_10.42.42.5(pid=24608): stderr: | 20221209042959123 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209042959123 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209042959123 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209042959124 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209042959124 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209042959124 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209042959124 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:30:00.763010 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24608): Process ended prematurely: osmo-stp_10.42.42.5(pid=24608) [trial-2354↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24608)] [trial-2354↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 04:30:00.771843 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 04:30:00.798638 run osmo-hlr_10.42.42.2(pid=24605): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24605)] 04:30:00.854785 run osmo-hlr_10.42.42.2(pid=24605): stdout: | (launched: 2022-12-09_04:29:58.016563) 04:30:00.922273 run osmo-hlr_10.42.42.2(pid=24605): stderr: | 20221209042958194 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209042958194 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209042958194 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209042958194 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209042958194 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209042958194 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209042958207 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209042958215 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209042958215 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209042958215 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:30:00.994499 run osmo-msc_10.42.42.6(pid=24611): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24611)] 04:30:01.044357 run osmo-msc_10.42.42.6(pid=24611): stdout: | (launched: 2022-12-09_04:29:59.902231) 04:30:01.095845 run osmo-msc_10.42.42.6(pid=24611): stderr: | 20221209043000174 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209043000174 DLGLOBAL DEBUG validating counter group 0x7eff4f6dac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209043000174 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209043000174 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209043000174 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209043000174 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209043000176 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209043000177 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209043000177 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209043000178 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:30:01.148124 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24604): Terminating (SIGTERM) 04:30:01.189755 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24607): Terminating (SIGTERM) 04:30:01.242530 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24610): Terminating (SIGTERM) 04:30:01.303368 --- ParallelTerminationStrategy: PID 24604 died... 04:30:01.331184 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24604): Terminated: ok {rc=0} 04:30:01.391080 --- ParallelTerminationStrategy: PID 24607 died... 04:30:01.411106 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24607): Terminated: ok {rc=0} 04:30:01.462764 --- ParallelTerminationStrategy: PID 24610 died... 04:30:01.482498 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24610): Terminated: ok {rc=0} 04:30:01.577151 bus /sierra_3: Setting Powered False 04:30:02.680736 bus /sierra_3: Setting Powered False 04:30:03.795965 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 04:30:05.044920 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:30:05.051556 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 04:30:05.080476 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 04:30:05.108265 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 04:30:05.157486 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 04:30:05.185824 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 04:30:05.211599 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 04:30:05.767778 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 04:30:05.815232 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:30:05.826510 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 04:30:05.891630 tst mo_mt_call.py: using LAC 19080 04:30:06.008587 tst mo_mt_call.py: using RAC 210 04:30:06.125201 tst mo_mt_call.py: using CellId 19080 04:30:06.241341 tst mo_mt_call.py: using BVCI 19081 04:30:06.348504 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:30:06.359797 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:30:06.370705 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:30:06.382124 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:30:06.393226 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:30:06.404213 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:30:06.521828 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:30:06.639056 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:30:07.103770 run create_hlr_db(pid=24626): Launched 04:30:07.227072 bus /sierra_2: Setting Powered False 04:30:08.286720 run create_hlr_db(pid=24626): Terminated: ok {rc=0} 04:30:08.724720 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24628): Launched 04:30:09.045839 run osmo-hlr_10.42.42.2(pid=24629): Launched 04:30:09.168376 run osmo-stp_10.42.42.5: Starting osmo-stp 04:30:09.722496 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24631): Launched 04:30:10.043252 run osmo-stp_10.42.42.5(pid=24632): Launched 04:30:10.166285 run osmo-msc_10.42.42.6: Starting osmo-msc 04:30:10.752077 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24634): Launched 04:30:11.072655 run osmo-msc_10.42.42.6(pid=24635): Launched 04:30:11.251437 run osmo-stp_10.42.42.5(pid=24632): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24632)] 04:30:11.386513 run osmo-stp_10.42.42.5(pid=24632): stdout: | (launched: 2022-12-09_04:30:09.985057) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:30:11.522130 run osmo-stp_10.42.42.5(pid=24632): stderr: | 20221209043010177 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043010177 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043010178 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043010178 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043010178 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043010178 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043010179 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:30:11.657475 run osmo-stp_10.42.42.5(pid=24632): stdout: | (launched: 2022-12-09_04:30:09.985057) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:30:11.785602 run osmo-stp_10.42.42.5(pid=24632): stderr: | 20221209043010177 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043010177 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043010178 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043010178 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043010178 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043010178 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043010179 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:30:11.939285 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24632): Process ended prematurely: osmo-stp_10.42.42.5(pid=24632) [trial-2354↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24632)] [trial-2354↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 04:30:11.948562 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 04:30:11.977843 run osmo-hlr_10.42.42.2(pid=24629): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24629)] 04:30:12.028582 run osmo-hlr_10.42.42.2(pid=24629): stdout: | (launched: 2022-12-09_04:30:08.987369) 04:30:12.081236 run osmo-hlr_10.42.42.2(pid=24629): stderr: | 20221209043009187 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209043009187 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209043009187 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209043009187 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209043009187 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209043009187 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209043009199 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209043009207 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209043009207 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209043009207 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:30:12.155460 run osmo-msc_10.42.42.6(pid=24635): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24635)] 04:30:12.210203 run osmo-msc_10.42.42.6(pid=24635): stdout: | (launched: 2022-12-09_04:30:11.014308) 04:30:12.266112 run osmo-msc_10.42.42.6(pid=24635): stderr: | 20221209043011334 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209043011334 DLGLOBAL DEBUG validating counter group 0x7f231dd36c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209043011334 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209043011334 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209043011335 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209043011335 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209043011336 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209043011337 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209043011337 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209043011337 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:30:12.322440 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24628): Terminating (SIGTERM) 04:30:12.367481 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24631): Terminating (SIGTERM) 04:30:12.412084 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24634): Terminating (SIGTERM) 04:30:12.456777 --- ParallelTerminationStrategy: PID 24628 died... 04:30:12.477547 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24628): Terminated: ok {rc=0} 04:30:12.527710 --- ParallelTerminationStrategy: PID 24631 died... 04:30:12.548368 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24631): Terminated: ok {rc=0} 04:30:12.598465 --- ParallelTerminationStrategy: PID 24634 died... 04:30:12.619129 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24634): Terminated: ok {rc=0} 04:30:12.712386 bus /sierra_3: Setting Powered False 04:30:13.819364 bus /sierra_3: Setting Powered False 04:30:14.938914 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2354 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 04:30:16.118191 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:30:16.134891 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 04:30:16.204291 tst mo_mt_call_osmux.py: using LAC 19081 04:30:16.333164 tst mo_mt_call_osmux.py: using RAC 211 04:30:16.461116 tst mo_mt_call_osmux.py: using CellId 19081 04:30:16.609877 tst mo_mt_call_osmux.py: using BVCI 19082 04:30:16.762229 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:30:16.774390 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:30:16.787200 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:30:16.799121 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:30:16.811722 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:30:16.826681 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:30:16.949787 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:30:17.068848 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:30:17.567573 run create_hlr_db(pid=24988): Launched 04:30:17.690105 bus /sierra_2: Setting Powered False 04:30:18.750299 run create_hlr_db(pid=24988): Terminated: ok {rc=0} 04:30:19.187573 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24990): Launched 04:30:19.507771 run osmo-hlr_10.42.42.2(pid=24991): Launched 04:30:19.630700 run osmo-stp_10.42.42.5: Starting osmo-stp 04:30:20.184512 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24993): Launched 04:30:20.505790 run osmo-stp_10.42.42.5(pid=24994): Launched 04:30:20.628156 run osmo-msc_10.42.42.6: Starting osmo-msc 04:30:21.206614 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24996): Launched 04:30:21.526598 run osmo-msc_10.42.42.6(pid=24997): Launched 04:30:21.705690 run osmo-stp_10.42.42.5(pid=24994): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24994)] 04:30:21.841021 run osmo-stp_10.42.42.5(pid=24994): stdout: | (launched: 2022-12-09_04:30:20.447347) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:30:21.977678 run osmo-stp_10.42.42.5(pid=24994): stderr: | 20221209043020639 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043020639 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043020640 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043020640 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043020640 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043020641 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043020641 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:30:22.112919 run osmo-stp_10.42.42.5(pid=24994): stdout: | (launched: 2022-12-09_04:30:20.447347) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:30:22.240836 run osmo-stp_10.42.42.5(pid=24994): stderr: | 20221209043020639 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043020639 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043020640 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043020640 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043020640 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043020641 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043020641 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:30:22.393841 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24994): Process ended prematurely: osmo-stp_10.42.42.5(pid=24994) [trial-2354↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24994)] [trial-2354↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 04:30:22.403173 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 04:30:22.432007 run osmo-hlr_10.42.42.2(pid=24991): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24991)] 04:30:22.483980 run osmo-hlr_10.42.42.2(pid=24991): stdout: | (launched: 2022-12-09_04:30:19.449613) 04:30:22.538272 run osmo-hlr_10.42.42.2(pid=24991): stderr: | 20221209043019648 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209043019648 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209043019648 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209043019648 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209043019648 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209043019648 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209043019660 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209043019669 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209043019669 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209043019669 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:30:22.612679 run osmo-msc_10.42.42.6(pid=24997): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24997)] 04:30:22.667451 run osmo-msc_10.42.42.6(pid=24997): stdout: | (launched: 2022-12-09_04:30:21.468058) 04:30:22.722556 run osmo-msc_10.42.42.6(pid=24997): stderr: | 20221209043021790 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209043021790 DLGLOBAL DEBUG validating counter group 0x7f271f570c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209043021790 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209043021791 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209043021791 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209043021791 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209043021793 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209043021793 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209043021793 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209043021793 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:30:22.778899 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24990): Terminating (SIGTERM) 04:30:22.823790 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24993): Terminating (SIGTERM) 04:30:22.869244 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24996): Terminating (SIGTERM) 04:30:22.916115 --- ParallelTerminationStrategy: PID 24990 died... 04:30:22.937631 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24990): Terminated: ok {rc=0} 04:30:22.989472 --- ParallelTerminationStrategy: PID 24993 died... 04:30:23.010424 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24993): Terminated: ok {rc=0} 04:30:23.060771 --- ParallelTerminationStrategy: PID 24996 died... 04:30:23.082315 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24996): Terminated: ok {rc=0} 04:30:23.175458 bus /sierra_3: Setting Powered False 04:30:24.274483 bus /sierra_3: Setting Powered False 04:30:25.391635 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 04:30:26.648138 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:30:26.654946 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 04:30:26.689346 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 04:30:26.718939 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 04:30:26.772363 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 04:30:26.803387 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 04:30:26.832361 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 04:30:27.382540 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 04:30:27.431157 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:30:27.442751 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:30:27.511218 tst mo_mt_call.py: using LAC 19082 04:30:27.631235 tst mo_mt_call.py: using RAC 212 04:30:27.750117 tst mo_mt_call.py: using CellId 19082 04:30:27.867525 tst mo_mt_call.py: using BVCI 19083 04:30:27.979385 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:30:27.991615 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:30:28.003534 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:30:28.015588 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:30:28.027816 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:30:28.040116 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 04:30:28.157599 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 04:30:28.275575 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:30:28.746223 run create_hlr_db(pid=25178): Launched 04:30:28.869599 bus /sierra_2: Setting Powered False 04:30:29.929503 run create_hlr_db(pid=25178): Terminated: ok {rc=0} 04:30:30.346351 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25180): Launched 04:30:30.643830 run osmo-hlr_10.42.42.2(pid=25181): Launched 04:30:30.758095 run osmo-stp_10.42.42.5: Starting osmo-stp 04:30:31.346366 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25183): Launched 04:30:31.658648 run osmo-stp_10.42.42.5(pid=25184): Launched 04:30:31.880058 run osmo-msc_10.42.42.6: Starting osmo-msc 04:30:32.529536 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25186): Launched 04:30:32.851263 run osmo-msc_10.42.42.6(pid=25187): Launched 04:30:33.030956 run osmo-stp_10.42.42.5(pid=25184): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25184)] 04:30:33.166889 run osmo-stp_10.42.42.5(pid=25184): stdout: | (launched: 2022-12-09_04:30:31.598475) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:30:33.303645 run osmo-stp_10.42.42.5(pid=25184): stderr: | 20221209043031917 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043031917 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043031917 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043031918 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043031918 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043031918 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043031918 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:30:33.439580 run osmo-stp_10.42.42.5(pid=25184): stdout: | (launched: 2022-12-09_04:30:31.598475) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:30:33.568192 run osmo-stp_10.42.42.5(pid=25184): stderr: | 20221209043031917 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043031917 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043031917 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043031918 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043031918 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043031918 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043031918 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:30:33.721994 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25184): Process ended prematurely: osmo-stp_10.42.42.5(pid=25184) [trial-2354↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25184)] [trial-2354↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 04:30:33.731581 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 04:30:33.760532 run osmo-hlr_10.42.42.2(pid=25181): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25181)] 04:30:33.811294 run osmo-hlr_10.42.42.2(pid=25181): stdout: | (launched: 2022-12-09_04:30:30.589504) 04:30:33.863758 run osmo-hlr_10.42.42.2(pid=25181): stderr: | 20221209043030768 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209043030768 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209043030768 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209043030768 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209043030768 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209043030768 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209043030781 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209043030789 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209043030789 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209043030789 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:30:33.937600 run osmo-msc_10.42.42.6(pid=25187): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25187)] 04:30:33.988601 run osmo-msc_10.42.42.6(pid=25187): stdout: | (launched: 2022-12-09_04:30:32.792726) 04:30:34.041052 run osmo-msc_10.42.42.6(pid=25187): stderr: | 20221209043033113 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209043033114 DLGLOBAL DEBUG validating counter group 0x7fa2eedd4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209043033114 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209043033114 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209043033114 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209043033114 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209043033116 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209043033116 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209043033116 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209043033116 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:30:34.093843 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25180): Terminating (SIGTERM) 04:30:34.136003 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25183): Terminating (SIGTERM) 04:30:34.178481 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25186): Terminating (SIGTERM) 04:30:34.221472 --- ParallelTerminationStrategy: PID 25180 died... 04:30:34.241633 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25180): Terminated: ok {rc=0} 04:30:34.288887 --- ParallelTerminationStrategy: PID 25183 died... 04:30:34.308788 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25183): Terminated: ok {rc=0} 04:30:34.355707 --- ParallelTerminationStrategy: PID 25186 died... 04:30:34.375597 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25186): Terminated: ok {rc=0} 04:30:34.464050 bus /sierra_3: Setting Powered False 04:30:35.561139 bus /sierra_3: Setting Powered False 04:30:36.676177 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2354 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 04:30:37.821167 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:30:37.832731 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:30:37.898482 tst mo_mt_call_osmux.py: using LAC 19083 04:30:38.016138 tst mo_mt_call_osmux.py: using RAC 213 04:30:38.133112 tst mo_mt_call_osmux.py: using CellId 19083 04:30:38.249622 tst mo_mt_call_osmux.py: using BVCI 19084 04:30:38.357467 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:30:38.368391 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:30:38.379361 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:30:38.390270 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:30:38.401197 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:30:38.411930 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 04:30:38.526563 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 04:30:38.645715 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:30:39.107615 run create_hlr_db(pid=25189): Launched 04:30:39.229491 bus /sierra_2: Setting Powered False 04:30:40.290349 run create_hlr_db(pid=25189): Terminated: ok {rc=0} 04:30:40.727418 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25191): Launched 04:30:41.048159 run osmo-hlr_10.42.42.2(pid=25192): Launched 04:30:41.170547 run osmo-stp_10.42.42.5: Starting osmo-stp 04:30:41.697941 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25194): Launched 04:30:41.995896 run osmo-stp_10.42.42.5(pid=25195): Launched 04:30:42.109085 run osmo-msc_10.42.42.6: Starting osmo-msc 04:30:42.646552 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25197): Launched 04:30:42.946001 run osmo-msc_10.42.42.6(pid=25198): Launched 04:30:43.113495 run osmo-stp_10.42.42.5(pid=25195): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25195)] 04:30:43.239237 run osmo-stp_10.42.42.5(pid=25195): stdout: | (launched: 2022-12-09_04:30:41.940272) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:30:43.365709 run osmo-stp_10.42.42.5(pid=25195): stderr: | 20221209043042110 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043042111 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043042111 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043042111 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043042112 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043042112 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043042112 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:30:43.490121 run osmo-stp_10.42.42.5(pid=25195): stdout: | (launched: 2022-12-09_04:30:41.940272) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:30:43.608839 run osmo-stp_10.42.42.5(pid=25195): stderr: | 20221209043042110 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043042111 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043042111 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043042111 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043042112 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043042112 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043042112 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:30:43.750887 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25195): Process ended prematurely: osmo-stp_10.42.42.5(pid=25195) [trial-2354↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25195)] [trial-2354↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 04:30:43.759551 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 04:30:43.786087 run osmo-hlr_10.42.42.2(pid=25192): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25192)] 04:30:43.833647 run osmo-hlr_10.42.42.2(pid=25192): stdout: | (launched: 2022-12-09_04:30:40.989954) 04:30:43.883128 run osmo-hlr_10.42.42.2(pid=25192): stderr: | 20221209043041190 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209043041190 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209043041190 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209043041190 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209043041190 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209043041190 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209043041202 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209043041211 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209043041211 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209043041211 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:30:43.952562 run osmo-msc_10.42.42.6(pid=25198): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25198)] 04:30:44.000602 run osmo-msc_10.42.42.6(pid=25198): stdout: | (launched: 2022-12-09_04:30:42.890720) 04:30:44.050157 run osmo-msc_10.42.42.6(pid=25198): stderr: | 20221209043043166 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209043043166 DLGLOBAL DEBUG validating counter group 0x7fb525a9ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209043043166 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209043043166 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209043043166 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209043043166 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209043043168 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209043043169 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209043043169 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209043043169 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:30:44.100278 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25191): Terminating (SIGTERM) 04:30:44.139962 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25194): Terminating (SIGTERM) 04:30:44.179581 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25197): Terminating (SIGTERM) 04:30:44.219811 --- ParallelTerminationStrategy: PID 25191 died... 04:30:44.238997 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25191): Terminated: ok {rc=0} 04:30:44.283003 --- ParallelTerminationStrategy: PID 25194 died... 04:30:44.301813 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25194): Terminated: ok {rc=0} 04:30:44.345656 --- ParallelTerminationStrategy: PID 25197 died... 04:30:44.364275 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25197): Terminated: ok {rc=0} 04:30:44.448287 bus /sierra_3: Setting Powered False 04:30:45.542780 bus /sierra_3: Setting Powered False 04:30:46.661695 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 emergency:trx-lms-limenet-micro --------------------------------------------------------------------- 04:30:47.914579 tst emergency:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:30:47.919323 tst emergency:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 04:30:47.950171 tst emergency:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 04:30:47.977153 tst emergency:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 04:30:48.061985 tst emergency:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 04:30:48.091594 tst emergency:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 04:30:48.118486 tst emergency:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 04:30:48.705683 tst emergency:trx-lms-limenet-micro: RESERVED RESOURCES for emergency: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2354 emergency:trx-lms-limenet-micro emergency_mo_mt_call.py ---------------------------------------------- 04:30:48.711775 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:30:48.723529 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 04:30:48.768231 tst emergency_mo_mt_call.py: using LAC 19084 04:30:48.883190 tst emergency_mo_mt_call.py: using RAC 214 04:30:49.003294 tst emergency_mo_mt_call.py: using CellId 19084 04:30:49.116265 tst emergency_mo_mt_call.py: using BVCI 19085 04:30:49.222710 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:30:49.233473 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:30:49.243940 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:30:49.254464 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:30:49.264885 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:30:49.275345 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 04:30:49.391117 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 04:30:49.508409 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:30:49.997043 run create_hlr_db(pid=25204): Launched 04:30:50.117279 bus /sierra_2: Setting Powered False 04:30:51.180253 run create_hlr_db(pid=25204): Terminated: ok {rc=0} 04:30:51.618841 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25206): Launched 04:30:51.932816 run osmo-hlr_10.42.42.2(pid=25207): Launched 04:30:52.054086 run osmo-stp_10.42.42.5: Starting osmo-stp 04:30:52.597248 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25209): Launched 04:30:52.910448 run osmo-stp_10.42.42.5(pid=25210): Launched 04:30:53.040864 tst emergency_mo_mt_call.py: using MSISDN 7024 04:30:53.206603 run osmo-msc_10.42.42.6: Starting osmo-msc 04:30:53.773961 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25212): Launched 04:30:54.088346 run osmo-msc_10.42.42.6(pid=25213): Launched 04:30:54.263893 run osmo-stp_10.42.42.5(pid=25210): ERR: Terminated: ERROR {rc=1} [trial-2354↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25210)] 04:30:54.397235 run osmo-stp_10.42.42.5(pid=25210): stdout: | (launched: 2022-12-09_04:30:52.853341) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:30:54.530757 run osmo-stp_10.42.42.5(pid=25210): stderr: | 20221209043053043 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043053043 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043053043 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043053044 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043053044 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043053045 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043053045 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:30:54.663256 run osmo-stp_10.42.42.5(pid=25210): stdout: | (launched: 2022-12-09_04:30:52.853341) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:30:54.788159 run osmo-stp_10.42.42.5(pid=25210): stderr: | 20221209043053043 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043053043 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043053043 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043053044 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043053044 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043053045 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043053045 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:30:54.937476 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=25210): Process ended prematurely: osmo-stp_10.42.42.5(pid=25210) [trial-2354↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25210)] [trial-2354↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19] 04:30:54.946727 tst emergency_mo_mt_call.py:19: Test FAILED (6.2 sec) 04:30:54.975070 run osmo-hlr_10.42.42.2(pid=25207): ERR: Terminated: ERROR {rc=237} [trial-2354↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25207)] 04:30:55.025603 run osmo-hlr_10.42.42.2(pid=25207): stdout: | (launched: 2022-12-09_04:30:51.875102) 04:30:55.077868 run osmo-hlr_10.42.42.2(pid=25207): stderr: | 20221209043052073 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209043052073 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209043052073 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209043052073 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209043052073 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209043052073 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209043052085 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/emergency:trx-lms-limenet-micro/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209043052093 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209043052094 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209043052094 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:30:55.150663 run osmo-msc_10.42.42.6(pid=25213): ERR: Terminated: ERROR {rc=2} [trial-2354↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25213)] 04:30:55.201052 run osmo-msc_10.42.42.6(pid=25213): stdout: | (launched: 2022-12-09_04:30:54.030796) 04:30:55.253123 run osmo-msc_10.42.42.6(pid=25213): stderr: | 20221209043054350 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209043054350 DLGLOBAL DEBUG validating counter group 0x7fd3441dfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209043054350 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209043054350 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209043054350 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209043054351 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209043054352 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209043054353 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209043054353 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209043054353 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:30:55.305864 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25206): Terminating (SIGTERM) 04:30:55.347908 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25209): Terminating (SIGTERM) 04:30:55.390116 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25212): Terminating (SIGTERM) 04:30:55.432769 --- ParallelTerminationStrategy: PID 25206 died... 04:30:55.453023 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25206): Terminated: ok {rc=0} 04:30:55.500051 --- ParallelTerminationStrategy: PID 25209 died... 04:30:55.519868 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25209): Terminated: ok {rc=0} 04:30:55.566496 --- ParallelTerminationStrategy: PID 25212 died... 04:30:55.586329 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25212): Terminated: ok {rc=0} 04:30:55.675658 bus /sierra_3: Setting Powered False 04:30:56.774949 bus /sierra_3: Setting Powered False 04:30:57.891149 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2354 emergency:trx-lms-limenet-micro emergency_preemptive_call.py ---------------------------------------------- 04:30:58.977900 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:30:58.989913 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 04:30:59.038719 tst emergency_preemptive_call.py: using LAC 19085 04:30:59.161396 tst emergency_preemptive_call.py: using RAC 215 04:30:59.284685 tst emergency_preemptive_call.py: using CellId 19085 04:30:59.400594 tst emergency_preemptive_call.py: using BVCI 19086 04:30:59.505791 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:30:59.516506 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:30:59.527087 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:30:59.537868 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:30:59.548396 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:30:59.559017 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 04:30:59.671880 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 04:30:59.787060 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 04:30:59.905685 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 04:31:00.023257 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:31:00.513480 run create_hlr_db(pid=25215): Launched 04:31:00.634840 bus /sierra_2: Setting Powered False 04:31:01.701568 run create_hlr_db(pid=25215): Terminated: ok {rc=0} 04:31:02.180783 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25217): Launched 04:31:02.506931 run osmo-hlr_10.42.42.2(pid=25218): Launched 04:31:02.628942 run osmo-stp_10.42.42.5: Starting osmo-stp 04:31:03.170179 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25220): Launched 04:31:03.484037 run osmo-stp_10.42.42.5(pid=25221): Launched 04:31:03.611693 tst emergency_preemptive_call.py: using MSISDN 7025 04:31:03.776023 run osmo-msc_10.42.42.6: Starting osmo-msc 04:31:04.340780 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25223): Launched 04:31:04.654792 run osmo-msc_10.42.42.6(pid=25224): Launched 04:31:04.830784 run osmo-stp_10.42.42.5(pid=25221): ERR: Terminated: ERROR {rc=1} [trial-2354↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25221)] 04:31:04.968908 run osmo-stp_10.42.42.5(pid=25221): stdout: | (launched: 2022-12-09_04:31:03.426872) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:31:05.101451 run osmo-stp_10.42.42.5(pid=25221): stderr: | 20221209043103619 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043103619 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043103619 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043103620 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043103620 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043103620 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043103620 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:31:05.233270 run osmo-stp_10.42.42.5(pid=25221): stdout: | (launched: 2022-12-09_04:31:03.426872) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:31:05.358645 run osmo-stp_10.42.42.5(pid=25221): stderr: | 20221209043103619 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043103619 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043103619 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043103620 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043103620 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043103620 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043103620 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:31:05.508208 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=25221): Process ended prematurely: osmo-stp_10.42.42.5(pid=25221) [trial-2354↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25221)] [trial-2354↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32] 04:31:05.517091 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 04:31:05.545400 run osmo-hlr_10.42.42.2(pid=25218): ERR: Terminated: ERROR {rc=237} [trial-2354↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25218)] 04:31:05.596184 run osmo-hlr_10.42.42.2(pid=25218): stdout: | (launched: 2022-12-09_04:31:02.449772) 04:31:05.648656 run osmo-hlr_10.42.42.2(pid=25218): stderr: | 20221209043102645 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209043102645 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209043102645 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209043102645 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209043102645 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209043102646 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209043102659 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/emergency:trx-lms-limenet-micro/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209043102670 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209043102670 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209043102670 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:31:05.722055 run osmo-msc_10.42.42.6(pid=25224): ERR: Terminated: ERROR {rc=2} [trial-2354↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25224)] 04:31:05.772777 run osmo-msc_10.42.42.6(pid=25224): stdout: | (launched: 2022-12-09_04:31:04.597510) 04:31:05.825189 run osmo-msc_10.42.42.6(pid=25224): stderr: | 20221209043104917 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209043104917 DLGLOBAL DEBUG validating counter group 0x7f03007ccc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209043104917 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209043104917 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209043104918 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209043104918 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209043104919 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209043104920 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209043104920 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209043104920 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:31:05.877983 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25217): Terminating (SIGTERM) 04:31:05.920035 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25220): Terminating (SIGTERM) 04:31:05.962565 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25223): Terminating (SIGTERM) 04:31:06.005307 --- ParallelTerminationStrategy: PID 25217 died... 04:31:06.025538 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25217): Terminated: ok {rc=0} 04:31:06.072468 --- ParallelTerminationStrategy: PID 25220 died... 04:31:06.092049 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25220): Terminated: ok {rc=0} 04:31:06.139088 --- ParallelTerminationStrategy: PID 25223 died... 04:31:06.158862 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25223): Terminated: ok {rc=0} 04:31:06.247310 bus /sierra_9: Setting Powered False 04:31:07.346804 bus /sierra_9: Setting Powered False 04:31:08.463350 bus /sierra_8: Setting Powered False 04:31:09.561848 bus /sierra_8: Setting Powered False 04:31:10.679436 bus /sierra_3: Setting Powered False 04:31:11.777442 bus /sierra_3: Setting Powered False 04:31:12.893636 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 emergency:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 gprs:trx-lms-limenet-micro --------------------------------------------------------------------- 04:31:14.164266 tst gprs:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:31:14.168565 tst gprs:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 04:31:14.197165 tst gprs:trx-lms-limenet-micro: Verifying 9 x ip_address (candidates: 9) 04:31:14.235187 tst gprs:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 04:31:14.322389 tst gprs:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 04:31:14.352282 tst gprs:trx-lms-limenet-micro: Reserving 9 x ip_address (candidates: 9) 04:31:14.391377 tst gprs:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 04:31:14.977789 tst gprs:trx-lms-limenet-micro: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2354 gprs:trx-lms-limenet-micro cs_paging_gprs_active.py ---------------------------------------------- 04:31:15.027331 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:31:15.038003 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 04:31:15.083210 tst cs_paging_gprs_active.py: using LAC 19086 04:31:15.201086 tst cs_paging_gprs_active.py: using RAC 216 04:31:15.320350 tst cs_paging_gprs_active.py: using CellId 19086 04:31:15.439742 tst cs_paging_gprs_active.py: using BVCI 19087 04:31:15.547831 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:31:15.558542 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:31:15.569005 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:31:15.579990 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:31:15.590812 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:31:15.601608 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:31:15.612650 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:31:15.623656 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:31:15.634764 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 04:31:15.751575 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 04:31:15.881206 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 04:31:16.115591 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:31:16.452792 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25229): Launched 04:31:16.751662 run iperf3-srv_10.42.42.10(pid=25230): Launched 04:31:16.883478 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 04:31:17.106119 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:31:17.432549 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25231): Launched 04:31:17.712408 run iperf3-srv_10.42.42.10(pid=25232): Launched 04:31:17.833422 tst cs_paging_gprs_active.py:38: start network... 04:31:18.050207 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:31:18.548027 run create_hlr_db(pid=25233): Launched 04:31:18.671617 bus /sierra_2: Setting Powered False 04:31:19.734903 run create_hlr_db(pid=25233): Terminated: ok {rc=0} 04:31:20.182178 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25235): Launched 04:31:20.503321 run osmo-hlr_10.42.42.2(pid=25236): Launched 04:31:20.626139 run osmo-stp_10.42.42.5: Starting osmo-stp 04:31:21.179869 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25238): Launched 04:31:21.499391 run osmo-stp_10.42.42.5(pid=25239): Launched 04:31:21.622146 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:31:22.175071 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25241): Launched 04:31:22.298319 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:31:22.570468 run patchelf(pid=25242): Launched 04:31:22.749776 run osmo-stp_10.42.42.5(pid=25239): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25239)] 04:31:22.885707 run osmo-stp_10.42.42.5(pid=25239): stdout: | (launched: 2022-12-09_04:31:21.441382) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:31:23.023933 run osmo-stp_10.42.42.5(pid=25239): stderr: | 20221209043121632 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043121633 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043121633 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043121633 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043121634 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043121634 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043121634 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:31:23.161974 run osmo-stp_10.42.42.5(pid=25239): stdout: | (launched: 2022-12-09_04:31:21.441382) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:31:23.293875 run osmo-stp_10.42.42.5(pid=25239): stderr: | 20221209043121632 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043121633 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043121633 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043121633 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043121634 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043121634 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043121634 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:31:23.450006 run patchelf(pid=25242): Terminating (SIGINT) 04:31:23.631224 run patchelf(pid=25242): Terminated: ok {rc=0} 04:31:23.761850 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=25239): Process ended prematurely: osmo-stp_10.42.42.5(pid=25239) [trial-2354↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25239)] [trial-2354↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38] 04:31:23.772021 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 04:31:23.801534 run osmo-hlr_10.42.42.2(pid=25236): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25236)] 04:31:23.852271 run osmo-hlr_10.42.42.2(pid=25236): stdout: | (launched: 2022-12-09_04:31:20.444587) 04:31:23.904743 run osmo-hlr_10.42.42.2(pid=25236): stderr: | 20221209043120642 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209043120642 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209043120642 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209043120642 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209043120642 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209043120642 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209043120654 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-lms-limenet-micro/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209043120663 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209043120663 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209043120663 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:31:23.957725 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25229): Terminating (SIGTERM) 04:31:24.000550 run iperf3-srv_10.42.42.10(pid=25230): Terminating (SIGTERM) 04:31:24.042709 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25231): Terminating (SIGTERM) 04:31:24.085234 run iperf3-srv_10.42.42.10(pid=25232): Terminating (SIGTERM) 04:31:24.127442 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25235): Terminating (SIGTERM) 04:31:24.170319 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25238): Terminating (SIGTERM) 04:31:24.212535 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25241): Terminating (SIGTERM) 04:31:24.255225 --- ParallelTerminationStrategy: PID 25229 died... 04:31:24.275522 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25229): Terminated: ok {rc=0} 04:31:24.323377 --- ParallelTerminationStrategy: PID 25230 died... 04:31:24.343284 run iperf3-srv_10.42.42.10(pid=25230): Terminated {rc=256} 04:31:24.390336 --- ParallelTerminationStrategy: PID 25231 died... 04:31:24.410202 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25231): Terminated: ok {rc=0} 04:31:24.457311 --- ParallelTerminationStrategy: PID 25232 died... 04:31:24.476863 run iperf3-srv_10.42.42.10(pid=25232): Terminated {rc=256} 04:31:24.523771 --- ParallelTerminationStrategy: PID 25235 died... 04:31:24.543526 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25235): Terminated: ok {rc=0} 04:31:24.590150 --- ParallelTerminationStrategy: PID 25238 died... 04:31:24.610028 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25238): Terminated: ok {rc=0} 04:31:24.657184 --- ParallelTerminationStrategy: PID 25241 died... 04:31:24.676930 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25241): Terminated: ok {rc=0} 04:31:24.765889 bus /gobi_0: Setting Powered False 04:31:25.865715 bus /gobi_0: Setting Powered False 04:31:26.980889 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:trx-lms-limenet-micro iperf3.py ---------------------------------------------- 04:31:28.129087 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:31:28.140858 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 04:31:28.190361 tst iperf3.py: using LAC 19087 04:31:28.317157 tst iperf3.py: using RAC 217 04:31:28.444838 tst iperf3.py: using CellId 19087 04:31:28.569416 tst iperf3.py: using BVCI 19088 04:31:28.679130 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:31:28.689813 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:31:28.700191 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:31:28.710599 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:31:28.720919 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:31:28.731262 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:31:28.741842 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:31:28.752238 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:31:28.762828 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 04:31:28.880340 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 04:31:29.096862 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:31:29.418404 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25244): Launched 04:31:29.698021 run iperf3-srv_10.42.42.10(pid=25245): Launched 04:31:29.818232 tst iperf3.py:8: start network... 04:31:30.034374 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:31:30.530211 run create_hlr_db(pid=25246): Launched 04:31:30.653061 bus /gobi_6: Setting Powered False 04:31:31.712829 run create_hlr_db(pid=25246): Terminated: ok {rc=0} 04:31:32.224444 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25248): Launched 04:31:32.554162 run osmo-hlr_10.42.42.2(pid=25249): Launched 04:31:32.677479 run osmo-stp_10.42.42.5: Starting osmo-stp 04:31:33.231758 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25251): Launched 04:31:33.552057 run osmo-stp_10.42.42.5(pid=25252): Launched 04:31:33.674781 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:31:34.227213 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25254): Launched 04:31:34.349847 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:31:34.620478 run patchelf(pid=25255): Launched 04:31:34.798597 run osmo-stp_10.42.42.5(pid=25252): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25252)] 04:31:34.934441 run osmo-stp_10.42.42.5(pid=25252): stdout: | (launched: 2022-12-09_04:31:33.493716) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:31:35.072227 run osmo-stp_10.42.42.5(pid=25252): stderr: | 20221209043133685 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043133685 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043133686 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043133686 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043133686 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043133687 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043133687 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:31:35.210151 run osmo-stp_10.42.42.5(pid=25252): stdout: | (launched: 2022-12-09_04:31:33.493716) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:31:35.342151 run osmo-stp_10.42.42.5(pid=25252): stderr: | 20221209043133685 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043133685 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043133686 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043133686 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043133686 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043133687 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043133687 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:31:35.498084 run patchelf(pid=25255): Terminating (SIGINT) 04:31:35.678304 run patchelf(pid=25255): Terminated: ok {rc=0} 04:31:35.808504 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25252): Process ended prematurely: osmo-stp_10.42.42.5(pid=25252) [trial-2354↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25252)] [trial-2354↪gprs:trx-lms-limenet-micro↪iperf3.py:8] 04:31:35.818621 tst iperf3.py:8: Test FAILED (7.7 sec) 04:31:35.847940 run osmo-hlr_10.42.42.2(pid=25249): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-lms-limenet-micro↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25249)] 04:31:35.898608 run osmo-hlr_10.42.42.2(pid=25249): stdout: | (launched: 2022-12-09_04:31:32.495712) 04:31:35.951217 run osmo-hlr_10.42.42.2(pid=25249): stderr: | 20221209043132693 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209043132693 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209043132693 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209043132693 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209043132693 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209043132693 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209043132704 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-lms-limenet-micro/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209043132712 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209043132713 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209043132713 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:31:36.004626 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25244): Terminating (SIGTERM) 04:31:36.047225 run iperf3-srv_10.42.42.10(pid=25245): Terminating (SIGTERM) 04:31:36.089770 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25248): Terminating (SIGTERM) 04:31:36.132160 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25251): Terminating (SIGTERM) 04:31:36.174738 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25254): Terminating (SIGTERM) 04:31:36.217581 --- ParallelTerminationStrategy: PID 25244 died... 04:31:36.237642 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25244): Terminated: ok {rc=0} 04:31:36.284825 --- ParallelTerminationStrategy: PID 25245 died... 04:31:36.305073 run iperf3-srv_10.42.42.10(pid=25245): Terminated {rc=256} 04:31:36.352341 --- ParallelTerminationStrategy: PID 25248 died... 04:31:36.372254 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25248): Terminated: ok {rc=0} 04:31:36.419324 --- ParallelTerminationStrategy: PID 25251 died... 04:31:36.439066 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25251): Terminated: ok {rc=0} 04:31:36.485867 --- ParallelTerminationStrategy: PID 25254 died... 04:31:36.505574 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25254): Terminated: ok {rc=0} 04:31:36.594144 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:trx-lms-limenet-micro iperf3m4.py ---------------------------------------------- 04:31:37.739975 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:31:37.751276 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 04:31:37.796199 tst iperf3m4.py: using LAC 19088 04:31:37.915146 tst iperf3m4.py: using RAC 218 04:31:38.034251 tst iperf3m4.py: using CellId 19088 04:31:38.152670 tst iperf3m4.py: using BVCI 19089 04:31:38.260265 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:31:38.271043 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:31:38.281552 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:31:38.291919 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:31:38.302361 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:31:38.312595 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:31:38.323208 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:31:38.333574 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:31:38.344161 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 04:31:38.458933 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 04:31:38.578034 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 04:31:38.697248 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 04:31:38.820329 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 04:31:39.036717 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:31:39.357706 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25256): Launched 04:31:39.636644 run iperf3-srv_10.42.42.10(pid=25257): Launched 04:31:39.757082 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 04:31:39.972838 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:31:40.293567 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25258): Launched 04:31:40.572513 run iperf3-srv_10.42.42.10(pid=25259): Launched 04:31:40.693448 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 04:31:40.908885 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:31:41.230823 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25260): Launched 04:31:41.509274 run iperf3-srv_10.42.42.10(pid=25261): Launched 04:31:41.629875 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 04:31:41.845408 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:31:42.169010 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25262): Launched 04:31:42.448071 run iperf3-srv_10.42.42.10(pid=25264): Launched 04:31:42.568523 tst iperf3m4.py:8: start network... 04:31:42.783749 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:31:43.281788 run create_hlr_db(pid=25265): Launched 04:31:43.403708 bus /gobi_6: Setting Powered False 04:31:44.468198 run create_hlr_db(pid=25265): Terminated: ok {rc=0} 04:31:44.913601 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25267): Launched 04:31:45.235228 run osmo-hlr_10.42.42.2(pid=25268): Launched 04:31:45.358280 run osmo-stp_10.42.42.5: Starting osmo-stp 04:31:46.029443 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25270): Launched 04:31:46.345887 run osmo-stp_10.42.42.5(pid=25271): Launched 04:31:46.480046 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:31:47.215042 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25273): Launched 04:31:47.360413 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:31:47.616171 run patchelf(pid=25274): Launched 04:31:47.780168 run osmo-stp_10.42.42.5(pid=25271): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25271)] 04:31:47.904466 run osmo-stp_10.42.42.5(pid=25271): stdout: | (launched: 2022-12-09_04:31:46.287363) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:31:48.030504 run osmo-stp_10.42.42.5(pid=25271): stderr: | 20221209043146635 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043146636 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043146637 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043146639 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043146641 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043146641 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043146641 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:31:48.156128 run osmo-stp_10.42.42.5(pid=25271): stdout: | (launched: 2022-12-09_04:31:46.287363) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:31:48.276371 run osmo-stp_10.42.42.5(pid=25271): stderr: | 20221209043146635 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043146636 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043146637 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043146639 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043146641 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043146641 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043146641 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:31:48.418606 run patchelf(pid=25274): Terminating (SIGINT) 04:31:48.585785 run patchelf(pid=25274): Terminated: ok {rc=0} 04:31:48.705367 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25271): Process ended prematurely: osmo-stp_10.42.42.5(pid=25271) [trial-2354↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25271)] [trial-2354↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8] 04:31:48.714764 tst iperf3m4.py:8: Test FAILED (11.0 sec) 04:31:48.742075 run osmo-hlr_10.42.42.2(pid=25268): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-lms-limenet-micro↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25268)] 04:31:48.789394 run osmo-hlr_10.42.42.2(pid=25268): stdout: | (launched: 2022-12-09_04:31:45.176475) 04:31:48.838404 run osmo-hlr_10.42.42.2(pid=25268): stderr: | 20221209043145373 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209043145373 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209043145373 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209043145373 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209043145373 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209043145373 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209043145386 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-lms-limenet-micro/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209043145394 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209043145394 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209043145395 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:31:48.887623 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25256): Terminating (SIGTERM) 04:31:48.927061 run iperf3-srv_10.42.42.10(pid=25257): Terminating (SIGTERM) 04:31:48.966264 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25258): Terminating (SIGTERM) 04:31:49.005483 run iperf3-srv_10.42.42.10(pid=25259): Terminating (SIGTERM) 04:31:49.044728 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25260): Terminating (SIGTERM) 04:31:49.083844 run iperf3-srv_10.42.42.10(pid=25261): Terminating (SIGTERM) 04:31:49.122972 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25262): Terminating (SIGTERM) 04:31:49.162669 run iperf3-srv_10.42.42.10(pid=25264): Terminating (SIGTERM) 04:31:49.202090 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25267): Terminating (SIGTERM) 04:31:49.241318 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25270): Terminating (SIGTERM) 04:31:49.280490 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25273): Terminating (SIGTERM) 04:31:49.319929 --- ParallelTerminationStrategy: PID 25256 died... 04:31:49.338973 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25256): Terminated: ok {rc=0} 04:31:49.383176 --- ParallelTerminationStrategy: PID 25257 died... 04:31:49.401824 run iperf3-srv_10.42.42.10(pid=25257): Terminated {rc=256} 04:31:49.445400 --- ParallelTerminationStrategy: PID 25258 died... 04:31:49.463989 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25258): Terminated: ok {rc=0} 04:31:49.508094 --- ParallelTerminationStrategy: PID 25259 died... 04:31:49.526738 run iperf3-srv_10.42.42.10(pid=25259): Terminated {rc=256} 04:31:49.570447 --- ParallelTerminationStrategy: PID 25260 died... 04:31:49.588870 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25260): Terminated: ok {rc=0} 04:31:49.632756 --- ParallelTerminationStrategy: PID 25261 died... 04:31:49.651346 run iperf3-srv_10.42.42.10(pid=25261): Terminated {rc=256} 04:31:49.694885 --- ParallelTerminationStrategy: PID 25262 died... 04:31:49.713424 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25262): Terminated: ok {rc=0} 04:31:49.756907 --- ParallelTerminationStrategy: PID 25264 died... 04:31:49.776058 run iperf3-srv_10.42.42.10(pid=25264): Terminated {rc=256} 04:31:49.819711 --- ParallelTerminationStrategy: PID 25267 died... 04:31:49.838332 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25267): Terminated: ok {rc=0} 04:31:49.881687 --- ParallelTerminationStrategy: PID 25270 died... 04:31:49.900087 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25270): Terminated: ok {rc=0} 04:31:49.943585 --- ParallelTerminationStrategy: PID 25273 died... 04:31:49.962152 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25273): Terminated: ok {rc=0} 04:31:50.045497 bus /gobi_4: Setting Powered False 04:31:51.142101 bus /gobi_4: Setting Powered False 04:31:52.262405 bus /gobi_1: Setting Powered False 04:31:53.360451 bus /gobi_1: Setting Powered False 04:31:54.475990 bus /gobi_0: Setting Powered False 04:31:55.575275 bus /gobi_0: Setting Powered False 04:31:56.691347 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:trx-lms-limenet-micro ping.py ---------------------------------------------- 04:31:57.794117 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:31:57.805295 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 04:31:57.850952 tst ping.py: using LAC 19089 04:31:57.966889 tst ping.py: using RAC 219 04:31:58.082033 tst ping.py: using CellId 19089 04:31:58.197632 tst ping.py: using BVCI 19090 04:31:58.302428 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:31:58.312904 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:31:58.323374 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:31:58.334408 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:31:58.345348 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:31:58.356262 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:31:58.367290 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:31:58.378248 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 04:31:58.492407 tst ping.py:19: start network... 04:31:58.685292 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:31:59.130071 run create_hlr_db(pid=25275): Launched 04:31:59.248090 bus /gobi_6: Setting Powered False 04:32:00.306950 run create_hlr_db(pid=25275): Terminated: ok {rc=0} 04:32:00.729290 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25277): Launched 04:32:01.051391 run osmo-hlr_10.42.42.2(pid=25278): Launched 04:32:01.192803 run osmo-stp_10.42.42.5: Starting osmo-stp 04:32:01.915371 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25280): Launched 04:32:02.221563 run osmo-stp_10.42.42.5(pid=25281): Launched 04:32:02.332451 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:32:02.898461 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25283): Launched 04:32:03.017843 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:32:03.279033 run patchelf(pid=25284): Launched 04:32:03.451432 run osmo-stp_10.42.42.5(pid=25281): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25281)] 04:32:03.582709 run osmo-stp_10.42.42.5(pid=25281): stdout: | (launched: 2022-12-09_04:32:02.166012) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:32:03.715541 run osmo-stp_10.42.42.5(pid=25281): stderr: | 20221209043202333 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043202333 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043202334 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043202334 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043202335 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043202335 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043202335 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:32:03.848574 run osmo-stp_10.42.42.5(pid=25281): stdout: | (launched: 2022-12-09_04:32:02.166012) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:32:03.975988 run osmo-stp_10.42.42.5(pid=25281): stderr: | 20221209043202333 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043202333 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043202334 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043202334 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043202335 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043202335 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043202335 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:32:04.127457 run patchelf(pid=25284): Terminating (SIGINT) 04:32:04.302110 run patchelf(pid=25284): Terminated: ok {rc=0} 04:32:04.428092 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=25281): Process ended prematurely: osmo-stp_10.42.42.5(pid=25281) [trial-2354↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25281)] [trial-2354↪gprs:trx-lms-limenet-micro↪ping.py:22] 04:32:04.437676 tst ping.py:22: Test FAILED (6.6 sec) 04:32:04.466245 run osmo-hlr_10.42.42.2(pid=25278): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-lms-limenet-micro↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25278)] 04:32:04.516343 run osmo-hlr_10.42.42.2(pid=25278): stdout: | (launched: 2022-12-09_04:32:00.982552) 04:32:04.568723 run osmo-hlr_10.42.42.2(pid=25278): stderr: | 20221209043201343 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209043201343 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209043201343 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209043201343 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209043201343 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209043201343 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209043201355 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-lms-limenet-micro/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209043201371 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209043201372 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209043201372 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:32:04.621537 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25277): Terminating (SIGTERM) 04:32:04.663735 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25280): Terminating (SIGTERM) 04:32:04.705909 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25283): Terminating (SIGTERM) 04:32:04.748140 --- ParallelTerminationStrategy: PID 25277 died... 04:32:04.768181 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25277): Terminated: ok {rc=0} 04:32:04.814876 --- ParallelTerminationStrategy: PID 25280 died... 04:32:04.834386 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25280): Terminated: ok {rc=0} 04:32:04.881300 --- ParallelTerminationStrategy: PID 25283 died... 04:32:04.900772 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25283): Terminated: ok {rc=0} 04:32:04.989420 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:trx-lms-limenet-micro ping_idle_ping.py ---------------------------------------------- 04:32:06.076840 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:32:06.088536 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 04:32:06.135944 tst ping_idle_ping.py: using LAC 19090 04:32:06.260061 tst ping_idle_ping.py: using RAC 220 04:32:06.382347 tst ping_idle_ping.py: using CellId 19090 04:32:06.508154 tst ping_idle_ping.py: using BVCI 19091 04:32:06.622775 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:32:06.633892 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:32:06.644756 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:32:06.656000 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:32:06.667009 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:32:06.678333 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:32:06.689626 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:32:06.700623 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 04:32:06.813968 tst ping_idle_ping.py:24: start network... 04:32:07.009791 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:32:07.460587 run create_hlr_db(pid=25285): Launched 04:32:07.581087 bus /gobi_6: Setting Powered False 04:32:08.641548 run create_hlr_db(pid=25285): Terminated: ok {rc=0} 04:32:09.057657 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25287): Launched 04:32:09.347448 run osmo-hlr_10.42.42.2(pid=25288): Launched 04:32:09.458329 run osmo-stp_10.42.42.5: Starting osmo-stp 04:32:09.955693 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25290): Launched 04:32:10.245377 run osmo-stp_10.42.42.5(pid=25291): Launched 04:32:10.356002 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:32:10.857335 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25293): Launched 04:32:10.968512 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:32:11.213044 run patchelf(pid=25294): Launched 04:32:11.374338 run osmo-stp_10.42.42.5(pid=25291): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25291)] 04:32:11.497184 run osmo-stp_10.42.42.5(pid=25291): stdout: | (launched: 2022-12-09_04:32:10.192137) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:32:11.621959 run osmo-stp_10.42.42.5(pid=25291): stderr: | 20221209043210358 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043210359 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043210359 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043210359 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043210360 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043210360 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043210360 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:32:11.746704 run osmo-stp_10.42.42.5(pid=25291): stdout: | (launched: 2022-12-09_04:32:10.192137) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:32:11.865773 run osmo-stp_10.42.42.5(pid=25291): stderr: | 20221209043210358 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043210359 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043210359 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043210359 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043210360 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043210360 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043210360 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:32:12.006844 run patchelf(pid=25294): Terminating (SIGINT) 04:32:12.170585 run patchelf(pid=25294): Terminated: ok {rc=0} 04:32:12.288239 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=25291): Process ended prematurely: osmo-stp_10.42.42.5(pid=25291) [trial-2354↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25291)] [trial-2354↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27] 04:32:12.297078 tst ping_idle_ping.py:27: Test FAILED (6.2 sec) 04:32:12.323469 run osmo-hlr_10.42.42.2(pid=25288): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25288)] 04:32:12.370760 run osmo-hlr_10.42.42.2(pid=25288): stdout: | (launched: 2022-12-09_04:32:09.294154) 04:32:12.419764 run osmo-hlr_10.42.42.2(pid=25288): stderr: | 20221209043209469 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209043209469 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209043209469 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209043209469 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209043209469 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209043209469 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209043209482 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-lms-limenet-micro/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209043209490 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209043209490 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209043209490 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:32:12.469416 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25287): Terminating (SIGTERM) 04:32:12.508728 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25290): Terminating (SIGTERM) 04:32:12.548013 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25293): Terminating (SIGTERM) 04:32:12.587652 --- ParallelTerminationStrategy: PID 25287 died... 04:32:12.606362 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25287): Terminated: ok {rc=0} 04:32:12.649546 --- ParallelTerminationStrategy: PID 25290 died... 04:32:12.667883 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25290): Terminated: ok {rc=0} 04:32:12.712169 --- ParallelTerminationStrategy: PID 25293 died... 04:32:12.730576 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25293): Terminated: ok {rc=0} 04:32:12.815779 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2354 gprs:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 gprs:trx-lms-limenet-micro+mod-bts0-egprs --------------------------------------------------------------------- 04:32:14.106958 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:32:14.112015 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 04:32:14.140475 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 04:32:14.178100 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 04:32:14.261520 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 04:32:14.289608 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 04:32:14.326642 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 04:32:14.922536 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2354 gprs:trx-lms-limenet-micro+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 04:32:14.969779 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:32:14.980736 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:32:15.027901 tst cs_paging_gprs_active.py: using LAC 19091 04:32:15.142243 tst cs_paging_gprs_active.py: using RAC 221 04:32:15.257316 tst cs_paging_gprs_active.py: using CellId 19091 04:32:15.371045 tst cs_paging_gprs_active.py: using BVCI 19092 04:32:15.477150 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:32:15.487956 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:32:15.498565 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:32:15.509202 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:32:15.519710 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:32:15.530426 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:32:15.541090 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:32:15.551604 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:32:15.562341 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:32:15.674086 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:32:15.788464 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 04:32:15.990037 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:32:16.325127 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25300): Launched 04:32:16.607054 run iperf3-srv_10.42.42.10(pid=25301): Launched 04:32:16.724115 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 04:32:16.925755 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:32:17.230163 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25302): Launched 04:32:17.500259 run iperf3-srv_10.42.42.10(pid=25303): Launched 04:32:17.610813 tst cs_paging_gprs_active.py:38: start network... 04:32:17.806501 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:32:18.263032 run create_hlr_db(pid=25304): Launched 04:32:18.383907 bus /gobi_6: Setting Powered False 04:32:19.442829 run create_hlr_db(pid=25304): Terminated: ok {rc=0} 04:32:19.854149 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25306): Launched 04:32:20.147641 run osmo-hlr_10.42.42.2(pid=25307): Launched 04:32:20.260180 run osmo-stp_10.42.42.5: Starting osmo-stp 04:32:20.780468 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25309): Launched 04:32:21.074494 run osmo-stp_10.42.42.5(pid=25310): Launched 04:32:21.186683 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:32:21.694248 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25312): Launched 04:32:21.806565 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:32:22.055540 run patchelf(pid=25313): Launched 04:32:22.219498 run osmo-stp_10.42.42.5(pid=25310): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25310)] 04:32:22.343911 run osmo-stp_10.42.42.5(pid=25310): stdout: | (launched: 2022-12-09_04:32:21.020735) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:32:22.469818 run osmo-stp_10.42.42.5(pid=25310): stderr: | 20221209043221189 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043221189 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043221190 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043221190 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043221190 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043221191 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043221191 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:32:22.595805 run osmo-stp_10.42.42.5(pid=25310): stdout: | (launched: 2022-12-09_04:32:21.020735) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:32:22.716458 run osmo-stp_10.42.42.5(pid=25310): stderr: | 20221209043221189 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043221189 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043221190 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043221190 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043221190 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043221191 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043221191 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:32:22.860240 run patchelf(pid=25313): Terminating (SIGINT) 04:32:23.026677 run patchelf(pid=25313): Terminated: ok {rc=0} 04:32:23.146958 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=25310): Process ended prematurely: osmo-stp_10.42.42.5(pid=25310) [trial-2354↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25310)] [trial-2354↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 04:32:23.156333 tst cs_paging_gprs_active.py:38: Test FAILED (8.2 sec) 04:32:23.183328 run osmo-hlr_10.42.42.2(pid=25307): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25307)] 04:32:23.230575 run osmo-hlr_10.42.42.2(pid=25307): stdout: | (launched: 2022-12-09_04:32:20.093644) 04:32:23.279421 run osmo-hlr_10.42.42.2(pid=25307): stderr: | 20221209043220268 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209043220268 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209043220268 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209043220268 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209043220268 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209043220268 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209043220280 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-lms-limenet-micro+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209043220289 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209043220289 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209043220289 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:32:23.328846 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25300): Terminating (SIGTERM) 04:32:23.368064 run iperf3-srv_10.42.42.10(pid=25301): Terminating (SIGTERM) 04:32:23.407179 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25302): Terminating (SIGTERM) 04:32:23.446328 run iperf3-srv_10.42.42.10(pid=25303): Terminating (SIGTERM) 04:32:23.485349 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25306): Terminating (SIGTERM) 04:32:23.525120 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25309): Terminating (SIGTERM) 04:32:23.564274 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25312): Terminating (SIGTERM) 04:32:23.603836 --- ParallelTerminationStrategy: PID 25300 died... 04:32:23.622393 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25300): Terminated: ok {rc=0} 04:32:23.666090 --- ParallelTerminationStrategy: PID 25301 died... 04:32:23.684367 run iperf3-srv_10.42.42.10(pid=25301): Terminated {rc=256} 04:32:23.727758 --- ParallelTerminationStrategy: PID 25302 died... 04:32:23.746092 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25302): Terminated: ok {rc=0} 04:32:23.789439 --- ParallelTerminationStrategy: PID 25303 died... 04:32:23.807811 run iperf3-srv_10.42.42.10(pid=25303): Terminated {rc=256} 04:32:23.851166 --- ParallelTerminationStrategy: PID 25306 died... 04:32:23.869589 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25306): Terminated: ok {rc=0} 04:32:23.913233 --- ParallelTerminationStrategy: PID 25309 died... 04:32:23.931555 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25309): Terminated: ok {rc=0} 04:32:23.975294 --- ParallelTerminationStrategy: PID 25312 died... 04:32:23.993875 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25312): Terminated: ok {rc=0} 04:32:24.080042 bus /gobi_0: Setting Powered False 04:32:25.180727 bus /gobi_0: Setting Powered False 04:32:26.294197 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3.py ---------------------------------------------- 04:32:27.441630 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:32:27.453757 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:32:27.501372 tst iperf3.py: using LAC 19092 04:32:27.626298 tst iperf3.py: using RAC 222 04:32:27.748855 tst iperf3.py: using CellId 19092 04:32:27.872272 tst iperf3.py: using BVCI 19093 04:32:27.986804 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:32:27.998589 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:32:28.010120 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:32:28.021672 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:32:28.032937 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:32:28.045261 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:32:28.057341 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:32:28.068740 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:32:28.080376 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:32:28.196490 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 04:32:28.393770 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:32:28.689392 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25314): Launched 04:32:28.947066 run iperf3-srv_10.42.42.10(pid=25315): Launched 04:32:29.057708 tst iperf3.py:8: start network... 04:32:29.253719 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:32:29.707821 run create_hlr_db(pid=25316): Launched 04:32:29.830147 bus /gobi_6: Setting Powered False 04:32:30.915593 run create_hlr_db(pid=25316): Terminated: ok {rc=0} 04:32:31.344511 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25318): Launched 04:32:31.725627 run osmo-hlr_10.42.42.2(pid=25319): Launched 04:32:31.859665 run osmo-stp_10.42.42.5: Starting osmo-stp 04:32:32.549780 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25321): Launched 04:32:32.846463 run osmo-stp_10.42.42.5(pid=25322): Launched 04:32:32.958782 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:32:33.463253 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25324): Launched 04:32:33.575632 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:32:33.822849 run patchelf(pid=25325): Launched 04:32:33.986173 run osmo-stp_10.42.42.5(pid=25322): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25322)] 04:32:34.110985 run osmo-stp_10.42.42.5(pid=25322): stdout: | (launched: 2022-12-09_04:32:32.792774) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:32:34.237386 run osmo-stp_10.42.42.5(pid=25322): stderr: | 20221209043232961 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043232962 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043232962 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043232962 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043232963 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043232963 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043232963 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:32:34.363428 run osmo-stp_10.42.42.5(pid=25322): stdout: | (launched: 2022-12-09_04:32:32.792774) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:32:34.484306 run osmo-stp_10.42.42.5(pid=25322): stderr: | 20221209043232961 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043232962 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043232962 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043232962 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043232963 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043232963 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043232963 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:32:34.627084 run patchelf(pid=25325): Terminating (SIGINT) 04:32:34.793167 run patchelf(pid=25325): Terminated: ok {rc=0} 04:32:34.913229 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25322): Process ended prematurely: osmo-stp_10.42.42.5(pid=25322) [trial-2354↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25322)] [trial-2354↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8] 04:32:34.922605 tst iperf3.py:8: Test FAILED (7.5 sec) 04:32:34.949625 run osmo-hlr_10.42.42.2(pid=25319): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25319)] 04:32:34.997193 run osmo-hlr_10.42.42.2(pid=25319): stdout: | (launched: 2022-12-09_04:32:31.659489) 04:32:35.046332 run osmo-hlr_10.42.42.2(pid=25319): stderr: | 20221209043232030 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209043232030 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209043232030 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209043232030 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209043232030 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209043232030 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209043232052 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209043232070 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209043232070 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209043232070 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:32:35.095894 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25314): Terminating (SIGTERM) 04:32:35.135711 run iperf3-srv_10.42.42.10(pid=25315): Terminating (SIGTERM) 04:32:35.175264 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25318): Terminating (SIGTERM) 04:32:35.215665 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25321): Terminating (SIGTERM) 04:32:35.255671 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25324): Terminating (SIGTERM) 04:32:35.295503 --- ParallelTerminationStrategy: PID 25314 died... 04:32:35.314655 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25314): Terminated: ok {rc=0} 04:32:35.358829 --- ParallelTerminationStrategy: PID 25315 died... 04:32:35.377470 run iperf3-srv_10.42.42.10(pid=25315): Terminated {rc=256} 04:32:35.421174 --- ParallelTerminationStrategy: PID 25318 died... 04:32:35.439620 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25318): Terminated: ok {rc=0} 04:32:35.483258 --- ParallelTerminationStrategy: PID 25321 died... 04:32:35.502144 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25321): Terminated: ok {rc=0} 04:32:35.546022 --- ParallelTerminationStrategy: PID 25324 died... 04:32:35.564687 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25324): Terminated: ok {rc=0} 04:32:35.649919 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 04:32:36.795519 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:32:36.807088 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:32:36.853895 tst iperf3m4.py: using LAC 19093 04:32:36.970804 tst iperf3m4.py: using RAC 223 04:32:37.087012 tst iperf3m4.py: using CellId 19093 04:32:37.204255 tst iperf3m4.py: using BVCI 19094 04:32:37.311175 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:32:37.322307 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:32:37.333121 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:32:37.343950 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:32:37.354749 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:32:37.365625 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:32:37.376648 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:32:37.387355 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:32:37.398234 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:32:37.517159 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:32:37.635257 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:32:37.752697 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:32:37.872492 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 04:32:38.086630 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:32:38.402635 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25328): Launched 04:32:38.676759 run iperf3-srv_10.42.42.10(pid=25329): Launched 04:32:38.796139 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 04:32:39.008799 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:32:39.325761 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25330): Launched 04:32:39.600874 run iperf3-srv_10.42.42.10(pid=25331): Launched 04:32:39.720088 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 04:32:39.933499 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:32:40.250523 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25332): Launched 04:32:40.525410 run iperf3-srv_10.42.42.10(pid=25333): Launched 04:32:40.644301 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 04:32:40.855838 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:32:41.173563 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25334): Launched 04:32:41.447793 run iperf3-srv_10.42.42.10(pid=25335): Launched 04:32:41.566416 tst iperf3m4.py:8: start network... 04:32:41.778277 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:32:42.267518 run create_hlr_db(pid=25336): Launched 04:32:42.387934 bus /gobi_6: Setting Powered False 04:32:43.450217 run create_hlr_db(pid=25336): Terminated: ok {rc=0} 04:32:43.872928 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25338): Launched 04:32:44.170592 run osmo-hlr_10.42.42.2(pid=25339): Launched 04:32:44.283136 run osmo-stp_10.42.42.5: Starting osmo-stp 04:32:44.822716 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25341): Launched 04:32:45.137891 run osmo-stp_10.42.42.5(pid=25342): Launched 04:32:45.258097 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:32:45.800386 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25344): Launched 04:32:45.935509 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:32:46.210785 run patchelf(pid=25345): Launched 04:32:46.398185 run osmo-stp_10.42.42.5(pid=25342): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25342)] 04:32:46.535584 run osmo-stp_10.42.42.5(pid=25342): stdout: | (launched: 2022-12-09_04:32:45.080248) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:32:46.674815 run osmo-stp_10.42.42.5(pid=25342): stderr: | 20221209043245268 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043245268 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043245268 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043245269 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043245269 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043245269 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043245269 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:32:46.813964 run osmo-stp_10.42.42.5(pid=25342): stdout: | (launched: 2022-12-09_04:32:45.080248) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:32:46.946994 run osmo-stp_10.42.42.5(pid=25342): stderr: | 20221209043245268 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043245268 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043245268 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043245269 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043245269 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043245269 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043245269 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:32:47.105102 run patchelf(pid=25345): Terminating (SIGINT) 04:32:47.283886 run patchelf(pid=25345): Terminated: ok {rc=0} 04:32:47.411722 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25342): Process ended prematurely: osmo-stp_10.42.42.5(pid=25342) [trial-2354↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25342)] [trial-2354↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8] 04:32:47.422254 tst iperf3m4.py:8: Test FAILED (10.7 sec) 04:32:47.451598 run osmo-hlr_10.42.42.2(pid=25339): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25339)] 04:32:47.502589 run osmo-hlr_10.42.42.2(pid=25339): stdout: | (launched: 2022-12-09_04:32:44.116005) 04:32:47.555338 run osmo-hlr_10.42.42.2(pid=25339): stderr: | 20221209043244291 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209043244291 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209043244291 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209043244291 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209043244291 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209043244291 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209043244303 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209043244311 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209043244311 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209043244311 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:32:47.608307 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25328): Terminating (SIGTERM) 04:32:47.650556 run iperf3-srv_10.42.42.10(pid=25329): Terminating (SIGTERM) 04:32:47.692590 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25330): Terminating (SIGTERM) 04:32:47.735485 run iperf3-srv_10.42.42.10(pid=25331): Terminating (SIGTERM) 04:32:47.778340 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25332): Terminating (SIGTERM) 04:32:47.820875 run iperf3-srv_10.42.42.10(pid=25333): Terminating (SIGTERM) 04:32:47.863298 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25334): Terminating (SIGTERM) 04:32:47.905676 run iperf3-srv_10.42.42.10(pid=25335): Terminating (SIGTERM) 04:32:47.947872 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25338): Terminating (SIGTERM) 04:32:47.990154 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25341): Terminating (SIGTERM) 04:32:48.032620 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25344): Terminating (SIGTERM) 04:32:48.075315 --- ParallelTerminationStrategy: PID 25328 died... 04:32:48.095486 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25328): Terminated: ok {rc=0} 04:32:48.142365 --- ParallelTerminationStrategy: PID 25329 died... 04:32:48.161925 run iperf3-srv_10.42.42.10(pid=25329): Terminated {rc=256} 04:32:48.208480 --- ParallelTerminationStrategy: PID 25330 died... 04:32:48.228018 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25330): Terminated: ok {rc=0} 04:32:48.274710 --- ParallelTerminationStrategy: PID 25331 died... 04:32:48.294352 run iperf3-srv_10.42.42.10(pid=25331): Terminated {rc=256} 04:32:48.341225 --- ParallelTerminationStrategy: PID 25332 died... 04:32:48.360736 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25332): Terminated: ok {rc=0} 04:32:48.407501 --- ParallelTerminationStrategy: PID 25333 died... 04:32:48.427123 run iperf3-srv_10.42.42.10(pid=25333): Terminated {rc=256} 04:32:48.473899 --- ParallelTerminationStrategy: PID 25334 died... 04:32:48.493623 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25334): Terminated: ok {rc=0} 04:32:48.540349 --- ParallelTerminationStrategy: PID 25335 died... 04:32:48.560171 run iperf3-srv_10.42.42.10(pid=25335): Terminated {rc=256} 04:32:48.607085 --- ParallelTerminationStrategy: PID 25338 died... 04:32:48.626841 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25338): Terminated: ok {rc=0} 04:32:48.673616 --- ParallelTerminationStrategy: PID 25341 died... 04:32:48.693401 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25341): Terminated: ok {rc=0} 04:32:48.740244 --- ParallelTerminationStrategy: PID 25344 died... 04:32:48.760092 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25344): Terminated: ok {rc=0} 04:32:48.848907 bus /gobi_4: Setting Powered False 04:32:49.947421 bus /gobi_4: Setting Powered False 04:32:51.063440 bus /gobi_1: Setting Powered False 04:32:52.164264 bus /gobi_1: Setting Powered False 04:32:53.280450 bus /gobi_0: Setting Powered False 04:32:54.378772 bus /gobi_0: Setting Powered False 04:32:55.496719 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping.py ---------------------------------------------- 04:32:56.599102 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:32:56.611068 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:32:56.664240 tst ping.py: using LAC 19094 04:32:56.790044 tst ping.py: using RAC 224 04:32:56.910354 tst ping.py: using CellId 19094 04:32:57.030353 tst ping.py: using BVCI 19095 04:32:57.142811 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:32:57.154136 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:32:57.165388 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:32:57.176632 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:32:57.187937 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:32:57.199198 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:32:57.210670 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:32:57.222111 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:32:57.337350 tst ping.py:19: start network... 04:32:57.544730 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:32:58.022882 run create_hlr_db(pid=25346): Launched 04:32:58.140732 bus /gobi_6: Setting Powered False 04:32:59.202822 run create_hlr_db(pid=25346): Terminated: ok {rc=0} 04:32:59.617247 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25348): Launched 04:32:59.906151 run osmo-hlr_10.42.42.2(pid=25349): Launched 04:33:00.016218 run osmo-stp_10.42.42.5: Starting osmo-stp 04:33:00.513907 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25351): Launched 04:33:00.801234 run osmo-stp_10.42.42.5(pid=25352): Launched 04:33:01.059472 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:33:01.619937 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25355): Launched 04:33:01.762058 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:33:02.045714 run patchelf(pid=25356): Launched 04:33:02.234969 run osmo-stp_10.42.42.5(pid=25352): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25352)] 04:33:02.368245 run osmo-stp_10.42.42.5(pid=25352): stdout: | (launched: 2022-12-09_04:33:00.748670) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:33:02.502426 run osmo-stp_10.42.42.5(pid=25352): stderr: | 20221209043300916 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043300916 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043300917 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043300917 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043300918 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043300918 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043300918 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:33:02.636691 run osmo-stp_10.42.42.5(pid=25352): stdout: | (launched: 2022-12-09_04:33:00.748670) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:33:02.765567 run osmo-stp_10.42.42.5(pid=25352): stderr: | 20221209043300916 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043300916 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043300917 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043300917 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043300918 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043300918 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043300918 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:33:02.917285 run patchelf(pid=25356): Terminating (SIGINT) 04:33:03.093281 run patchelf(pid=25356): Terminated: ok {rc=0} 04:33:03.219883 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=25352): Process ended prematurely: osmo-stp_10.42.42.5(pid=25352) [trial-2354↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25352)] [trial-2354↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22] 04:33:03.229472 tst ping.py:22: Test FAILED (6.6 sec) 04:33:03.258364 run osmo-hlr_10.42.42.2(pid=25349): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25349)] 04:33:03.309815 run osmo-hlr_10.42.42.2(pid=25349): stdout: | (launched: 2022-12-09_04:32:59.853364) 04:33:03.362892 run osmo-hlr_10.42.42.2(pid=25349): stderr: | 20221209043300027 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209043300027 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209043300027 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209043300027 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209043300027 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209043300027 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209043300040 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209043300050 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209043300050 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209043300050 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:33:03.416510 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25348): Terminating (SIGTERM) 04:33:03.459313 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25351): Terminating (SIGTERM) 04:33:03.502149 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25355): Terminating (SIGTERM) 04:33:03.545235 --- ParallelTerminationStrategy: PID 25348 died... 04:33:03.565519 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25348): Terminated: ok {rc=0} 04:33:03.613120 --- ParallelTerminationStrategy: PID 25351 died... 04:33:03.633107 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25351): Terminated: ok {rc=0} 04:33:03.680479 --- ParallelTerminationStrategy: PID 25355 died... 04:33:03.700412 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25355): Terminated: ok {rc=0} 04:33:03.790727 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 04:33:04.878909 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:33:04.890474 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:33:04.937656 tst ping_idle_ping.py: using LAC 19095 04:33:05.053127 tst ping_idle_ping.py: using RAC 225 04:33:05.168373 tst ping_idle_ping.py: using CellId 19095 04:33:05.281815 tst ping_idle_ping.py: using BVCI 19096 04:33:05.386791 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:33:05.397822 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:33:05.408442 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:33:05.419155 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:33:05.429775 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:33:05.440386 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:33:05.451192 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:33:05.461858 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:33:05.576810 tst ping_idle_ping.py:24: start network... 04:33:05.784326 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:33:06.266689 run create_hlr_db(pid=25357): Launched 04:33:06.386235 bus /gobi_6: Setting Powered False 04:33:07.448390 run create_hlr_db(pid=25357): Terminated: ok {rc=0} 04:33:07.881233 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25359): Launched 04:33:08.190690 run osmo-hlr_10.42.42.2(pid=25360): Launched 04:33:08.309682 run osmo-stp_10.42.42.5: Starting osmo-stp 04:33:08.845553 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25362): Launched 04:33:09.155765 run osmo-stp_10.42.42.5(pid=25363): Launched 04:33:09.274700 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:33:09.808271 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25365): Launched 04:33:09.927604 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:33:10.189875 run patchelf(pid=25366): Launched 04:33:10.363023 run osmo-stp_10.42.42.5(pid=25363): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25363)] 04:33:10.495116 run osmo-stp_10.42.42.5(pid=25363): stdout: | (launched: 2022-12-09_04:33:09.099150) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:33:10.628703 run osmo-stp_10.42.42.5(pid=25363): stderr: | 20221209043309289 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043309289 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043309289 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043309290 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043309290 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043309290 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043309290 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:33:10.762249 run osmo-stp_10.42.42.5(pid=25363): stdout: | (launched: 2022-12-09_04:33:09.099150) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:33:10.890346 run osmo-stp_10.42.42.5(pid=25363): stderr: | 20221209043309289 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043309289 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043309289 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043309290 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043309290 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043309290 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043309290 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:33:11.042318 run patchelf(pid=25366): Terminating (SIGINT) 04:33:11.217672 run patchelf(pid=25366): Terminated: ok {rc=0} 04:33:11.343585 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=25363): Process ended prematurely: osmo-stp_10.42.42.5(pid=25363) [trial-2354↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25363)] [trial-2354↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27] 04:33:11.353126 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 04:33:11.381576 run osmo-hlr_10.42.42.2(pid=25360): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25360)] 04:33:11.431672 run osmo-hlr_10.42.42.2(pid=25360): stdout: | (launched: 2022-12-09_04:33:08.134422) 04:33:11.483749 run osmo-hlr_10.42.42.2(pid=25360): stderr: | 20221209043308327 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209043308327 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209043308327 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209043308327 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209043308327 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209043308327 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209043308339 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209043308348 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209043308348 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209043308348 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:33:11.536024 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25359): Terminating (SIGTERM) 04:33:11.577843 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25362): Terminating (SIGTERM) 04:33:11.619745 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25365): Terminating (SIGTERM) 04:33:11.661864 --- ParallelTerminationStrategy: PID 25359 died... 04:33:11.681606 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25359): Terminated: ok {rc=0} 04:33:11.728531 --- ParallelTerminationStrategy: PID 25362 died... 04:33:11.748051 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25362): Terminated: ok {rc=0} 04:33:11.794476 --- ParallelTerminationStrategy: PID 25365 died... 04:33:11.813923 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25365): Terminated: ok {rc=0} 04:33:11.902362 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2354 gprs:trx-lms-limenet-micro+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa --------------------------------------------------------------------- 04:33:13.207110 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:33:13.214178 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 04:33:13.244239 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 04:33:13.283246 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 04:33:13.370746 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 04:33:13.400275 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 04:33:13.439224 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 04:33:14.040215 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2354 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 04:33:14.092920 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:33:14.104311 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:33:14.183514 tst cs_paging_gprs_active.py: using LAC 19096 04:33:14.310018 tst cs_paging_gprs_active.py: using RAC 226 04:33:14.433648 tst cs_paging_gprs_active.py: using CellId 19096 04:33:14.551211 tst cs_paging_gprs_active.py: using BVCI 19097 04:33:14.657734 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:33:14.668597 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:33:14.679310 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:33:14.690121 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:33:14.700735 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:33:14.711390 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:33:14.722202 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:33:14.732735 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:33:14.743542 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:33:14.858893 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:33:14.980139 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 04:33:15.194601 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:33:15.513727 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25370): Launched 04:33:15.789931 run iperf3-srv_10.42.42.10(pid=25371): Launched 04:33:15.910738 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 04:33:16.128472 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:33:16.461696 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25372): Launched 04:33:16.761724 run iperf3-srv_10.42.42.10(pid=25373): Launched 04:33:16.887818 tst cs_paging_gprs_active.py:38: start network... 04:33:17.106031 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:33:17.599946 run create_hlr_db(pid=25374): Launched 04:33:17.721168 bus /gobi_6: Setting Powered False 04:33:18.784557 run create_hlr_db(pid=25374): Terminated: ok {rc=0} 04:33:19.225524 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25376): Launched 04:33:19.541979 run osmo-hlr_10.42.42.2(pid=25377): Launched 04:33:19.663364 run osmo-stp_10.42.42.5: Starting osmo-stp 04:33:20.210438 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25379): Launched 04:33:20.527784 run osmo-stp_10.42.42.5(pid=25380): Launched 04:33:20.650027 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:33:21.198029 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25382): Launched 04:33:21.319545 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:33:21.587745 run patchelf(pid=25383): Launched 04:33:21.764354 run osmo-stp_10.42.42.5(pid=25380): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25380)] 04:33:21.899513 run osmo-stp_10.42.42.5(pid=25380): stdout: | (launched: 2022-12-09_04:33:20.470240) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:33:22.036298 run osmo-stp_10.42.42.5(pid=25380): stderr: | 20221209043320660 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043320660 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043320661 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043320661 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043320662 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043320662 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043320662 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:33:22.172798 run osmo-stp_10.42.42.5(pid=25380): stdout: | (launched: 2022-12-09_04:33:20.470240) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:33:22.303225 run osmo-stp_10.42.42.5(pid=25380): stderr: | 20221209043320660 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043320660 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043320661 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043320661 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043320662 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043320662 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043320662 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:33:22.457924 run patchelf(pid=25383): Terminating (SIGINT) 04:33:22.637126 run patchelf(pid=25383): Terminated: ok {rc=0} 04:33:22.766374 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=25380): Process ended prematurely: osmo-stp_10.42.42.5(pid=25380) [trial-2354↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25380)] [trial-2354↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 04:33:22.776441 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 04:33:22.805745 run osmo-hlr_10.42.42.2(pid=25377): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25377)] 04:33:22.856514 run osmo-hlr_10.42.42.2(pid=25377): stdout: | (launched: 2022-12-09_04:33:19.483739) 04:33:22.908880 run osmo-hlr_10.42.42.2(pid=25377): stderr: | 20221209043319681 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209043319681 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209043319681 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209043319681 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209043319681 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209043319681 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209043319693 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209043319702 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209043319702 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209043319702 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:33:22.961695 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25370): Terminating (SIGTERM) 04:33:23.003770 run iperf3-srv_10.42.42.10(pid=25371): Terminating (SIGTERM) 04:33:23.046376 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25372): Terminating (SIGTERM) 04:33:23.088777 run iperf3-srv_10.42.42.10(pid=25373): Terminating (SIGTERM) 04:33:23.130843 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25376): Terminating (SIGTERM) 04:33:23.173152 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25379): Terminating (SIGTERM) 04:33:23.215168 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25382): Terminating (SIGTERM) 04:33:23.257437 --- ParallelTerminationStrategy: PID 25370 died... 04:33:23.277588 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25370): Terminated: ok {rc=0} 04:33:23.324487 --- ParallelTerminationStrategy: PID 25371 died... 04:33:23.343822 run iperf3-srv_10.42.42.10(pid=25371): Terminated {rc=256} 04:33:23.390189 --- ParallelTerminationStrategy: PID 25372 died... 04:33:23.409687 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25372): Terminated: ok {rc=0} 04:33:23.455816 --- ParallelTerminationStrategy: PID 25373 died... 04:33:23.475292 run iperf3-srv_10.42.42.10(pid=25373): Terminated {rc=256} 04:33:23.521585 --- ParallelTerminationStrategy: PID 25376 died... 04:33:23.540997 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25376): Terminated: ok {rc=0} 04:33:23.587423 --- ParallelTerminationStrategy: PID 25379 died... 04:33:23.607010 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25379): Terminated: ok {rc=0} 04:33:23.653423 --- ParallelTerminationStrategy: PID 25382 died... 04:33:23.672909 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25382): Terminated: ok {rc=0} 04:33:23.761969 bus /gobi_0: Setting Powered False 04:33:24.861177 bus /gobi_0: Setting Powered False 04:33:25.979444 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 04:33:27.129056 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:33:27.141450 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:33:27.211127 tst iperf3.py: using LAC 19097 04:33:27.336342 tst iperf3.py: using RAC 227 04:33:27.461290 tst iperf3.py: using CellId 19097 04:33:27.589182 tst iperf3.py: using BVCI 19098 04:33:27.698984 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:33:27.710028 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:33:27.721044 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:33:27.732299 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:33:27.743453 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:33:27.754804 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:33:27.766575 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:33:27.778016 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:33:27.789720 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:33:27.907741 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 04:33:28.121861 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:33:28.439213 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25384): Launched 04:33:28.715469 run iperf3-srv_10.42.42.10(pid=25385): Launched 04:33:28.834660 tst iperf3.py:8: start network... 04:33:29.048056 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:33:29.537414 run create_hlr_db(pid=25386): Launched 04:33:29.658544 bus /gobi_6: Setting Powered False 04:33:30.721583 run create_hlr_db(pid=25386): Terminated: ok {rc=0} 04:33:31.184144 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25388): Launched 04:33:31.582921 run osmo-hlr_10.42.42.2(pid=25389): Launched 04:33:31.739774 run osmo-stp_10.42.42.5: Starting osmo-stp 04:33:32.483160 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25391): Launched 04:33:32.778240 run osmo-stp_10.42.42.5(pid=25392): Launched 04:33:32.890846 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:33:33.399256 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25394): Launched 04:33:33.512123 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:33:33.761498 run patchelf(pid=25395): Launched 04:33:33.925510 run osmo-stp_10.42.42.5(pid=25392): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25392)] 04:33:34.050798 run osmo-stp_10.42.42.5(pid=25392): stdout: | (launched: 2022-12-09_04:33:32.724101) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:33:34.177743 run osmo-stp_10.42.42.5(pid=25392): stderr: | 20221209043332892 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043332892 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043332892 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043332892 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043332893 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043332893 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043332893 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:33:34.304488 run osmo-stp_10.42.42.5(pid=25392): stdout: | (launched: 2022-12-09_04:33:32.724101) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:33:34.425759 run osmo-stp_10.42.42.5(pid=25392): stderr: | 20221209043332892 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043332892 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043332892 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043332892 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043332893 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043332893 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043332893 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:33:34.569296 run patchelf(pid=25395): Terminating (SIGINT) 04:33:34.736173 run patchelf(pid=25395): Terminated: ok {rc=0} 04:33:34.856652 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25392): Process ended prematurely: osmo-stp_10.42.42.5(pid=25392) [trial-2354↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25392)] [trial-2354↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8] 04:33:34.866144 tst iperf3.py:8: Test FAILED (7.8 sec) 04:33:34.893265 run osmo-hlr_10.42.42.2(pid=25389): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25389)] 04:33:34.940825 run osmo-hlr_10.42.42.2(pid=25389): stdout: | (launched: 2022-12-09_04:33:31.519710) 04:33:34.990101 run osmo-hlr_10.42.42.2(pid=25389): stderr: | 20221209043331887 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209043331887 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209043331887 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209043331888 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209043331888 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209043331888 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209043331916 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209043331924 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209043331924 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209043331933 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:33:35.040073 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25384): Terminating (SIGTERM) 04:33:35.079930 run iperf3-srv_10.42.42.10(pid=25385): Terminating (SIGTERM) 04:33:35.119569 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25388): Terminating (SIGTERM) 04:33:35.159027 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25391): Terminating (SIGTERM) 04:33:35.198959 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25394): Terminating (SIGTERM) 04:33:35.238651 --- ParallelTerminationStrategy: PID 25384 died... 04:33:35.257664 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25384): Terminated: ok {rc=0} 04:33:35.301931 --- ParallelTerminationStrategy: PID 25385 died... 04:33:35.320508 run iperf3-srv_10.42.42.10(pid=25385): Terminated {rc=256} 04:33:35.364435 --- ParallelTerminationStrategy: PID 25388 died... 04:33:35.383178 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25388): Terminated: ok {rc=0} 04:33:35.426725 --- ParallelTerminationStrategy: PID 25391 died... 04:33:35.445380 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25391): Terminated: ok {rc=0} 04:33:35.489289 --- ParallelTerminationStrategy: PID 25394 died... 04:33:35.507916 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25394): Terminated: ok {rc=0} 04:33:35.593288 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 04:33:36.739199 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:33:36.750768 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:33:36.817300 tst iperf3m4.py: using LAC 19098 04:33:36.932827 tst iperf3m4.py: using RAC 228 04:33:37.048567 tst iperf3m4.py: using CellId 19098 04:33:37.164573 tst iperf3m4.py: using BVCI 19099 04:33:37.270630 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:33:37.281570 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:33:37.292273 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:33:37.302988 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:33:37.313650 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:33:37.324222 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:33:37.334968 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:33:37.345654 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:33:37.356591 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:33:37.469567 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:33:37.590162 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:33:37.705411 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:33:37.822455 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 04:33:38.036731 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:33:38.354012 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25396): Launched 04:33:38.629521 run iperf3-srv_10.42.42.10(pid=25397): Launched 04:33:38.749021 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 04:33:38.961653 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:33:39.279077 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25398): Launched 04:33:39.555219 run iperf3-srv_10.42.42.10(pid=25399): Launched 04:33:39.674295 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 04:33:39.886484 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:33:40.203937 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25400): Launched 04:33:40.479553 run iperf3-srv_10.42.42.10(pid=25401): Launched 04:33:40.598573 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 04:33:40.810718 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:33:41.128032 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25402): Launched 04:33:41.403363 run iperf3-srv_10.42.42.10(pid=25403): Launched 04:33:41.522532 tst iperf3m4.py:8: start network... 04:33:41.734637 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:33:42.224021 run create_hlr_db(pid=25404): Launched 04:33:42.344898 bus /gobi_6: Setting Powered False 04:33:43.408213 run create_hlr_db(pid=25404): Terminated: ok {rc=0} 04:33:43.848276 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25406): Launched 04:33:44.164372 run osmo-hlr_10.42.42.2(pid=25407): Launched 04:33:44.286124 run osmo-stp_10.42.42.5: Starting osmo-stp 04:33:44.833708 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25409): Launched 04:33:45.151265 run osmo-stp_10.42.42.5(pid=25410): Launched 04:33:45.272443 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:33:45.815408 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25412): Launched 04:33:45.964309 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:33:46.261923 run patchelf(pid=25413): Launched 04:33:46.432190 run osmo-stp_10.42.42.5(pid=25410): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25410)] 04:33:46.561830 run osmo-stp_10.42.42.5(pid=25410): stdout: | (launched: 2022-12-09_04:33:45.093542) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:33:46.694664 run osmo-stp_10.42.42.5(pid=25410): stderr: | 20221209043345282 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043345282 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043345283 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043345283 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043345283 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043345283 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043345284 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:33:46.825730 run osmo-stp_10.42.42.5(pid=25410): stdout: | (launched: 2022-12-09_04:33:45.093542) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:33:46.950092 run osmo-stp_10.42.42.5(pid=25410): stderr: | 20221209043345282 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043345282 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043345283 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043345283 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043345283 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043345283 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043345284 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:33:47.099267 run patchelf(pid=25413): Terminating (SIGINT) 04:33:47.272925 run patchelf(pid=25413): Terminated: ok {rc=0} 04:33:47.394128 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25410): Process ended prematurely: osmo-stp_10.42.42.5(pid=25410) [trial-2354↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25410)] [trial-2354↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8] 04:33:47.403730 tst iperf3m4.py:8: Test FAILED (10.7 sec) 04:33:47.431307 run osmo-hlr_10.42.42.2(pid=25407): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25407)] 04:33:47.479368 run osmo-hlr_10.42.42.2(pid=25407): stdout: | (launched: 2022-12-09_04:33:44.106822) 04:33:47.529158 run osmo-hlr_10.42.42.2(pid=25407): stderr: | 20221209043344303 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209043344303 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209043344303 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209043344303 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209043344303 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209043344303 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209043344316 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209043344324 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209043344324 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209043344324 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:33:47.579052 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25396): Terminating (SIGTERM) 04:33:47.618620 run iperf3-srv_10.42.42.10(pid=25397): Terminating (SIGTERM) 04:33:47.658243 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25398): Terminating (SIGTERM) 04:33:47.697776 run iperf3-srv_10.42.42.10(pid=25399): Terminating (SIGTERM) 04:33:47.737065 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25400): Terminating (SIGTERM) 04:33:47.776369 run iperf3-srv_10.42.42.10(pid=25401): Terminating (SIGTERM) 04:33:47.815604 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25402): Terminating (SIGTERM) 04:33:47.854915 run iperf3-srv_10.42.42.10(pid=25403): Terminating (SIGTERM) 04:33:47.894385 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25406): Terminating (SIGTERM) 04:33:47.933775 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25409): Terminating (SIGTERM) 04:33:47.973172 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25412): Terminating (SIGTERM) 04:33:48.012657 --- ParallelTerminationStrategy: PID 25396 died... 04:33:48.031618 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25396): Terminated: ok {rc=0} 04:33:48.076014 --- ParallelTerminationStrategy: PID 25397 died... 04:33:48.094782 run iperf3-srv_10.42.42.10(pid=25397): Terminated {rc=256} 04:33:48.139067 --- ParallelTerminationStrategy: PID 25398 died... 04:33:48.158028 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25398): Terminated: ok {rc=0} 04:33:48.202313 --- ParallelTerminationStrategy: PID 25399 died... 04:33:48.220696 run iperf3-srv_10.42.42.10(pid=25399): Terminated {rc=256} 04:33:48.264520 --- ParallelTerminationStrategy: PID 25400 died... 04:33:48.283196 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25400): Terminated: ok {rc=0} 04:33:48.327254 --- ParallelTerminationStrategy: PID 25401 died... 04:33:48.345962 run iperf3-srv_10.42.42.10(pid=25401): Terminated {rc=256} 04:33:48.390531 --- ParallelTerminationStrategy: PID 25402 died... 04:33:48.409467 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25402): Terminated: ok {rc=0} 04:33:48.453770 --- ParallelTerminationStrategy: PID 25403 died... 04:33:48.472486 run iperf3-srv_10.42.42.10(pid=25403): Terminated {rc=256} 04:33:48.516529 --- ParallelTerminationStrategy: PID 25406 died... 04:33:48.535299 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25406): Terminated: ok {rc=0} 04:33:48.579508 --- ParallelTerminationStrategy: PID 25409 died... 04:33:48.598191 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25409): Terminated: ok {rc=0} 04:33:48.642374 --- ParallelTerminationStrategy: PID 25412 died... 04:33:48.661224 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25412): Terminated: ok {rc=0} 04:33:48.746527 bus /gobi_4: Setting Powered False 04:33:49.846869 bus /gobi_4: Setting Powered False 04:33:50.963292 bus /gobi_1: Setting Powered False 04:33:52.063658 bus /gobi_1: Setting Powered False 04:33:53.179091 bus /gobi_0: Setting Powered False 04:33:54.274332 bus /gobi_0: Setting Powered False 04:33:55.389358 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 04:33:56.492390 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:33:56.504160 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:33:56.570387 tst ping.py: using LAC 19099 04:33:56.685125 tst ping.py: using RAC 229 04:33:56.799762 tst ping.py: using CellId 19099 04:33:56.915847 tst ping.py: using BVCI 19100 04:33:57.022908 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:33:57.033905 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:33:57.044496 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:33:57.055949 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:33:57.067130 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:33:57.078393 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:33:57.089682 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:33:57.100900 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:33:57.219562 tst ping.py:19: start network... 04:33:57.428205 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:33:57.908259 run create_hlr_db(pid=25416): Launched 04:33:58.026593 bus /gobi_6: Setting Powered False 04:33:59.088272 run create_hlr_db(pid=25416): Terminated: ok {rc=0} 04:33:59.503811 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25418): Launched 04:33:59.794243 run osmo-hlr_10.42.42.2(pid=25419): Launched 04:33:59.903763 run osmo-stp_10.42.42.5: Starting osmo-stp 04:34:00.417876 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25421): Launched 04:34:00.704307 run osmo-stp_10.42.42.5(pid=25422): Launched 04:34:00.813152 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:34:01.443111 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25424): Launched 04:34:01.611463 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:34:01.962728 run patchelf(pid=25425): Launched 04:34:02.131594 run osmo-stp_10.42.42.5(pid=25422): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25422)] 04:34:02.256530 run osmo-stp_10.42.42.5(pid=25422): stdout: | (launched: 2022-12-09_04:34:00.651376) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:34:02.382490 run osmo-stp_10.42.42.5(pid=25422): stderr: | 20221209043400820 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043400820 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043400820 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043400821 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043400821 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043400821 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043400821 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:34:02.507359 run osmo-stp_10.42.42.5(pid=25422): stdout: | (launched: 2022-12-09_04:34:00.651376) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:34:02.626560 run osmo-stp_10.42.42.5(pid=25422): stderr: | 20221209043400820 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043400820 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043400820 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043400821 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043400821 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043400821 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043400821 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:34:02.767741 run patchelf(pid=25425): Terminating (SIGINT) 04:34:02.931425 run patchelf(pid=25425): Terminated: ok {rc=0} 04:34:03.049499 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=25422): Process ended prematurely: osmo-stp_10.42.42.5(pid=25422) [trial-2354↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25422)] [trial-2354↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22] 04:34:03.058439 tst ping.py:22: Test FAILED (6.6 sec) 04:34:03.085232 run osmo-hlr_10.42.42.2(pid=25419): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25419)] 04:34:03.132918 run osmo-hlr_10.42.42.2(pid=25419): stdout: | (launched: 2022-12-09_04:33:59.740912) 04:34:03.182339 run osmo-hlr_10.42.42.2(pid=25419): stderr: | 20221209043359913 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209043359913 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209043359913 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209043359913 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209043359913 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209043359913 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209043359926 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209043359935 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209043359935 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209043359935 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:34:03.232017 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25418): Terminating (SIGTERM) 04:34:03.271479 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25421): Terminating (SIGTERM) 04:34:03.310840 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25424): Terminating (SIGTERM) 04:34:03.350529 --- ParallelTerminationStrategy: PID 25418 died... 04:34:03.369567 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25418): Terminated: ok {rc=0} 04:34:03.413296 --- ParallelTerminationStrategy: PID 25421 died... 04:34:03.431653 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25421): Terminated: ok {rc=0} 04:34:03.475989 --- ParallelTerminationStrategy: PID 25424 died... 04:34:03.494548 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25424): Terminated: ok {rc=0} 04:34:03.580386 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 04:34:04.669938 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:34:04.681866 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:34:04.748861 tst ping_idle_ping.py: using LAC 19100 04:34:04.864036 tst ping_idle_ping.py: using RAC 230 04:34:04.978776 tst ping_idle_ping.py: using CellId 19100 04:34:05.092572 tst ping_idle_ping.py: using BVCI 19101 04:34:05.197590 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:34:05.208409 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:34:05.219022 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:34:05.229709 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:34:05.240305 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:34:05.250960 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:34:05.261766 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:34:05.272346 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:34:05.391587 tst ping_idle_ping.py:24: start network... 04:34:05.599834 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:34:06.083278 run create_hlr_db(pid=25426): Launched 04:34:06.202708 bus /gobi_6: Setting Powered False 04:34:07.265296 run create_hlr_db(pid=25426): Terminated: ok {rc=0} 04:34:07.682437 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25428): Launched 04:34:07.974112 run osmo-hlr_10.42.42.2(pid=25429): Launched 04:34:08.085233 run osmo-stp_10.42.42.5: Starting osmo-stp 04:34:08.583920 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25431): Launched 04:34:08.873415 run osmo-stp_10.42.42.5(pid=25432): Launched 04:34:08.984469 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:34:09.485253 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25434): Launched 04:34:09.596865 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:34:09.842725 run patchelf(pid=25435): Launched 04:34:10.004894 run osmo-stp_10.42.42.5(pid=25432): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25432)] 04:34:10.128229 run osmo-stp_10.42.42.5(pid=25432): stdout: | (launched: 2022-12-09_04:34:08.820304) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:34:10.252696 run osmo-stp_10.42.42.5(pid=25432): stderr: | 20221209043408988 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043408988 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043408988 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043408989 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043408989 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043408989 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043408989 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:34:10.377309 run osmo-stp_10.42.42.5(pid=25432): stdout: | (launched: 2022-12-09_04:34:08.820304) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:34:10.496725 run osmo-stp_10.42.42.5(pid=25432): stderr: | 20221209043408988 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043408988 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043408988 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043408989 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043408989 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043408989 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043408989 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:34:10.637741 run patchelf(pid=25435): Terminating (SIGINT) 04:34:10.801891 run patchelf(pid=25435): Terminated: ok {rc=0} 04:34:10.920070 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=25432): Process ended prematurely: osmo-stp_10.42.42.5(pid=25432) [trial-2354↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25432)] [trial-2354↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 04:34:10.928890 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 04:34:10.955504 run osmo-hlr_10.42.42.2(pid=25429): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25429)] 04:34:11.002575 run osmo-hlr_10.42.42.2(pid=25429): stdout: | (launched: 2022-12-09_04:34:07.920825) 04:34:11.051575 run osmo-hlr_10.42.42.2(pid=25429): stderr: | 20221209043408093 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209043408093 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209043408093 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209043408093 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209043408093 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209043408093 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209043408109 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209043408119 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209043408119 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209043408119 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:34:11.101213 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25428): Terminating (SIGTERM) 04:34:11.141080 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25431): Terminating (SIGTERM) 04:34:11.180343 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25434): Terminating (SIGTERM) 04:34:11.219904 --- ParallelTerminationStrategy: PID 25428 died... 04:34:11.238814 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25428): Terminated: ok {rc=0} 04:34:11.282802 --- ParallelTerminationStrategy: PID 25431 died... 04:34:11.301353 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25431): Terminated: ok {rc=0} 04:34:11.345140 --- ParallelTerminationStrategy: PID 25434 died... 04:34:11.363560 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25434): Terminated: ok {rc=0} 04:34:11.449964 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2354 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 04:34:12.749593 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:34:12.755826 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 04:34:12.784699 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 04:34:12.822871 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 04:34:12.907899 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 04:34:12.936366 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 04:34:12.974254 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 04:34:13.573662 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2354 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 04:34:13.622952 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:34:13.633990 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:34:13.697993 tst cs_paging_gprs_active.py: using LAC 19101 04:34:13.812583 tst cs_paging_gprs_active.py: using RAC 231 04:34:13.927137 tst cs_paging_gprs_active.py: using CellId 19101 04:34:14.041669 tst cs_paging_gprs_active.py: using BVCI 19102 04:34:14.148366 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:34:14.159275 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:34:14.170066 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:34:14.180645 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:34:14.191342 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:34:14.201993 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:34:14.212686 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:34:14.223434 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:34:14.234227 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:34:14.351746 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:34:14.470766 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 04:34:14.686131 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:34:15.004742 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25439): Launched 04:34:15.281691 run iperf3-srv_10.42.42.10(pid=25440): Launched 04:34:15.401586 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 04:34:15.615811 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:34:15.952678 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25441): Launched 04:34:16.266666 run iperf3-srv_10.42.42.10(pid=25442): Launched 04:34:16.399125 tst cs_paging_gprs_active.py:38: start network... 04:34:16.617694 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:34:17.127154 run create_hlr_db(pid=25443): Launched 04:34:17.251563 bus /gobi_6: Setting Powered False 04:34:18.311132 run create_hlr_db(pid=25443): Terminated: ok {rc=0} 04:34:18.723972 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25445): Launched 04:34:19.019631 run osmo-hlr_10.42.42.2(pid=25446): Launched 04:34:19.132561 run osmo-stp_10.42.42.5: Starting osmo-stp 04:34:19.653977 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25448): Launched 04:34:19.950274 run osmo-stp_10.42.42.5(pid=25449): Launched 04:34:20.062447 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:34:20.571977 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25451): Launched 04:34:20.694991 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:34:20.969843 run patchelf(pid=25452): Launched 04:34:21.149133 run osmo-stp_10.42.42.5(pid=25449): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25449)] 04:34:21.284787 run osmo-stp_10.42.42.5(pid=25449): stdout: | (launched: 2022-12-09_04:34:19.895904) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:34:21.422248 run osmo-stp_10.42.42.5(pid=25449): stderr: | 20221209043420064 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043420064 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043420064 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043420064 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043420065 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043420065 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043420065 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:34:21.559504 run osmo-stp_10.42.42.5(pid=25449): stdout: | (launched: 2022-12-09_04:34:19.895904) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:34:21.691242 run osmo-stp_10.42.42.5(pid=25449): stderr: | 20221209043420064 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043420064 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043420064 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043420064 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043420065 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043420065 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043420065 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:34:21.847257 run patchelf(pid=25452): Terminating (SIGINT) 04:34:22.027569 run patchelf(pid=25452): Terminated: ok {rc=0} 04:34:22.158468 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=25449): Process ended prematurely: osmo-stp_10.42.42.5(pid=25449) [trial-2354↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25449)] [trial-2354↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 04:34:22.168776 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 04:34:22.198686 run osmo-hlr_10.42.42.2(pid=25446): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25446)] 04:34:22.250083 run osmo-hlr_10.42.42.2(pid=25446): stdout: | (launched: 2022-12-09_04:34:18.965700) 04:34:22.303062 run osmo-hlr_10.42.42.2(pid=25446): stderr: | 20221209043419143 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209043419143 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209043419143 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209043419143 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209043419143 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209043419143 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209043419156 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209043419164 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209043419164 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209043419164 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:34:22.356397 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25439): Terminating (SIGTERM) 04:34:22.399265 run iperf3-srv_10.42.42.10(pid=25440): Terminating (SIGTERM) 04:34:22.441983 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25441): Terminating (SIGTERM) 04:34:22.484935 run iperf3-srv_10.42.42.10(pid=25442): Terminating (SIGTERM) 04:34:22.527614 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25445): Terminating (SIGTERM) 04:34:22.570373 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25448): Terminating (SIGTERM) 04:34:22.613333 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25451): Terminating (SIGTERM) 04:34:22.656396 --- ParallelTerminationStrategy: PID 25439 died... 04:34:22.676633 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25439): Terminated: ok {rc=0} 04:34:22.724118 --- ParallelTerminationStrategy: PID 25440 died... 04:34:22.743902 run iperf3-srv_10.42.42.10(pid=25440): Terminated {rc=256} 04:34:22.790871 --- ParallelTerminationStrategy: PID 25441 died... 04:34:22.810707 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25441): Terminated: ok {rc=0} 04:34:22.857871 --- ParallelTerminationStrategy: PID 25442 died... 04:34:22.877764 run iperf3-srv_10.42.42.10(pid=25442): Terminated {rc=256} 04:34:22.924920 --- ParallelTerminationStrategy: PID 25445 died... 04:34:22.945176 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25445): Terminated: ok {rc=0} 04:34:22.992479 --- ParallelTerminationStrategy: PID 25448 died... 04:34:23.012404 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25448): Terminated: ok {rc=0} 04:34:23.060135 --- ParallelTerminationStrategy: PID 25451 died... 04:34:23.079830 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25451): Terminated: ok {rc=0} 04:34:23.169731 bus /gobi_0: Setting Powered False 04:34:24.269662 bus /gobi_0: Setting Powered False 04:34:25.387165 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 04:34:26.535888 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:34:26.548026 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:34:26.617293 tst iperf3.py: using LAC 19102 04:34:26.742404 tst iperf3.py: using RAC 232 04:34:26.867345 tst iperf3.py: using CellId 19102 04:34:26.991095 tst iperf3.py: using BVCI 19103 04:34:27.106941 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:34:27.118597 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:34:27.129857 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:34:27.142069 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:34:27.153928 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:34:27.165702 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:34:27.178076 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:34:27.189931 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:34:27.202022 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:34:27.317129 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 04:34:27.513788 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:34:27.809881 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25453): Launched 04:34:28.067324 run iperf3-srv_10.42.42.10(pid=25454): Launched 04:34:28.178211 tst iperf3.py:8: start network... 04:34:28.374363 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:34:28.830555 run create_hlr_db(pid=25455): Launched 04:34:28.952830 bus /gobi_6: Setting Powered False 04:34:30.012125 run create_hlr_db(pid=25455): Terminated: ok {rc=0} 04:34:30.448017 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25457): Launched 04:34:30.765450 run osmo-hlr_10.42.42.2(pid=25458): Launched 04:34:30.915443 run osmo-stp_10.42.42.5: Starting osmo-stp 04:34:31.663686 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25460): Launched 04:34:31.989336 run osmo-stp_10.42.42.5(pid=25461): Launched 04:34:32.301616 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:34:32.852836 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25463): Launched 04:34:32.974871 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:34:33.244238 run patchelf(pid=25464): Launched 04:34:33.421192 run osmo-stp_10.42.42.5(pid=25461): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25461)] 04:34:33.556189 run osmo-stp_10.42.42.5(pid=25461): stdout: | (launched: 2022-12-09_04:34:31.918748) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:34:33.692886 run osmo-stp_10.42.42.5(pid=25461): stderr: | 20221209043432151 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043432152 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043432153 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043432155 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043432155 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043432155 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043432155 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:34:33.830190 run osmo-stp_10.42.42.5(pid=25461): stdout: | (launched: 2022-12-09_04:34:31.918748) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:34:33.961160 run osmo-stp_10.42.42.5(pid=25461): stderr: | 20221209043432151 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043432152 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043432153 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043432155 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043432155 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043432155 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043432155 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:34:34.116764 run patchelf(pid=25464): Terminating (SIGINT) 04:34:34.295732 run patchelf(pid=25464): Terminated: ok {rc=0} 04:34:34.425264 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25461): Process ended prematurely: osmo-stp_10.42.42.5(pid=25461) [trial-2354↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25461)] [trial-2354↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8] 04:34:34.435650 tst iperf3.py:8: Test FAILED (7.9 sec) 04:34:34.465314 run osmo-hlr_10.42.42.2(pid=25458): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25458)] 04:34:34.516485 run osmo-hlr_10.42.42.2(pid=25458): stdout: | (launched: 2022-12-09_04:34:30.707951) 04:34:34.569440 run osmo-hlr_10.42.42.2(pid=25458): stderr: | 20221209043431012 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209043431012 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209043431012 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209043431012 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209043431012 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209043431012 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209043431027 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209043431043 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209043431043 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209043431043 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:34:34.622574 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25453): Terminating (SIGTERM) 04:34:34.665372 run iperf3-srv_10.42.42.10(pid=25454): Terminating (SIGTERM) 04:34:34.708084 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25457): Terminating (SIGTERM) 04:34:34.750810 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25460): Terminating (SIGTERM) 04:34:34.793436 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25463): Terminating (SIGTERM) 04:34:34.836236 --- ParallelTerminationStrategy: PID 25453 died... 04:34:34.856406 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25453): Terminated: ok {rc=0} 04:34:34.903551 --- ParallelTerminationStrategy: PID 25454 died... 04:34:34.923137 run iperf3-srv_10.42.42.10(pid=25454): Terminated {rc=256} 04:34:34.969775 --- ParallelTerminationStrategy: PID 25457 died... 04:34:34.989754 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25457): Terminated: ok {rc=0} 04:34:35.036295 --- ParallelTerminationStrategy: PID 25460 died... 04:34:35.056246 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25460): Terminated: ok {rc=0} 04:34:35.103094 --- ParallelTerminationStrategy: PID 25463 died... 04:34:35.122828 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25463): Terminated: ok {rc=0} 04:34:35.211842 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 04:34:36.362097 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:34:36.374285 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:34:36.442199 tst iperf3m4.py: using LAC 19103 04:34:36.567643 tst iperf3m4.py: using RAC 233 04:34:36.692194 tst iperf3m4.py: using CellId 19103 04:34:36.815871 tst iperf3m4.py: using BVCI 19104 04:34:36.930745 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:34:36.942122 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:34:36.953425 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:34:36.964727 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:34:36.976228 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:34:36.987587 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:34:36.999115 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:34:37.010489 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:34:37.022273 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:34:37.138397 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:34:37.254988 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:34:37.373337 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:34:37.491256 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 04:34:37.690786 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:34:37.989036 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25466): Launched 04:34:38.248797 run iperf3-srv_10.42.42.10(pid=25467): Launched 04:34:38.361392 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 04:34:38.558773 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:34:38.855439 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25468): Launched 04:34:39.113308 run iperf3-srv_10.42.42.10(pid=25469): Launched 04:34:39.224570 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 04:34:39.421616 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:34:39.717924 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25470): Launched 04:34:39.976616 run iperf3-srv_10.42.42.10(pid=25471): Launched 04:34:40.087841 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 04:34:40.284766 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:34:40.582227 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25472): Launched 04:34:40.840301 run iperf3-srv_10.42.42.10(pid=25473): Launched 04:34:40.951862 tst iperf3m4.py:8: start network... 04:34:41.148774 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:34:41.606612 run create_hlr_db(pid=25474): Launched 04:34:41.729463 bus /gobi_6: Setting Powered False 04:34:42.789293 run create_hlr_db(pid=25474): Terminated: ok {rc=0} 04:34:43.224515 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25476): Launched 04:34:43.542330 run osmo-hlr_10.42.42.2(pid=25477): Launched 04:34:43.664785 run osmo-stp_10.42.42.5: Starting osmo-stp 04:34:44.210752 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25479): Launched 04:34:44.529244 run osmo-stp_10.42.42.5(pid=25480): Launched 04:34:44.651023 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:34:45.199358 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25482): Launched 04:34:45.321886 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:34:45.590083 run patchelf(pid=25483): Launched 04:34:45.766959 run osmo-stp_10.42.42.5(pid=25480): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25480)] 04:34:45.930314 run osmo-stp_10.42.42.5(pid=25480): stdout: | (launched: 2022-12-09_04:34:44.470721) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:34:46.089299 run osmo-stp_10.42.42.5(pid=25480): stderr: | 20221209043444658 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043444658 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043444659 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043444659 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043444659 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043444660 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043444660 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:34:46.224846 run osmo-stp_10.42.42.5(pid=25480): stdout: | (launched: 2022-12-09_04:34:44.470721) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:34:46.394835 run osmo-stp_10.42.42.5(pid=25480): stderr: | 20221209043444658 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043444658 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043444659 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043444659 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043444659 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043444660 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043444660 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:34:46.577572 run patchelf(pid=25483): Terminating (SIGINT) 04:34:46.751298 run patchelf(pid=25483): Terminated: ok {rc=0} 04:34:46.876259 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25480): Process ended prematurely: osmo-stp_10.42.42.5(pid=25480) [trial-2354↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25480)] [trial-2354↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8] 04:34:46.887187 tst iperf3m4.py:8: Test FAILED (10.6 sec) 04:34:46.916409 run osmo-hlr_10.42.42.2(pid=25477): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25477)] 04:34:46.966523 run osmo-hlr_10.42.42.2(pid=25477): stdout: | (launched: 2022-12-09_04:34:43.484375) 04:34:47.018372 run osmo-hlr_10.42.42.2(pid=25477): stderr: | 20221209043443679 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209043443679 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209043443679 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209043443679 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209043443679 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209043443679 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209043443705 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209043443715 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209043443715 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209043443715 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:34:47.071496 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25466): Terminating (SIGTERM) 04:34:47.113601 run iperf3-srv_10.42.42.10(pid=25467): Terminating (SIGTERM) 04:34:47.158703 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25468): Terminating (SIGTERM) 04:34:47.201039 run iperf3-srv_10.42.42.10(pid=25469): Terminating (SIGTERM) 04:34:47.241560 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25470): Terminating (SIGTERM) 04:34:47.283451 run iperf3-srv_10.42.42.10(pid=25471): Terminating (SIGTERM) 04:34:47.323351 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25472): Terminating (SIGTERM) 04:34:47.363424 run iperf3-srv_10.42.42.10(pid=25473): Terminating (SIGTERM) 04:34:47.403509 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25476): Terminating (SIGTERM) 04:34:47.443329 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25479): Terminating (SIGTERM) 04:34:47.483559 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25482): Terminating (SIGTERM) 04:34:47.524009 --- ParallelTerminationStrategy: PID 25466 died... 04:34:47.543015 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25466): Terminated: ok {rc=0} 04:34:47.587583 --- ParallelTerminationStrategy: PID 25467 died... 04:34:47.606158 run iperf3-srv_10.42.42.10(pid=25467): Terminated {rc=256} 04:34:47.650301 --- ParallelTerminationStrategy: PID 25468 died... 04:34:47.669324 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25468): Terminated: ok {rc=0} 04:34:47.713437 --- ParallelTerminationStrategy: PID 25469 died... 04:34:47.732016 run iperf3-srv_10.42.42.10(pid=25469): Terminated {rc=256} 04:34:47.776820 --- ParallelTerminationStrategy: PID 25470 died... 04:34:47.796030 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25470): Terminated: ok {rc=0} 04:34:47.840884 --- ParallelTerminationStrategy: PID 25471 died... 04:34:47.860161 run iperf3-srv_10.42.42.10(pid=25471): Terminated {rc=256} 04:34:47.904231 --- ParallelTerminationStrategy: PID 25472 died... 04:34:47.923635 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25472): Terminated: ok {rc=0} 04:34:47.967900 --- ParallelTerminationStrategy: PID 25473 died... 04:34:47.986590 run iperf3-srv_10.42.42.10(pid=25473): Terminated {rc=256} 04:34:48.030491 --- ParallelTerminationStrategy: PID 25476 died... 04:34:48.049202 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25476): Terminated: ok {rc=0} 04:34:48.093287 --- ParallelTerminationStrategy: PID 25479 died... 04:34:48.111859 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25479): Terminated: ok {rc=0} 04:34:48.156150 --- ParallelTerminationStrategy: PID 25482 died... 04:34:48.175048 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25482): Terminated: ok {rc=0} 04:34:48.261818 bus /gobi_4: Setting Powered False 04:34:49.361936 bus /gobi_4: Setting Powered False 04:34:50.475049 bus /gobi_1: Setting Powered False 04:34:51.573272 bus /gobi_1: Setting Powered False 04:34:52.690859 bus /gobi_0: Setting Powered False 04:34:53.790310 bus /gobi_0: Setting Powered False 04:34:54.907502 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 04:34:56.010768 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:34:56.022863 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:34:56.090505 tst ping.py: using LAC 19104 04:34:56.212705 tst ping.py: using RAC 234 04:34:56.337314 tst ping.py: using CellId 19104 04:34:56.461050 tst ping.py: using BVCI 19105 04:34:56.574524 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:34:56.586103 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:34:56.597646 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:34:56.609147 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:34:56.620693 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:34:56.632292 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:34:56.644027 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:34:56.655392 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:34:56.774621 tst ping.py:19: start network... 04:34:56.983303 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:34:57.464488 run create_hlr_db(pid=25484): Launched 04:34:57.584129 bus /gobi_6: Setting Powered False 04:34:58.646778 run create_hlr_db(pid=25484): Terminated: ok {rc=0} 04:34:59.064170 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25486): Launched 04:34:59.355387 run osmo-hlr_10.42.42.2(pid=25487): Launched 04:34:59.466996 run osmo-stp_10.42.42.5: Starting osmo-stp 04:34:59.982054 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25489): Launched 04:35:00.274319 run osmo-stp_10.42.42.5(pid=25490): Launched 04:35:00.386273 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:35:00.896234 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25492): Launched 04:35:01.044012 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:35:01.329728 run patchelf(pid=25493): Launched 04:35:01.522076 run osmo-stp_10.42.42.5(pid=25490): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25490)] 04:35:01.660485 run osmo-stp_10.42.42.5(pid=25490): stdout: | (launched: 2022-12-09_04:35:00.220740) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:35:01.799958 run osmo-stp_10.42.42.5(pid=25490): stderr: | 20221209043500390 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043500390 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043500390 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043500391 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043500391 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043500391 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043500391 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:35:01.939012 run osmo-stp_10.42.42.5(pid=25490): stdout: | (launched: 2022-12-09_04:35:00.220740) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:35:02.073420 run osmo-stp_10.42.42.5(pid=25490): stderr: | 20221209043500390 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043500390 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043500390 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043500391 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043500391 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043500391 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043500391 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:35:02.231307 run patchelf(pid=25493): Terminating (SIGINT) 04:35:02.407506 run patchelf(pid=25493): Terminated: ok {rc=0} 04:35:02.534201 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=25490): Process ended prematurely: osmo-stp_10.42.42.5(pid=25490) [trial-2354↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25490)] [trial-2354↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22] 04:35:02.543896 tst ping.py:22: Test FAILED (6.5 sec) 04:35:02.573056 run osmo-hlr_10.42.42.2(pid=25487): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25487)] 04:35:02.623974 run osmo-hlr_10.42.42.2(pid=25487): stdout: | (launched: 2022-12-09_04:34:59.302206) 04:35:02.676552 run osmo-hlr_10.42.42.2(pid=25487): stderr: | 20221209043459476 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209043459476 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209043459476 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209043459476 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209043459477 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209043459477 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209043459489 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209043459497 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209043459498 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209043459498 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:35:02.729370 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25486): Terminating (SIGTERM) 04:35:02.771550 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25489): Terminating (SIGTERM) 04:35:02.813863 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25492): Terminating (SIGTERM) 04:35:02.856805 --- ParallelTerminationStrategy: PID 25486 died... 04:35:02.877132 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25486): Terminated: ok {rc=0} 04:35:02.924157 --- ParallelTerminationStrategy: PID 25489 died... 04:35:02.943957 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25489): Terminated: ok {rc=0} 04:35:02.990895 --- ParallelTerminationStrategy: PID 25492 died... 04:35:03.010598 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25492): Terminated: ok {rc=0} 04:35:03.099579 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 04:35:04.186900 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:35:04.199140 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:35:04.268572 tst ping_idle_ping.py: using LAC 19105 04:35:04.392128 tst ping_idle_ping.py: using RAC 235 04:35:04.514327 tst ping_idle_ping.py: using CellId 19105 04:35:04.637396 tst ping_idle_ping.py: using BVCI 19106 04:35:04.752756 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:35:04.764272 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:35:04.775594 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:35:04.787358 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:35:04.798808 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:35:04.810546 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:35:04.822321 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:35:04.834503 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:35:04.950149 tst ping_idle_ping.py:24: start network... 04:35:05.144414 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:35:05.596004 run create_hlr_db(pid=25497): Launched 04:35:05.716547 bus /gobi_6: Setting Powered False 04:35:06.776110 run create_hlr_db(pid=25497): Terminated: ok {rc=0} 04:35:07.182671 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25499): Launched 04:35:07.472748 run osmo-hlr_10.42.42.2(pid=25500): Launched 04:35:07.582958 run osmo-stp_10.42.42.5: Starting osmo-stp 04:35:08.081938 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25502): Launched 04:35:08.373543 run osmo-stp_10.42.42.5(pid=25503): Launched 04:35:08.484038 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:35:08.985500 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25505): Launched 04:35:09.097396 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:35:09.342699 run patchelf(pid=25506): Launched 04:35:09.504138 run osmo-stp_10.42.42.5(pid=25503): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25503)] 04:35:09.627296 run osmo-stp_10.42.42.5(pid=25503): stdout: | (launched: 2022-12-09_04:35:08.319246) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:35:09.752172 run osmo-stp_10.42.42.5(pid=25503): stderr: | 20221209043508487 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043508487 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043508488 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043508488 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043508489 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043508489 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043508489 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:35:09.877092 run osmo-stp_10.42.42.5(pid=25503): stdout: | (launched: 2022-12-09_04:35:08.319246) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:35:09.996282 run osmo-stp_10.42.42.5(pid=25503): stderr: | 20221209043508487 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043508487 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043508488 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043508488 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043508489 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043508489 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043508489 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:35:10.138053 run patchelf(pid=25506): Terminating (SIGINT) 04:35:10.302636 run patchelf(pid=25506): Terminated: ok {rc=0} 04:35:10.421319 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=25503): Process ended prematurely: osmo-stp_10.42.42.5(pid=25503) [trial-2354↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25503)] [trial-2354↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 04:35:10.430084 tst ping_idle_ping.py:27: Test FAILED (6.2 sec) 04:35:10.456848 run osmo-hlr_10.42.42.2(pid=25500): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25500)] 04:35:10.504416 run osmo-hlr_10.42.42.2(pid=25500): stdout: | (launched: 2022-12-09_04:35:07.418894) 04:35:10.553772 run osmo-hlr_10.42.42.2(pid=25500): stderr: | 20221209043507594 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209043507594 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209043507594 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209043507594 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209043507594 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209043507594 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209043507606 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209043507615 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209043507615 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209043507615 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:35:10.603599 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25499): Terminating (SIGTERM) 04:35:10.643303 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25502): Terminating (SIGTERM) 04:35:10.683360 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25505): Terminating (SIGTERM) 04:35:10.723326 --- ParallelTerminationStrategy: PID 25499 died... 04:35:10.742385 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25499): Terminated: ok {rc=0} 04:35:10.786023 --- ParallelTerminationStrategy: PID 25502 died... 04:35:10.804401 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25502): Terminated: ok {rc=0} 04:35:10.848136 --- ParallelTerminationStrategy: PID 25505 died... 04:35:10.866725 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25505): Terminated: ok {rc=0} 04:35:10.952007 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2354 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 04:35:12.251561 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:35:12.257861 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 04:35:12.286239 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 04:35:12.319798 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 04:35:12.374021 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 04:35:12.405934 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 04:35:12.441722 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 04:35:12.993936 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2354 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 04:35:13.000349 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:35:13.013154 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 04:35:13.082012 tst switch_tch_pdch.py: using LAC 19106 04:35:13.205038 tst switch_tch_pdch.py: using RAC 236 04:35:13.327648 tst switch_tch_pdch.py: using CellId 19106 04:35:13.450245 tst switch_tch_pdch.py: using BVCI 19107 04:35:13.563980 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:35:13.575832 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:35:13.587488 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:35:13.599942 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:35:13.611760 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:35:13.624439 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:35:13.636578 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:35:13.648522 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:35:13.763295 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:35:13.876171 tst switch_tch_pdch.py:51: start network... 04:35:14.068584 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:35:14.519283 run create_hlr_db(pid=25511): Launched 04:35:14.643408 bus /gobi_6: Setting Powered False 04:35:15.705635 run create_hlr_db(pid=25511): Terminated: ok {rc=0} 04:35:16.167180 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25513): Launched 04:35:16.489582 run osmo-hlr_10.42.42.2(pid=25514): Launched 04:35:16.698110 run osmo-stp_10.42.42.5: Starting osmo-stp 04:35:17.476151 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25516): Launched 04:35:17.767976 run osmo-stp_10.42.42.5(pid=25517): Launched 04:35:17.878700 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:35:18.378480 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25519): Launched 04:35:18.489160 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:35:18.733701 run patchelf(pid=25520): Launched 04:35:18.895493 run osmo-stp_10.42.42.5(pid=25517): ERR: Terminated: ERROR {rc=1} [trial-2354↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25517)] 04:35:19.018498 run osmo-stp_10.42.42.5(pid=25517): stdout: | (launched: 2022-12-09_04:35:17.714836) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:35:19.143527 run osmo-stp_10.42.42.5(pid=25517): stderr: | 20221209043517881 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043517882 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043517882 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043517882 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043517883 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043517883 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043517883 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:35:19.268411 run osmo-stp_10.42.42.5(pid=25517): stdout: | (launched: 2022-12-09_04:35:17.714836) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:35:19.388250 run osmo-stp_10.42.42.5(pid=25517): stderr: | 20221209043517881 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043517882 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043517882 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043517882 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043517883 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043517883 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043517883 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:35:19.529925 run patchelf(pid=25520): Terminating (SIGINT) 04:35:19.694426 run patchelf(pid=25520): Terminated: ok {rc=0} 04:35:19.812495 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=25517): Process ended prematurely: osmo-stp_10.42.42.5(pid=25517) [trial-2354↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25517)] [trial-2354↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 04:35:19.821437 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 04:35:19.847997 run osmo-hlr_10.42.42.2(pid=25514): ERR: Terminated: ERROR {rc=237} [trial-2354↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25514)] 04:35:19.895445 run osmo-hlr_10.42.42.2(pid=25514): stdout: | (launched: 2022-12-09_04:35:16.423981) 04:35:19.944872 run osmo-hlr_10.42.42.2(pid=25514): stderr: | 20221209043516749 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209043516749 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209043516750 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209043516750 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209043516750 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209043516750 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209043516781 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209043516802 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209043516802 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209043516803 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:35:19.994532 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25513): Terminating (SIGTERM) 04:35:20.033973 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25516): Terminating (SIGTERM) 04:35:20.073587 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25519): Terminating (SIGTERM) 04:35:20.113288 --- ParallelTerminationStrategy: PID 25513 died... 04:35:20.132206 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25513): Terminated: ok {rc=0} 04:35:20.176425 --- ParallelTerminationStrategy: PID 25516 died... 04:35:20.195372 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25516): Terminated: ok {rc=0} 04:35:20.239177 --- ParallelTerminationStrategy: PID 25519 died... 04:35:20.257819 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25519): Terminated: ok {rc=0} 04:35:20.343739 bus /gobi_0: Setting Powered False 04:35:21.443444 bus /gobi_0: Setting Powered False 04:35:22.559052 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2354 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 04:35:23.819311 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:35:23.825790 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 04:35:23.855791 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 04:35:23.890711 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 04:35:23.945060 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 04:35:23.975244 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 04:35:24.009855 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 04:35:24.565970 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2354 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 04:35:24.571158 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:35:24.582680 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 04:35:24.649384 tst switch_tch_pdch.py: using LAC 19107 04:35:24.773115 tst switch_tch_pdch.py: using RAC 237 04:35:24.892386 tst switch_tch_pdch.py: using CellId 19107 04:35:25.013791 tst switch_tch_pdch.py: using BVCI 19108 04:35:25.129586 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:35:25.141336 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:35:25.152691 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:35:25.164328 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:35:25.176340 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:35:25.188386 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:35:25.200304 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:35:25.212082 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 04:35:25.329498 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 04:35:25.443730 tst switch_tch_pdch.py:51: start network... 04:35:25.636088 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:35:26.059407 run create_hlr_db(pid=25524): Launched 04:35:26.179541 bus /gobi_6: Setting Powered False 04:35:27.240939 run create_hlr_db(pid=25524): Terminated: ok {rc=0} 04:35:27.634465 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25526): Launched 04:35:27.926664 run osmo-hlr_10.42.42.2(pid=25527): Launched 04:35:28.037801 run osmo-stp_10.42.42.5: Starting osmo-stp 04:35:28.527238 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25529): Launched 04:35:28.817639 run osmo-stp_10.42.42.5(pid=25530): Launched 04:35:28.928835 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:35:29.403713 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25532): Launched 04:35:29.514452 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:35:29.758385 run patchelf(pid=25533): Launched 04:35:29.919801 run osmo-stp_10.42.42.5(pid=25530): ERR: Terminated: ERROR {rc=1} [trial-2354↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25530)] 04:35:30.042591 run osmo-stp_10.42.42.5(pid=25530): stdout: | (launched: 2022-12-09_04:35:28.764273) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:35:30.167407 run osmo-stp_10.42.42.5(pid=25530): stderr: | 20221209043528931 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043528931 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043528932 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043528932 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043528933 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043528933 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043528933 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:35:30.292650 run osmo-stp_10.42.42.5(pid=25530): stdout: | (launched: 2022-12-09_04:35:28.764273) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:35:30.411886 run osmo-stp_10.42.42.5(pid=25530): stderr: | 20221209043528931 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043528931 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043528932 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043528932 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043528933 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043528933 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043528933 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:35:30.552668 run patchelf(pid=25533): Terminating (SIGINT) 04:35:30.716533 run patchelf(pid=25533): Terminated: ok {rc=0} 04:35:30.834422 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=25530): Process ended prematurely: osmo-stp_10.42.42.5(pid=25530) [trial-2354↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25530)] [trial-2354↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 04:35:30.854603 tst switch_tch_pdch.py:54: Test FAILED (6.3 sec) 04:35:30.894231 run osmo-hlr_10.42.42.2(pid=25527): ERR: Terminated: ERROR {rc=237} [trial-2354↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25527)] 04:35:30.947135 run osmo-hlr_10.42.42.2(pid=25527): stdout: | (launched: 2022-12-09_04:35:27.871819) 04:35:30.997512 run osmo-hlr_10.42.42.2(pid=25527): stderr: | 20221209043528047 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209043528047 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209043528047 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209043528047 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209043528047 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209043528047 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209043528061 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209043528070 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209043528071 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209043528071 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:35:31.048707 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25526): Terminating (SIGTERM) 04:35:31.089200 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25529): Terminating (SIGTERM) 04:35:31.130329 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25532): Terminating (SIGTERM) 04:35:31.172791 --- ParallelTerminationStrategy: PID 25526 died... 04:35:31.192230 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25526): Terminated: ok {rc=0} 04:35:31.236593 --- ParallelTerminationStrategy: PID 25529 died... 04:35:31.255709 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25529): Terminated: ok {rc=0} 04:35:31.300189 --- ParallelTerminationStrategy: PID 25532 died... 04:35:31.319247 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25532): Terminated: ok {rc=0} 04:35:31.406096 bus /gobi_0: Setting Powered False 04:35:32.501758 bus /gobi_0: Setting Powered False 04:35:33.617665 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2354 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 nitb_sms:nanobts --------------------------------------------------------------------- 04:35:34.873727 tst nitb_sms:nanobts: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:35:34.878460 tst nitb_sms:nanobts: Verifying 1 x bts (candidates: 11) 04:35:34.903403 tst nitb_sms:nanobts: Verifying 1 x ip_address (candidates: 9) 04:35:34.910263 tst nitb_sms:nanobts: Verifying 2 x modem (candidates: 12) 04:35:34.962294 tst nitb_sms:nanobts: Reserving 1 x bts (candidates: 11) 04:35:34.987934 tst nitb_sms:nanobts: Reserving 1 x ip_address (candidates: 9) 04:35:34.994615 tst nitb_sms:nanobts: Reserving 2 x modem (candidates: 12) 04:35:35.529561 tst nitb_sms:nanobts: RESERVED RESOURCES for nitb_sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 nitb_sms:nanobts mo_mt_sms.py ---------------------------------------------- 04:35:35.534708 tst nitb_sms:nanobts: Using 1 x ip_address (candidates: 1) 04:35:35.545469 tst nitb_sms:nanobts: Using 1 x bts (candidates: 1) 04:35:35.583912 tst mo_mt_sms.py: using LAC 19108 04:35:35.697467 tst mo_mt_sms.py: using RAC 238 04:35:35.813339 tst mo_mt_sms.py: using CellId 19108 04:35:35.929797 tst mo_mt_sms.py: using BVCI 19109 04:35:36.035119 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 04:35:36.149388 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 04:35:36.261974 tst mo_mt_sms.py:9: start nitb and bts... 04:35:36.455279 run osmo-nitb_10.42.42.2: Starting osmo-nitb 04:35:37.048275 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25537): Launched 04:35:37.338483 run osmo-nitb_10.42.42.2(pid=25538): Launched 04:35:37.499673 run osmo-nitb_10.42.42.2(pid=25538): ERR: Terminated: ERROR {rc=2} [trial-2354↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25538)] 04:35:37.630931 run osmo-nitb_10.42.42.2(pid=25538): stdout: | (launched: 2022-12-09_04:35:37.285530) 04:35:37.763486 run osmo-nitb_10.42.42.2(pid=25538): stderr: | (launched: 2022-12-09_04:35:37.328248) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:35:37.895792 run osmo-nitb_10.42.42.2(pid=25538): stdout: | (launched: 2022-12-09_04:35:37.285530) 04:35:38.022336 run osmo-nitb_10.42.42.2(pid=25538): stderr: | (launched: 2022-12-09_04:35:37.328248) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f4d467d3268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=25538): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25538) [trial-2354↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25538)] 04:35:38.448020 tst osmo-nitb_10.42.42.2(pid=25538): stdout: | (launched: 2022-12-09_04:35:37.285530) 04:35:38.565358 tst osmo-nitb_10.42.42.2(pid=25538): stderr: | (launched: 2022-12-09_04:35:37.328248) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:35:38.703155 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=25538): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25538) [trial-2354↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25538)] [trial-2354↪nitb_sms:nanobts↪mo_mt_sms.py:11] 04:35:38.711482 tst mo_mt_sms.py:11: Test FAILED (3.2 sec) 04:35:38.717922 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25537): Terminating (SIGTERM) 04:35:38.926025 --- ParallelTerminationStrategy: PID 25537 died... 04:35:38.946211 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25537): Terminated: ok {rc=0} 04:35:39.029872 bus /sierra_3: Setting Powered False 04:35:40.127726 bus /sierra_3: Setting Powered False 04:35:41.244368 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 nitb_sms:nanobts FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 sms:nanobts+band-1900 --------------------------------------------------------------------- 04:35:42.431110 tst sms:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:35:42.435704 tst sms:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 04:35:42.458957 tst sms:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 04:35:42.484683 tst sms:nanobts+band-1900: Verifying 2 x modem (candidates: 12) 04:35:42.536659 tst sms:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 04:35:42.560688 tst sms:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 04:35:42.586619 tst sms:nanobts+band-1900: Reserving 2 x modem (candidates: 12) 04:35:43.132477 tst sms:nanobts+band-1900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 sms:nanobts+band-1900 mo_mt_sms.py ---------------------------------------------- 04:35:43.137403 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 04:35:43.147861 tst sms:nanobts+band-1900: Using 1 x bts (candidates: 1) 04:35:43.185269 tst mo_mt_sms.py: using LAC 19109 04:35:43.298697 tst mo_mt_sms.py: using RAC 239 04:35:43.413113 tst mo_mt_sms.py: using CellId 19109 04:35:43.527115 tst mo_mt_sms.py: using BVCI 19110 04:35:43.642541 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 04:35:43.653670 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 04:35:43.664645 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 04:35:43.675847 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 04:35:43.686999 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 04:35:43.698093 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 04:35:43.812438 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 04:35:43.927317 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:35:44.377617 run create_hlr_db(pid=25542): Launched 04:35:44.497728 bus /sierra_2: Setting Powered False 04:35:45.556084 run create_hlr_db(pid=25542): Terminated: ok {rc=0} 04:35:45.999191 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25544): Launched 04:35:46.320192 run osmo-hlr_10.42.42.2(pid=25545): Launched 04:35:46.552864 run osmo-stp_10.42.42.5: Starting osmo-stp 04:35:47.203852 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25547): Launched 04:35:47.544906 run osmo-stp_10.42.42.5(pid=25548): Launched 04:35:47.666283 run osmo-msc_10.42.42.6: Starting osmo-msc 04:35:48.231534 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25550): Launched 04:35:48.536916 run osmo-msc_10.42.42.6(pid=25551): Launched 04:35:48.702474 run osmo-stp_10.42.42.5(pid=25548): ERR: Terminated: ERROR {rc=1} [trial-2354↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25548)] 04:35:48.827796 run osmo-stp_10.42.42.5(pid=25548): stdout: | (launched: 2022-12-09_04:35:47.488154) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:35:48.952364 run osmo-stp_10.42.42.5(pid=25548): stderr: | 20221209043547675 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043547675 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043547676 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043547676 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043547676 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043547677 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043547677 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:35:49.074665 run osmo-stp_10.42.42.5(pid=25548): stdout: | (launched: 2022-12-09_04:35:47.488154) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:35:49.190476 run osmo-stp_10.42.42.5(pid=25548): stderr: | 20221209043547675 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043547675 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043547676 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043547676 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043547676 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043547677 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043547677 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:35:49.328692 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=25548): Process ended prematurely: osmo-stp_10.42.42.5(pid=25548) [trial-2354↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25548)] [trial-2354↪sms:nanobts+band-1900↪mo_mt_sms.py:16] 04:35:49.336904 tst mo_mt_sms.py:16: Test FAILED (6.2 sec) 04:35:49.362610 run osmo-hlr_10.42.42.2(pid=25545): ERR: Terminated: ERROR {rc=237} [trial-2354↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25545)] 04:35:49.409825 run osmo-hlr_10.42.42.2(pid=25545): stdout: | (launched: 2022-12-09_04:35:46.258612) 04:35:49.458859 run osmo-hlr_10.42.42.2(pid=25545): stderr: | 20221209043546603 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209043546603 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209043546603 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209043546603 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209043546603 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209043546603 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209043546628 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/sms:nanobts+band-1900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209043546646 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209043546646 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209043546646 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:35:49.527166 run osmo-msc_10.42.42.6(pid=25551): ERR: Terminated: ERROR {rc=2} [trial-2354↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25551)] 04:35:49.574538 run osmo-msc_10.42.42.6(pid=25551): stdout: | (launched: 2022-12-09_04:35:48.483775) 04:35:49.623255 run osmo-msc_10.42.42.6(pid=25551): stderr: | 20221209043548752 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209043548752 DLGLOBAL DEBUG validating counter group 0x7fcdc3901c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209043548752 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209043548752 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209043548752 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209043548753 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209043548754 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209043548755 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209043548755 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209043548755 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:35:49.672813 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25544): Terminating (SIGTERM) 04:35:49.712149 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25547): Terminating (SIGTERM) 04:35:49.751291 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25550): Terminating (SIGTERM) 04:35:49.790869 --- ParallelTerminationStrategy: PID 25544 died... 04:35:49.809810 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25544): Terminated: ok {rc=0} 04:35:49.853215 --- ParallelTerminationStrategy: PID 25547 died... 04:35:49.871476 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25547): Terminated: ok {rc=0} 04:35:49.915654 --- ParallelTerminationStrategy: PID 25550 died... 04:35:49.934067 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25550): Terminated: ok {rc=0} 04:35:50.017246 bus /sierra_3: Setting Powered False 04:35:51.113402 bus /sierra_3: Setting Powered False 04:35:52.228262 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 sms:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 nitb_ussd:nanobts+band-1900 --------------------------------------------------------------------- 04:35:53.448917 tst nitb_ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:35:53.453773 tst nitb_ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 04:35:53.476879 tst nitb_ussd:nanobts+band-1900: Verifying 1 x ip_address (candidates: 9) 04:35:53.483437 tst nitb_ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 04:35:53.518055 tst nitb_ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 04:35:53.541328 tst nitb_ussd:nanobts+band-1900: Reserving 1 x ip_address (candidates: 9) 04:35:53.547731 tst nitb_ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 04:35:54.067132 tst nitb_ussd:nanobts+band-1900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2354 nitb_ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 04:35:54.071936 tst nitb_ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 1) 04:35:54.082608 tst nitb_ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 04:35:54.119311 tst assert_extension.py: using LAC 19110 04:35:54.235451 tst assert_extension.py: using RAC 240 04:35:54.351870 tst assert_extension.py: using CellId 19110 04:35:54.466911 tst assert_extension.py: using BVCI 19111 04:35:54.571802 tst nitb_ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 04:35:54.687944 tst assert_extension.py:10: start nitb and bts... 04:35:54.896702 run osmo-nitb_10.42.42.2: Starting osmo-nitb 04:35:55.533045 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25556): Launched 04:35:55.844549 run osmo-nitb_10.42.42.2(pid=25557): Launched 04:35:56.018139 run osmo-nitb_10.42.42.2(pid=25557): ERR: Terminated: ERROR {rc=2} [trial-2354↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25557)] 04:35:56.159051 run osmo-nitb_10.42.42.2(pid=25557): stdout: | (launched: 2022-12-09_04:35:55.787981) 04:35:56.300645 run osmo-nitb_10.42.42.2(pid=25557): stderr: | (launched: 2022-12-09_04:35:55.834317) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:35:56.442483 run osmo-nitb_10.42.42.2(pid=25557): stdout: | (launched: 2022-12-09_04:35:55.787981) 04:35:56.579364 run osmo-nitb_10.42.42.2(pid=25557): stderr: | (launched: 2022-12-09_04:35:55.834317) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f4d467d3268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=25557): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25557) [trial-2354↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25557)] 04:35:56.962381 tst osmo-nitb_10.42.42.2(pid=25557): stdout: | (launched: 2022-12-09_04:35:55.787981) 04:35:57.088836 tst osmo-nitb_10.42.42.2(pid=25557): stderr: | (launched: 2022-12-09_04:35:55.834317) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:35:57.238100 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=25557): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25557) [trial-2354↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25557)] [trial-2354↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12] 04:35:57.247270 tst assert_extension.py:12: Test FAILED (3.2 sec) 04:35:57.254494 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25556): Terminating (SIGTERM) 04:35:57.466614 --- ParallelTerminationStrategy: PID 25556 died... 04:35:57.488562 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25556): Terminated: ok {rc=0} 04:35:57.578020 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 nitb_ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 ussd:nanobts+band-1900 --------------------------------------------------------------------- 04:35:58.744902 tst ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:35:58.750403 tst ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 04:35:58.776322 tst ussd:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 04:35:58.803187 tst ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 04:35:58.837758 tst ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 04:35:58.861734 tst ussd:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 04:35:58.889853 tst ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 04:35:59.420272 tst ussd:nanobts+band-1900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2354 ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 04:35:59.425747 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 04:35:59.436573 tst ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 04:35:59.475559 tst assert_extension.py: using LAC 19111 04:35:59.598123 tst assert_extension.py: using RAC 241 04:35:59.722237 tst assert_extension.py: using CellId 19111 04:35:59.844924 tst assert_extension.py: using BVCI 19112 04:35:59.957762 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 04:35:59.968686 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 04:35:59.979619 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 04:35:59.990743 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 04:36:00.001888 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 04:36:00.012847 tst ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 04:36:00.124717 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:36:00.574733 run create_hlr_db(pid=25561): Launched 04:36:00.694714 bus /sierra_2: Setting Powered False 04:36:01.754010 run create_hlr_db(pid=25561): Terminated: ok {rc=0} 04:36:02.182235 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25563): Launched 04:36:02.487277 run osmo-hlr_10.42.42.2(pid=25564): Launched 04:36:02.600163 run osmo-stp_10.42.42.5: Starting osmo-stp 04:36:03.101386 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25566): Launched 04:36:03.391710 run osmo-stp_10.42.42.5(pid=25567): Launched 04:36:03.502852 run osmo-msc_10.42.42.6: Starting osmo-msc 04:36:04.028081 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25569): Launched 04:36:04.318210 run osmo-msc_10.42.42.6(pid=25570): Launched 04:36:04.481411 run osmo-stp_10.42.42.5(pid=25567): ERR: Terminated: ERROR {rc=1} [trial-2354↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25567)] 04:36:04.606672 run osmo-stp_10.42.42.5(pid=25567): stdout: | (launched: 2022-12-09_04:36:03.338521) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:36:04.730250 run osmo-stp_10.42.42.5(pid=25567): stderr: | 20221209043603507 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043603507 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043603507 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043603507 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043603508 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043603508 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043603508 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:36:04.851955 run osmo-stp_10.42.42.5(pid=25567): stdout: | (launched: 2022-12-09_04:36:03.338521) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:36:04.967719 run osmo-stp_10.42.42.5(pid=25567): stderr: | 20221209043603507 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043603507 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043603507 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043603507 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043603508 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043603508 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043603508 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:36:05.105989 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=25567): Process ended prematurely: osmo-stp_10.42.42.5(pid=25567) [trial-2354↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25567)] [trial-2354↪ussd:nanobts+band-1900↪assert_extension.py:17] 04:36:05.114324 tst assert_extension.py:17: Test FAILED (5.7 sec) 04:36:05.140223 run osmo-hlr_10.42.42.2(pid=25564): ERR: Terminated: ERROR {rc=237} [trial-2354↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25564)] 04:36:05.187793 run osmo-hlr_10.42.42.2(pid=25564): stdout: | (launched: 2022-12-09_04:36:02.433910) 04:36:05.237078 run osmo-hlr_10.42.42.2(pid=25564): stderr: | 20221209043602606 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209043602606 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209043602606 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209043602606 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209043602606 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209043602607 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209043602618 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/ussd:nanobts+band-1900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209043602627 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209043602627 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209043602627 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:36:05.305703 run osmo-msc_10.42.42.6(pid=25570): ERR: Terminated: ERROR {rc=2} [trial-2354↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25570)] 04:36:05.353323 run osmo-msc_10.42.42.6(pid=25570): stdout: | (launched: 2022-12-09_04:36:04.265152) 04:36:05.402521 run osmo-msc_10.42.42.6(pid=25570): stderr: | 20221209043604533 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209043604534 DLGLOBAL DEBUG validating counter group 0x7f68579b2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209043604534 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209043604534 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209043604534 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209043604534 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209043604536 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209043604536 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209043604536 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209043604536 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:36:05.452165 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25563): Terminating (SIGTERM) 04:36:05.491632 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25566): Terminating (SIGTERM) 04:36:05.531160 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25569): Terminating (SIGTERM) 04:36:05.570899 --- ParallelTerminationStrategy: PID 25563 died... 04:36:05.589843 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25563): Terminated: ok {rc=0} 04:36:05.633391 --- ParallelTerminationStrategy: PID 25566 died... 04:36:05.651783 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25566): Terminated: ok {rc=0} 04:36:05.695649 --- ParallelTerminationStrategy: PID 25569 died... 04:36:05.714064 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25569): Terminated: ok {rc=0} 04:36:05.796662 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 04:36:06.995129 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:36:07.003446 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 04:36:07.028871 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 04:36:07.055767 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 04:36:07.110236 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 04:36:07.135043 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 04:36:07.162407 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 04:36:07.712753 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 04:36:07.764257 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:36:07.775876 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 04:36:07.835887 tst mo_mt_call.py: using LAC 19112 04:36:07.961052 tst mo_mt_call.py: using RAC 242 04:36:08.085465 tst mo_mt_call.py: using CellId 19112 04:36:08.202778 tst mo_mt_call.py: using BVCI 19113 04:36:08.309686 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:36:08.320844 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:36:08.331907 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:36:08.343125 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:36:08.354406 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:36:08.365721 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 04:36:08.483118 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 04:36:08.601570 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:36:09.092402 run create_hlr_db(pid=25575): Launched 04:36:09.215716 bus /sierra_2: Setting Powered False 04:36:10.279804 run create_hlr_db(pid=25575): Terminated: ok {rc=0} 04:36:10.721187 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25577): Launched 04:36:11.037046 run osmo-hlr_10.42.42.2(pid=25578): Launched 04:36:11.158756 run osmo-stp_10.42.42.5: Starting osmo-stp 04:36:11.705095 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25580): Launched 04:36:12.020370 run osmo-stp_10.42.42.5(pid=25581): Launched 04:36:12.142188 run osmo-msc_10.42.42.6: Starting osmo-msc 04:36:12.713972 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25583): Launched 04:36:13.030945 run osmo-msc_10.42.42.6(pid=25584): Launched 04:36:13.209736 run osmo-stp_10.42.42.5(pid=25581): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25581)] 04:36:13.344188 run osmo-stp_10.42.42.5(pid=25581): stdout: | (launched: 2022-12-09_04:36:11.963022) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:36:13.479200 run osmo-stp_10.42.42.5(pid=25581): stderr: | 20221209043612153 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043612153 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043612153 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043612154 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043612154 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043612154 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043612154 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:36:13.612755 run osmo-stp_10.42.42.5(pid=25581): stdout: | (launched: 2022-12-09_04:36:11.963022) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:36:13.739681 run osmo-stp_10.42.42.5(pid=25581): stderr: | 20221209043612153 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043612153 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043612153 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043612154 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043612154 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043612154 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043612154 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:36:13.891096 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25581): Process ended prematurely: osmo-stp_10.42.42.5(pid=25581) [trial-2354↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25581)] [trial-2354↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 04:36:13.900517 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 04:36:13.928855 run osmo-hlr_10.42.42.2(pid=25578): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25578)] 04:36:13.979345 run osmo-hlr_10.42.42.2(pid=25578): stdout: | (launched: 2022-12-09_04:36:10.979695) 04:36:14.031483 run osmo-hlr_10.42.42.2(pid=25578): stderr: | 20221209043611177 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209043611177 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209043611177 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209043611177 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209043611177 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209043611177 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209043611190 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209043611198 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209043611198 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209043611198 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:36:14.104200 run osmo-msc_10.42.42.6(pid=25584): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25584)] 04:36:14.154958 run osmo-msc_10.42.42.6(pid=25584): stdout: | (launched: 2022-12-09_04:36:12.973128) 04:36:14.207017 run osmo-msc_10.42.42.6(pid=25584): stderr: | 20221209043613290 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209043613290 DLGLOBAL DEBUG validating counter group 0x7f6d1fdf5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209043613291 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209043613291 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209043613291 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209043613291 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209043613293 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209043613293 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209043613293 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209043613293 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:36:14.259192 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25577): Terminating (SIGTERM) 04:36:14.300740 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25580): Terminating (SIGTERM) 04:36:14.342560 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25583): Terminating (SIGTERM) 04:36:14.384616 --- ParallelTerminationStrategy: PID 25577 died... 04:36:14.404636 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25577): Terminated: ok {rc=0} 04:36:14.451145 --- ParallelTerminationStrategy: PID 25580 died... 04:36:14.470849 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25580): Terminated: ok {rc=0} 04:36:14.517390 --- ParallelTerminationStrategy: PID 25583 died... 04:36:14.536869 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25583): Terminated: ok {rc=0} 04:36:14.625942 bus /sierra_3: Setting Powered False 04:36:15.726069 bus /sierra_3: Setting Powered False 04:36:16.845075 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2354 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 04:36:17.988135 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:36:17.999766 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 04:36:18.058520 tst mo_mt_call_osmux.py: using LAC 19113 04:36:18.176665 tst mo_mt_call_osmux.py: using RAC 243 04:36:18.293213 tst mo_mt_call_osmux.py: using CellId 19113 04:36:18.409522 tst mo_mt_call_osmux.py: using BVCI 19114 04:36:18.516379 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:36:18.527761 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:36:18.538648 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:36:18.549510 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:36:18.560484 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:36:18.571358 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 04:36:18.688504 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 04:36:18.803745 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:36:19.261790 run create_hlr_db(pid=25586): Launched 04:36:19.384367 bus /sierra_2: Setting Powered False 04:36:20.444405 run create_hlr_db(pid=25586): Terminated: ok {rc=0} 04:36:20.877420 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25588): Launched 04:36:21.195918 run osmo-hlr_10.42.42.2(pid=25589): Launched 04:36:21.317746 run osmo-stp_10.42.42.5: Starting osmo-stp 04:36:21.863229 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25591): Launched 04:36:22.183124 run osmo-stp_10.42.42.5(pid=25592): Launched 04:36:22.305512 run osmo-msc_10.42.42.6: Starting osmo-msc 04:36:22.880070 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25594): Launched 04:36:23.199682 run osmo-msc_10.42.42.6(pid=25595): Launched 04:36:23.377266 run osmo-stp_10.42.42.5(pid=25592): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25592)] 04:36:23.512154 run osmo-stp_10.42.42.5(pid=25592): stdout: | (launched: 2022-12-09_04:36:22.125293) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:36:23.647627 run osmo-stp_10.42.42.5(pid=25592): stderr: | 20221209043622312 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043622313 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043622313 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043622313 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043622314 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043622314 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043622314 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:36:23.782234 run osmo-stp_10.42.42.5(pid=25592): stdout: | (launched: 2022-12-09_04:36:22.125293) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:36:23.909512 run osmo-stp_10.42.42.5(pid=25592): stderr: | 20221209043622312 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043622313 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043622313 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043622313 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043622314 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043622314 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043622314 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:36:24.061865 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25592): Process ended prematurely: osmo-stp_10.42.42.5(pid=25592) [trial-2354↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25592)] [trial-2354↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 04:36:24.071506 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 04:36:24.100844 run osmo-hlr_10.42.42.2(pid=25589): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25589)] 04:36:24.151906 run osmo-hlr_10.42.42.2(pid=25589): stdout: | (launched: 2022-12-09_04:36:21.138112) 04:36:24.204442 run osmo-hlr_10.42.42.2(pid=25589): stderr: | 20221209043621334 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209043621334 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209043621334 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209043621334 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209043621334 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209043621334 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209043621346 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209043621354 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209043621354 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209043621354 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:36:24.277457 run osmo-msc_10.42.42.6(pid=25595): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25595)] 04:36:24.327887 run osmo-msc_10.42.42.6(pid=25595): stdout: | (launched: 2022-12-09_04:36:23.141684) 04:36:24.379999 run osmo-msc_10.42.42.6(pid=25595): stderr: | 20221209043623461 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209043623461 DLGLOBAL DEBUG validating counter group 0x7fdc32274c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209043623462 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209043623462 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209043623462 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209043623462 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209043623464 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209043623464 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209043623464 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209043623464 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:36:24.432167 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25588): Terminating (SIGTERM) 04:36:24.474090 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25591): Terminating (SIGTERM) 04:36:24.515934 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25594): Terminating (SIGTERM) 04:36:24.558259 --- ParallelTerminationStrategy: PID 25588 died... 04:36:24.578400 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25588): Terminated: ok {rc=0} 04:36:24.625253 --- ParallelTerminationStrategy: PID 25591 died... 04:36:24.644831 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25591): Terminated: ok {rc=0} 04:36:24.691906 --- ParallelTerminationStrategy: PID 25594 died... 04:36:24.711764 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25594): Terminated: ok {rc=0} 04:36:24.801454 bus /sierra_3: Setting Powered False 04:36:25.901354 bus /sierra_3: Setting Powered False 04:36:27.019041 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 04:36:28.259962 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:36:28.267400 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 04:36:28.290944 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 04:36:28.316825 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 04:36:28.367339 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 04:36:28.390471 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 04:36:28.416384 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 04:36:28.968481 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 04:36:29.015941 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:36:29.026979 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 04:36:29.085096 tst mo_mt_call.py: using LAC 19114 04:36:29.202541 tst mo_mt_call.py: using RAC 244 04:36:29.322089 tst mo_mt_call.py: using CellId 19114 04:36:29.443538 tst mo_mt_call.py: using BVCI 19115 04:36:29.551852 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:36:29.562932 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:36:29.573925 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:36:29.584740 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:36:29.595686 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:36:29.606490 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 04:36:29.723638 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 04:36:29.841645 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:36:30.332680 run create_hlr_db(pid=25600): Launched 04:36:30.454618 bus /sierra_2: Setting Powered False 04:36:31.513495 run create_hlr_db(pid=25600): Terminated: ok {rc=0} 04:36:32.013460 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25602): Launched 04:36:32.322790 run osmo-hlr_10.42.42.2(pid=25603): Launched 04:36:32.438301 run osmo-stp_10.42.42.5: Starting osmo-stp 04:36:32.947423 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25605): Launched 04:36:33.243563 run osmo-stp_10.42.42.5(pid=25606): Launched 04:36:33.355907 run osmo-msc_10.42.42.6: Starting osmo-msc 04:36:33.888537 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25608): Launched 04:36:34.184350 run osmo-msc_10.42.42.6(pid=25609): Launched 04:36:34.350415 run osmo-stp_10.42.42.5(pid=25606): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25606)] 04:36:34.475937 run osmo-stp_10.42.42.5(pid=25606): stdout: | (launched: 2022-12-09_04:36:33.189141) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:36:34.602135 run osmo-stp_10.42.42.5(pid=25606): stderr: | 20221209043633357 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043633357 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043633357 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043633358 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043633358 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043633358 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043633359 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:36:34.725591 run osmo-stp_10.42.42.5(pid=25606): stdout: | (launched: 2022-12-09_04:36:33.189141) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:36:34.844376 run osmo-stp_10.42.42.5(pid=25606): stderr: | 20221209043633357 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043633357 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043633357 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043633358 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043633358 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043633358 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043633359 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:36:34.985667 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25606): Process ended prematurely: osmo-stp_10.42.42.5(pid=25606) [trial-2354↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25606)] [trial-2354↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 04:36:34.994396 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 04:36:35.020418 run osmo-hlr_10.42.42.2(pid=25603): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25603)] 04:36:35.067573 run osmo-hlr_10.42.42.2(pid=25603): stdout: | (launched: 2022-12-09_04:36:32.268932) 04:36:35.116547 run osmo-hlr_10.42.42.2(pid=25603): stderr: | 20221209043632442 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209043632442 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209043632442 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209043632442 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209043632442 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209043632443 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209043632455 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209043632463 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209043632464 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209043632464 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:36:35.185174 run osmo-msc_10.42.42.6(pid=25609): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25609)] 04:36:35.232264 run osmo-msc_10.42.42.6(pid=25609): stdout: | (launched: 2022-12-09_04:36:34.130241) 04:36:35.281359 run osmo-msc_10.42.42.6(pid=25609): stderr: | 20221209043634403 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209043634403 DLGLOBAL DEBUG validating counter group 0x7f9bbcbc0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209043634403 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209043634403 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209043634404 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209043634404 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209043634406 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209043634406 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209043634406 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209043634406 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:36:35.330811 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25602): Terminating (SIGTERM) 04:36:35.370191 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25605): Terminating (SIGTERM) 04:36:35.409511 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25608): Terminating (SIGTERM) 04:36:35.449303 --- ParallelTerminationStrategy: PID 25602 died... 04:36:35.468124 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25602): Terminated: ok {rc=0} 04:36:35.511867 --- ParallelTerminationStrategy: PID 25605 died... 04:36:35.530382 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25605): Terminated: ok {rc=0} 04:36:35.573924 --- ParallelTerminationStrategy: PID 25608 died... 04:36:35.592198 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25608): Terminated: ok {rc=0} 04:36:35.675675 bus /sierra_3: Setting Powered False 04:36:36.770406 bus /sierra_3: Setting Powered False 04:36:37.886937 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2354 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 04:36:39.031946 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:36:39.043458 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 04:36:39.102124 tst mo_mt_call_osmux.py: using LAC 19115 04:36:39.218329 tst mo_mt_call_osmux.py: using RAC 245 04:36:39.334820 tst mo_mt_call_osmux.py: using CellId 19115 04:36:39.450599 tst mo_mt_call_osmux.py: using BVCI 19116 04:36:39.557364 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:36:39.568303 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:36:39.579134 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:36:39.589990 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:36:39.601170 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:36:39.611898 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 04:36:39.724312 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 04:36:39.842779 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:36:40.335366 run create_hlr_db(pid=25612): Launched 04:36:40.458218 bus /sierra_2: Setting Powered False 04:36:41.521385 run create_hlr_db(pid=25612): Terminated: ok {rc=0} 04:36:41.963346 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25614): Launched 04:36:42.281041 run osmo-hlr_10.42.42.2(pid=25615): Launched 04:36:42.403270 run osmo-stp_10.42.42.5: Starting osmo-stp 04:36:42.951780 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25617): Launched 04:36:43.270639 run osmo-stp_10.42.42.5(pid=25618): Launched 04:36:43.392675 run osmo-msc_10.42.42.6: Starting osmo-msc 04:36:43.965373 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25620): Launched 04:36:44.283394 run osmo-msc_10.42.42.6(pid=25621): Launched 04:36:44.462656 run osmo-stp_10.42.42.5(pid=25618): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25618)] 04:36:44.597340 run osmo-stp_10.42.42.5(pid=25618): stdout: | (launched: 2022-12-09_04:36:43.212421) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:36:44.734316 run osmo-stp_10.42.42.5(pid=25618): stderr: | 20221209043643404 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043643404 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043643404 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043643405 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043643405 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043643405 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043643405 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:36:44.869165 run osmo-stp_10.42.42.5(pid=25618): stdout: | (launched: 2022-12-09_04:36:43.212421) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:36:44.995885 run osmo-stp_10.42.42.5(pid=25618): stderr: | 20221209043643404 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043643404 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043643404 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043643405 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043643405 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043643405 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043643405 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:36:45.147825 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25618): Process ended prematurely: osmo-stp_10.42.42.5(pid=25618) [trial-2354↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25618)] [trial-2354↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 04:36:45.157373 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 04:36:45.185870 run osmo-hlr_10.42.42.2(pid=25615): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25615)] 04:36:45.236274 run osmo-hlr_10.42.42.2(pid=25615): stdout: | (launched: 2022-12-09_04:36:42.223455) 04:36:45.288557 run osmo-hlr_10.42.42.2(pid=25615): stderr: | 20221209043642421 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209043642421 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209043642421 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209043642421 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209043642421 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209043642421 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209043642434 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209043642442 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209043642442 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209043642442 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:36:45.361520 run osmo-msc_10.42.42.6(pid=25621): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25621)] 04:36:45.411984 run osmo-msc_10.42.42.6(pid=25621): stdout: | (launched: 2022-12-09_04:36:44.225659) 04:36:45.464130 run osmo-msc_10.42.42.6(pid=25621): stderr: | 20221209043644545 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209043644546 DLGLOBAL DEBUG validating counter group 0x7f5c67e11c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209043644546 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209043644546 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209043644546 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209043644546 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209043644548 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209043644548 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209043644548 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209043644548 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:36:45.516736 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25614): Terminating (SIGTERM) 04:36:45.559001 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25617): Terminating (SIGTERM) 04:36:45.600941 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25620): Terminating (SIGTERM) 04:36:45.643296 --- ParallelTerminationStrategy: PID 25614 died... 04:36:45.663085 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25614): Terminated: ok {rc=0} 04:36:45.709857 --- ParallelTerminationStrategy: PID 25617 died... 04:36:45.729345 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25617): Terminated: ok {rc=0} 04:36:45.775663 --- ParallelTerminationStrategy: PID 25620 died... 04:36:45.795216 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25620): Terminated: ok {rc=0} 04:36:45.899548 bus /sierra_3: Setting Powered False 04:36:46.996141 bus /sierra_3: Setting Powered False 04:36:48.111622 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 04:36:49.354274 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:36:49.362986 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 04:36:49.386674 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 04:36:49.414127 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 04:36:49.464408 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 04:36:49.487588 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 04:36:49.513504 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 04:36:50.065680 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 04:36:50.113072 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:36:50.124038 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 04:36:50.185640 tst mo_mt_call.py: using LAC 19116 04:36:50.310246 tst mo_mt_call.py: using RAC 246 04:36:50.433776 tst mo_mt_call.py: using CellId 19116 04:36:50.556310 tst mo_mt_call.py: using BVCI 19117 04:36:50.671674 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:36:50.683477 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:36:50.694809 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:36:50.706339 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:36:50.718050 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:36:50.729531 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 04:36:50.843622 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 04:36:50.962012 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:36:51.455290 run create_hlr_db(pid=25627): Launched 04:36:51.576870 bus /sierra_2: Setting Powered False 04:36:52.640161 run create_hlr_db(pid=25627): Terminated: ok {rc=0} 04:36:53.082237 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25629): Launched 04:36:53.400915 run osmo-hlr_10.42.42.2(pid=25630): Launched 04:36:53.523385 run osmo-stp_10.42.42.5: Starting osmo-stp 04:36:54.070776 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25632): Launched 04:36:54.388333 run osmo-stp_10.42.42.5(pid=25633): Launched 04:36:54.510046 run osmo-msc_10.42.42.6: Starting osmo-msc 04:36:55.082328 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25635): Launched 04:36:55.400103 run osmo-msc_10.42.42.6(pid=25636): Launched 04:36:55.578321 run osmo-stp_10.42.42.5(pid=25633): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25633)] 04:36:55.712909 run osmo-stp_10.42.42.5(pid=25633): stdout: | (launched: 2022-12-09_04:36:54.330794) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:36:55.848547 run osmo-stp_10.42.42.5(pid=25633): stderr: | 20221209043654520 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043654521 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043654521 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043654522 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043654522 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043654522 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043654522 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:36:55.983282 run osmo-stp_10.42.42.5(pid=25633): stdout: | (launched: 2022-12-09_04:36:54.330794) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:36:56.110529 run osmo-stp_10.42.42.5(pid=25633): stderr: | 20221209043654520 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043654521 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043654521 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043654522 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043654522 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043654522 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043654522 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:36:56.263095 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25633): Process ended prematurely: osmo-stp_10.42.42.5(pid=25633) [trial-2354↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25633)] [trial-2354↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 04:36:56.272404 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 04:36:56.300837 run osmo-hlr_10.42.42.2(pid=25630): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25630)] 04:36:56.351142 run osmo-hlr_10.42.42.2(pid=25630): stdout: | (launched: 2022-12-09_04:36:53.343071) 04:36:56.403218 run osmo-hlr_10.42.42.2(pid=25630): stderr: | 20221209043653539 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209043653539 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209043653539 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209043653539 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209043653539 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209043653539 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209043653552 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209043653560 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209043653560 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209043653560 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:36:56.475720 run osmo-msc_10.42.42.6(pid=25636): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25636)] 04:36:56.525834 run osmo-msc_10.42.42.6(pid=25636): stdout: | (launched: 2022-12-09_04:36:55.342415) 04:36:56.577741 run osmo-msc_10.42.42.6(pid=25636): stderr: | 20221209043655660 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209043655660 DLGLOBAL DEBUG validating counter group 0x7faf4d147c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209043655660 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209043655660 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209043655661 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209043655661 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209043655663 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209043655663 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209043655664 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209043655664 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:36:56.629914 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25629): Terminating (SIGTERM) 04:36:56.671669 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25632): Terminating (SIGTERM) 04:36:56.713498 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25635): Terminating (SIGTERM) 04:36:56.755709 --- ParallelTerminationStrategy: PID 25629 died... 04:36:56.775411 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25629): Terminated: ok {rc=0} 04:36:56.821896 --- ParallelTerminationStrategy: PID 25632 died... 04:36:56.841353 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25632): Terminated: ok {rc=0} 04:36:56.887752 --- ParallelTerminationStrategy: PID 25635 died... 04:36:56.907174 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25635): Terminated: ok {rc=0} 04:36:56.993981 bus /sierra_3: Setting Powered False 04:36:58.093841 bus /sierra_3: Setting Powered False 04:36:59.209634 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2354 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 04:37:00.357067 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:37:00.369124 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 04:37:00.430773 tst mo_mt_call_osmux.py: using LAC 19117 04:37:00.556521 tst mo_mt_call_osmux.py: using RAC 247 04:37:00.683815 tst mo_mt_call_osmux.py: using CellId 19117 04:37:00.807486 tst mo_mt_call_osmux.py: using BVCI 19118 04:37:00.951758 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:37:00.963403 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:37:00.976788 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:37:00.988322 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:37:01.001200 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:37:01.013169 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 04:37:01.130868 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 04:37:01.248472 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:37:01.730555 run create_hlr_db(pid=25638): Launched 04:37:01.887586 bus /sierra_2: Setting Powered False 04:37:02.946973 run create_hlr_db(pid=25638): Terminated: ok {rc=0} 04:37:03.382714 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25640): Launched 04:37:03.702859 run osmo-hlr_10.42.42.2(pid=25641): Launched 04:37:03.825091 run osmo-stp_10.42.42.5: Starting osmo-stp 04:37:04.375012 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25643): Launched 04:37:04.674701 run osmo-stp_10.42.42.5(pid=25644): Launched 04:37:04.787119 run osmo-msc_10.42.42.6: Starting osmo-msc 04:37:05.329424 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25646): Launched 04:37:05.627369 run osmo-msc_10.42.42.6(pid=25647): Launched 04:37:05.794142 run osmo-stp_10.42.42.5(pid=25644): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25644)] 04:37:05.919697 run osmo-stp_10.42.42.5(pid=25644): stdout: | (launched: 2022-12-09_04:37:04.620301) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:37:06.045374 run osmo-stp_10.42.42.5(pid=25644): stderr: | 20221209043704788 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043704789 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043704789 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043704789 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043704792 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043704792 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043704792 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:37:06.169229 run osmo-stp_10.42.42.5(pid=25644): stdout: | (launched: 2022-12-09_04:37:04.620301) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:37:06.287455 run osmo-stp_10.42.42.5(pid=25644): stderr: | 20221209043704788 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043704789 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043704789 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043704789 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043704792 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043704792 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043704792 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:37:06.429512 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25644): Process ended prematurely: osmo-stp_10.42.42.5(pid=25644) [trial-2354↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25644)] [trial-2354↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 04:37:06.438528 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 04:37:06.464639 run osmo-hlr_10.42.42.2(pid=25641): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25641)] 04:37:06.512166 run osmo-hlr_10.42.42.2(pid=25641): stdout: | (launched: 2022-12-09_04:37:03.644466) 04:37:06.561799 run osmo-hlr_10.42.42.2(pid=25641): stderr: | 20221209043703843 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209043703843 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209043703844 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209043703844 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209043703844 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209043703844 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209043703856 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209043703864 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209043703864 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209043703864 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:37:06.630845 run osmo-msc_10.42.42.6(pid=25647): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25647)] 04:37:06.678184 run osmo-msc_10.42.42.6(pid=25647): stdout: | (launched: 2022-12-09_04:37:05.572784) 04:37:06.727075 run osmo-msc_10.42.42.6(pid=25647): stderr: | 20221209043705844 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209043705844 DLGLOBAL DEBUG validating counter group 0x7f1b19383c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209043705844 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209043705844 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209043705844 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209043705844 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209043705846 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209043705847 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209043705847 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209043705847 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:37:06.776526 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25640): Terminating (SIGTERM) 04:37:06.816096 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25643): Terminating (SIGTERM) 04:37:06.855523 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25646): Terminating (SIGTERM) 04:37:06.895147 --- ParallelTerminationStrategy: PID 25640 died... 04:37:06.914164 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25640): Terminated: ok {rc=0} 04:37:06.958204 --- ParallelTerminationStrategy: PID 25643 died... 04:37:06.976693 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25643): Terminated: ok {rc=0} 04:37:07.021140 --- ParallelTerminationStrategy: PID 25646 died... 04:37:07.039903 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25646): Terminated: ok {rc=0} 04:37:07.126142 bus /sierra_3: Setting Powered False 04:37:08.227256 bus /sierra_3: Setting Powered False 04:37:09.343337 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 04:37:10.579581 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:37:10.586911 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 04:37:10.610337 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 04:37:10.636145 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 04:37:10.687567 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 04:37:10.711775 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 04:37:10.738822 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 04:37:11.286760 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 04:37:11.333948 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:37:11.344996 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 04:37:11.403828 tst mo_mt_call.py: using LAC 19118 04:37:11.535439 tst mo_mt_call.py: using RAC 248 04:37:11.657124 tst mo_mt_call.py: using CellId 19118 04:37:11.774613 tst mo_mt_call.py: using BVCI 19119 04:37:11.882729 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:37:11.893809 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:37:11.904599 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:37:11.915566 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:37:11.926499 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:37:11.937301 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 04:37:12.052024 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 04:37:12.171276 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:37:12.628238 run create_hlr_db(pid=25652): Launched 04:37:12.749695 bus /sierra_2: Setting Powered False 04:37:13.808735 run create_hlr_db(pid=25652): Terminated: ok {rc=0} 04:37:14.240865 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25654): Launched 04:37:14.557469 run osmo-hlr_10.42.42.2(pid=25655): Launched 04:37:14.678604 run osmo-stp_10.42.42.5: Starting osmo-stp 04:37:15.228068 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25657): Launched 04:37:15.545079 run osmo-stp_10.42.42.5(pid=25658): Launched 04:37:15.666578 run osmo-msc_10.42.42.6: Starting osmo-msc 04:37:16.245772 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25660): Launched 04:37:16.578279 run osmo-msc_10.42.42.6(pid=25661): Launched 04:37:17.096483 run osmo-stp_10.42.42.5(pid=25658): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25658)] 04:37:17.274731 run osmo-stp_10.42.42.5(pid=25658): stdout: | (launched: 2022-12-09_04:37:15.487682) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:37:17.401076 run osmo-stp_10.42.42.5(pid=25658): stderr: | 20221209043715677 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043715677 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043715677 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043715678 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043715678 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043715678 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043715678 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:37:17.525206 run osmo-stp_10.42.42.5(pid=25658): stdout: | (launched: 2022-12-09_04:37:15.487682) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:37:17.642758 run osmo-stp_10.42.42.5(pid=25658): stderr: | 20221209043715677 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043715677 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043715677 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043715678 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043715678 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043715678 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043715678 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:37:17.783748 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25658): Process ended prematurely: osmo-stp_10.42.42.5(pid=25658) [trial-2354↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25658)] [trial-2354↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 04:37:17.792609 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 04:37:17.819142 run osmo-hlr_10.42.42.2(pid=25655): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25655)] 04:37:17.866962 run osmo-hlr_10.42.42.2(pid=25655): stdout: | (launched: 2022-12-09_04:37:14.499885) 04:37:17.916406 run osmo-hlr_10.42.42.2(pid=25655): stderr: | 20221209043714699 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209043714699 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209043714699 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209043714699 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209043714699 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209043714699 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209043714712 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209043714722 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209043714722 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209043714722 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:37:17.985642 run osmo-msc_10.42.42.6(pid=25661): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25661)] 04:37:18.033576 run osmo-msc_10.42.42.6(pid=25661): stdout: | (launched: 2022-12-09_04:37:16.514908) 04:37:18.082996 run osmo-msc_10.42.42.6(pid=25661): stderr: | 20221209043716857 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209043716858 DLGLOBAL DEBUG validating counter group 0x7f9cccbafc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209043716859 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209043716859 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209043716859 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209043716860 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209043716864 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209043716866 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209043716866 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209043716867 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:37:18.132679 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25654): Terminating (SIGTERM) 04:37:18.172339 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25657): Terminating (SIGTERM) 04:37:18.211820 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25660): Terminating (SIGTERM) 04:37:18.251927 --- ParallelTerminationStrategy: PID 25654 died... 04:37:18.270988 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25654): Terminated: ok {rc=0} 04:37:18.314902 --- ParallelTerminationStrategy: PID 25657 died... 04:37:18.333547 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25657): Terminated: ok {rc=0} 04:37:18.377339 --- ParallelTerminationStrategy: PID 25660 died... 04:37:18.396034 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25660): Terminated: ok {rc=0} 04:37:18.480382 bus /sierra_3: Setting Powered False 04:37:19.578410 bus /sierra_3: Setting Powered False 04:37:20.696530 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2354 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 04:37:21.841283 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:37:21.852871 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 04:37:21.912525 tst mo_mt_call_osmux.py: using LAC 19119 04:37:22.029879 tst mo_mt_call_osmux.py: using RAC 249 04:37:22.145569 tst mo_mt_call_osmux.py: using CellId 19119 04:37:22.263187 tst mo_mt_call_osmux.py: using BVCI 19120 04:37:22.371496 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:37:22.382535 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:37:22.393558 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:37:22.404332 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:37:22.415228 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:37:22.426033 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 04:37:22.539733 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 04:37:22.657777 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:37:23.150297 run create_hlr_db(pid=25663): Launched 04:37:23.273279 bus /sierra_2: Setting Powered False 04:37:24.336826 run create_hlr_db(pid=25663): Terminated: ok {rc=0} 04:37:24.778882 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25665): Launched 04:37:25.096310 run osmo-hlr_10.42.42.2(pid=25666): Launched 04:37:25.219411 run osmo-stp_10.42.42.5: Starting osmo-stp 04:37:25.768590 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25668): Launched 04:37:26.087064 run osmo-stp_10.42.42.5(pid=25669): Launched 04:37:26.209784 run osmo-msc_10.42.42.6: Starting osmo-msc 04:37:26.785238 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25671): Launched 04:37:27.104317 run osmo-msc_10.42.42.6(pid=25672): Launched 04:37:27.283962 run osmo-stp_10.42.42.5(pid=25669): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25669)] 04:37:27.418943 run osmo-stp_10.42.42.5(pid=25669): stdout: | (launched: 2022-12-09_04:37:26.029159) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:37:27.555642 run osmo-stp_10.42.42.5(pid=25669): stderr: | 20221209043726223 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043726223 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043726223 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043726224 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043726224 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043726224 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043726224 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:37:27.690185 run osmo-stp_10.42.42.5(pid=25669): stdout: | (launched: 2022-12-09_04:37:26.029159) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:37:27.817525 run osmo-stp_10.42.42.5(pid=25669): stderr: | 20221209043726223 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043726223 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043726223 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043726224 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043726224 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043726224 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043726224 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:37:27.969767 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25669): Process ended prematurely: osmo-stp_10.42.42.5(pid=25669) [trial-2354↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25669)] [trial-2354↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 04:37:27.979394 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 04:37:28.007892 run osmo-hlr_10.42.42.2(pid=25666): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25666)] 04:37:28.058610 run osmo-hlr_10.42.42.2(pid=25666): stdout: | (launched: 2022-12-09_04:37:25.038765) 04:37:28.111400 run osmo-hlr_10.42.42.2(pid=25666): stderr: | 20221209043725239 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209043725239 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209043725239 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209043725239 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209043725239 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209043725239 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209043725252 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209043725261 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209043725261 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209043725261 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:37:28.185172 run osmo-msc_10.42.42.6(pid=25672): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25672)] 04:37:28.236295 run osmo-msc_10.42.42.6(pid=25672): stdout: | (launched: 2022-12-09_04:37:27.046299) 04:37:28.289113 run osmo-msc_10.42.42.6(pid=25672): stderr: | 20221209043727366 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209043727366 DLGLOBAL DEBUG validating counter group 0x7fcfc971dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209043727367 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209043727367 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209043727367 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209043727367 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209043727369 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209043727369 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209043727369 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209043727370 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:37:28.341995 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25665): Terminating (SIGTERM) 04:37:28.384386 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25668): Terminating (SIGTERM) 04:37:28.427116 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25671): Terminating (SIGTERM) 04:37:28.469650 --- ParallelTerminationStrategy: PID 25665 died... 04:37:28.489868 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25665): Terminated: ok {rc=0} 04:37:28.537021 --- ParallelTerminationStrategy: PID 25668 died... 04:37:28.556692 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25668): Terminated: ok {rc=0} 04:37:28.603669 --- ParallelTerminationStrategy: PID 25671 died... 04:37:28.623372 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25671): Terminated: ok {rc=0} 04:37:28.712021 bus /sierra_3: Setting Powered False 04:37:29.810668 bus /sierra_3: Setting Powered False 04:37:30.953120 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 04:37:32.207999 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:37:32.215542 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 04:37:32.239338 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 04:37:32.265912 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 04:37:32.314841 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 04:37:32.338310 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 04:37:32.364907 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 04:37:32.918746 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 04:37:32.966305 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:37:32.977519 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 04:37:33.035370 tst mo_mt_call.py: using LAC 19120 04:37:33.150595 tst mo_mt_call.py: using RAC 250 04:37:33.266622 tst mo_mt_call.py: using CellId 19120 04:37:33.383088 tst mo_mt_call.py: using BVCI 19121 04:37:33.500542 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:37:33.512299 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:37:33.524025 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:37:33.535877 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:37:33.547569 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:37:33.559163 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:37:33.673542 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:37:33.786680 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:37:34.244531 run create_hlr_db(pid=25677): Launched 04:37:34.366782 bus /sierra_2: Setting Powered False 04:37:35.425673 run create_hlr_db(pid=25677): Terminated: ok {rc=0} 04:37:35.864091 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25680): Launched 04:37:36.183287 run osmo-hlr_10.42.42.2(pid=25681): Launched 04:37:36.304699 run osmo-stp_10.42.42.5: Starting osmo-stp 04:37:36.856414 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25683): Launched 04:37:37.175107 run osmo-stp_10.42.42.5(pid=25684): Launched 04:37:37.297083 run osmo-msc_10.42.42.6: Starting osmo-msc 04:37:37.874348 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25686): Launched 04:37:38.192106 run osmo-msc_10.42.42.6(pid=25687): Launched 04:37:38.370513 run osmo-stp_10.42.42.5(pid=25684): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25684)] 04:37:38.504072 run osmo-stp_10.42.42.5(pid=25684): stdout: | (launched: 2022-12-09_04:37:37.116495) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:37:38.639323 run osmo-stp_10.42.42.5(pid=25684): stderr: | 20221209043737310 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043737310 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043737310 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043737310 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043737311 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043737311 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043737311 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:37:38.773510 run osmo-stp_10.42.42.5(pid=25684): stdout: | (launched: 2022-12-09_04:37:37.116495) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:37:38.900411 run osmo-stp_10.42.42.5(pid=25684): stderr: | 20221209043737310 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043737310 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043737310 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043737310 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043737311 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043737311 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043737311 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:37:39.051925 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25684): Process ended prematurely: osmo-stp_10.42.42.5(pid=25684) [trial-2354↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25684)] [trial-2354↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 04:37:39.061608 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 04:37:39.090290 run osmo-hlr_10.42.42.2(pid=25681): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25681)] 04:37:39.140911 run osmo-hlr_10.42.42.2(pid=25681): stdout: | (launched: 2022-12-09_04:37:36.124189) 04:37:39.193823 run osmo-hlr_10.42.42.2(pid=25681): stderr: | 20221209043736323 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209043736323 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209043736323 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209043736323 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209043736323 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209043736323 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209043736336 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209043736344 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209043736344 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209043736344 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:37:39.266854 run osmo-msc_10.42.42.6(pid=25687): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25687)] 04:37:39.318091 run osmo-msc_10.42.42.6(pid=25687): stdout: | (launched: 2022-12-09_04:37:38.134097) 04:37:39.370567 run osmo-msc_10.42.42.6(pid=25687): stderr: | 20221209043738455 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209043738455 DLGLOBAL DEBUG validating counter group 0x7fedbf377c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209043738455 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209043738455 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209043738455 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209043738456 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209043738457 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209043738458 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209043738458 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209043738458 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:37:39.423236 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25680): Terminating (SIGTERM) 04:37:39.465371 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25683): Terminating (SIGTERM) 04:37:39.507368 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25686): Terminating (SIGTERM) 04:37:39.549912 --- ParallelTerminationStrategy: PID 25680 died... 04:37:39.569867 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25680): Terminated: ok {rc=0} 04:37:39.616564 --- ParallelTerminationStrategy: PID 25683 died... 04:37:39.636057 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25683): Terminated: ok {rc=0} 04:37:39.682987 --- ParallelTerminationStrategy: PID 25686 died... 04:37:39.702568 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25686): Terminated: ok {rc=0} 04:37:39.790482 bus /sierra_3: Setting Powered False 04:37:40.891625 bus /sierra_3: Setting Powered False 04:37:42.008348 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2354 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 04:37:43.157329 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:37:43.169475 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 04:37:43.230977 tst mo_mt_call_osmux.py: using LAC 19121 04:37:43.355528 tst mo_mt_call_osmux.py: using RAC 251 04:37:43.484093 tst mo_mt_call_osmux.py: using CellId 19121 04:37:43.608914 tst mo_mt_call_osmux.py: using BVCI 19122 04:37:43.724285 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:37:43.735828 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:37:43.747257 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:37:43.758841 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:37:43.770631 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:37:43.782424 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:37:43.899225 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:37:44.013338 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:37:44.473691 run create_hlr_db(pid=25689): Launched 04:37:44.595913 bus /sierra_2: Setting Powered False 04:37:45.655263 run create_hlr_db(pid=25689): Terminated: ok {rc=0} 04:37:46.098391 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25691): Launched 04:37:46.489756 run osmo-hlr_10.42.42.2(pid=25692): Launched 04:37:46.805028 run osmo-stp_10.42.42.5: Starting osmo-stp 04:37:47.477837 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25694): Launched 04:37:47.797048 run osmo-stp_10.42.42.5(pid=25695): Launched 04:37:47.919063 run osmo-msc_10.42.42.6: Starting osmo-msc 04:37:48.494735 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25697): Launched 04:37:48.813949 run osmo-msc_10.42.42.6(pid=25698): Launched 04:37:48.991931 run osmo-stp_10.42.42.5(pid=25695): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25695)] 04:37:49.126464 run osmo-stp_10.42.42.5(pid=25695): stdout: | (launched: 2022-12-09_04:37:47.739189) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:37:49.262694 run osmo-stp_10.42.42.5(pid=25695): stderr: | 20221209043747928 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043747928 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043747928 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043747929 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043747931 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043747931 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043747931 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:37:49.397454 run osmo-stp_10.42.42.5(pid=25695): stdout: | (launched: 2022-12-09_04:37:47.739189) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:37:49.524836 run osmo-stp_10.42.42.5(pid=25695): stderr: | 20221209043747928 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043747928 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043747928 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043747929 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043747931 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043747931 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043747931 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:37:49.676826 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25695): Process ended prematurely: osmo-stp_10.42.42.5(pid=25695) [trial-2354↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25695)] [trial-2354↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 04:37:49.686207 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 04:37:49.714588 run osmo-hlr_10.42.42.2(pid=25692): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25692)] 04:37:49.764881 run osmo-hlr_10.42.42.2(pid=25692): stdout: | (launched: 2022-12-09_04:37:46.420637) 04:37:49.816914 run osmo-hlr_10.42.42.2(pid=25692): stderr: | 20221209043746641 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209043746641 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209043746641 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209043746641 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209043746641 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209043746641 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209043746659 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209043746675 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209043746675 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209043746675 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:37:49.889426 run osmo-msc_10.42.42.6(pid=25698): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25698)] 04:37:49.940024 run osmo-msc_10.42.42.6(pid=25698): stdout: | (launched: 2022-12-09_04:37:48.755572) 04:37:49.992150 run osmo-msc_10.42.42.6(pid=25698): stderr: | 20221209043749076 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209043749076 DLGLOBAL DEBUG validating counter group 0x7f1d2c424c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209043749076 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209043749076 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209043749077 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209043749077 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209043749079 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209043749079 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209043749079 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209043749079 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:37:50.044739 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25691): Terminating (SIGTERM) 04:37:50.086872 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25694): Terminating (SIGTERM) 04:37:50.129142 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25697): Terminating (SIGTERM) 04:37:50.171846 --- ParallelTerminationStrategy: PID 25691 died... 04:37:50.191933 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25691): Terminated: ok {rc=0} 04:37:50.238825 --- ParallelTerminationStrategy: PID 25694 died... 04:37:50.258428 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25694): Terminated: ok {rc=0} 04:37:50.305276 --- ParallelTerminationStrategy: PID 25697 died... 04:37:50.324814 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25697): Terminated: ok {rc=0} 04:37:50.413032 bus /sierra_3: Setting Powered False 04:37:51.511842 bus /sierra_3: Setting Powered False 04:37:52.627464 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 emergency:nanobts+band-1900 --------------------------------------------------------------------- 04:37:53.868935 tst emergency:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:37:53.874609 tst emergency:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 04:37:53.898896 tst emergency:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 04:37:53.926311 tst emergency:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 04:37:54.011397 tst emergency:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 04:37:54.035445 tst emergency:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 04:37:54.062534 tst emergency:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 04:37:54.648294 tst emergency:nanobts+band-1900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2354 emergency:nanobts+band-1900 emergency_mo_mt_call.py ---------------------------------------------- 04:37:54.653593 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 04:37:54.664521 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 04:37:54.705172 tst emergency_mo_mt_call.py: using LAC 19122 04:37:54.827402 tst emergency_mo_mt_call.py: using RAC 252 04:37:54.950021 tst emergency_mo_mt_call.py: using CellId 19122 04:37:55.074636 tst emergency_mo_mt_call.py: using BVCI 19123 04:37:55.188338 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 04:37:55.199347 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 04:37:55.210511 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 04:37:55.221705 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 04:37:55.232706 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 04:37:55.243826 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 04:37:55.355801 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 04:37:55.472738 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:37:55.956291 run create_hlr_db(pid=25704): Launched 04:37:56.074753 bus /sierra_2: Setting Powered False 04:37:57.136809 run create_hlr_db(pid=25704): Terminated: ok {rc=0} 04:37:57.555258 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25706): Launched 04:37:57.845482 run osmo-hlr_10.42.42.2(pid=25707): Launched 04:37:57.956659 run osmo-stp_10.42.42.5: Starting osmo-stp 04:37:58.471555 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25709): Launched 04:37:58.762457 run osmo-stp_10.42.42.5(pid=25710): Launched 04:37:58.882977 tst emergency_mo_mt_call.py: using MSISDN 7026 04:37:59.030624 run osmo-msc_10.42.42.6: Starting osmo-msc 04:37:59.552582 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25712): Launched 04:37:59.842168 run osmo-msc_10.42.42.6(pid=25713): Launched 04:38:00.004445 run osmo-stp_10.42.42.5(pid=25710): ERR: Terminated: ERROR {rc=1} [trial-2354↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25710)] 04:38:00.127728 run osmo-stp_10.42.42.5(pid=25710): stdout: | (launched: 2022-12-09_04:37:58.709043) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:38:00.251228 run osmo-stp_10.42.42.5(pid=25710): stderr: | 20221209043758877 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043758877 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043758877 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043758877 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043758878 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043758878 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043758878 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:38:00.372406 run osmo-stp_10.42.42.5(pid=25710): stdout: | (launched: 2022-12-09_04:37:58.709043) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:38:00.487699 run osmo-stp_10.42.42.5(pid=25710): stderr: | 20221209043758877 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043758877 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043758877 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043758877 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043758878 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043758878 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043758878 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:38:00.625516 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=25710): Process ended prematurely: osmo-stp_10.42.42.5(pid=25710) [trial-2354↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25710)] [trial-2354↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19] 04:38:00.633674 tst emergency_mo_mt_call.py:19: Test FAILED (6.0 sec) 04:38:00.659510 run osmo-hlr_10.42.42.2(pid=25707): ERR: Terminated: ERROR {rc=237} [trial-2354↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25707)] 04:38:00.706918 run osmo-hlr_10.42.42.2(pid=25707): stdout: | (launched: 2022-12-09_04:37:57.792376) 04:38:00.756220 run osmo-hlr_10.42.42.2(pid=25707): stderr: | 20221209043757966 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209043757966 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209043757966 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209043757966 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209043757966 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209043757966 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209043757979 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/emergency:nanobts+band-1900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209043757987 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209043757988 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209043757988 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:38:00.825218 run osmo-msc_10.42.42.6(pid=25713): ERR: Terminated: ERROR {rc=2} [trial-2354↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25713)] 04:38:00.902317 run osmo-msc_10.42.42.6(pid=25713): stdout: | (launched: 2022-12-09_04:37:59.788863) 04:38:00.952225 run osmo-msc_10.42.42.6(pid=25713): stderr: | 20221209043800058 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209043800058 DLGLOBAL DEBUG validating counter group 0x7feea057ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209043800059 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209043800059 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209043800059 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209043800059 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209043800061 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209043800061 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209043800061 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209043800062 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:38:01.003222 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25706): Terminating (SIGTERM) 04:38:01.044842 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25709): Terminating (SIGTERM) 04:38:01.087451 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25712): Terminating (SIGTERM) 04:38:01.130367 --- ParallelTerminationStrategy: PID 25706 died... 04:38:01.149628 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25706): Terminated: ok {rc=0} 04:38:01.194014 --- ParallelTerminationStrategy: PID 25709 died... 04:38:01.213193 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25709): Terminated: ok {rc=0} 04:38:01.258091 --- ParallelTerminationStrategy: PID 25712 died... 04:38:01.277114 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25712): Terminated: ok {rc=0} 04:38:01.362791 bus /sierra_3: Setting Powered False 04:38:02.493794 bus /sierra_3: Setting Powered False 04:38:03.634824 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2354 emergency:nanobts+band-1900 emergency_preemptive_call.py ---------------------------------------------- 04:38:04.727613 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 04:38:04.740320 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 04:38:04.786077 tst emergency_preemptive_call.py: using LAC 19123 04:38:04.911317 tst emergency_preemptive_call.py: using RAC 253 04:38:05.039616 tst emergency_preemptive_call.py: using CellId 19123 04:38:05.166357 tst emergency_preemptive_call.py: using BVCI 19124 04:38:05.288297 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 04:38:05.300463 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 04:38:05.313809 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 04:38:05.326889 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 04:38:05.338811 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 04:38:05.351930 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 04:38:05.475785 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 04:38:05.595441 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 04:38:05.707145 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 04:38:05.819651 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:38:06.289242 run create_hlr_db(pid=25987): Launched 04:38:06.438668 bus /sierra_2: Setting Powered False 04:38:07.498955 run create_hlr_db(pid=25987): Terminated: ok {rc=0} 04:38:07.929737 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25989): Launched 04:38:08.253677 run osmo-hlr_10.42.42.2(pid=25990): Launched 04:38:08.497605 run osmo-stp_10.42.42.5: Starting osmo-stp 04:38:09.152398 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25992): Launched 04:38:09.488781 run osmo-stp_10.42.42.5(pid=25993): Launched 04:38:09.743693 tst emergency_preemptive_call.py: using MSISDN 7027 04:38:09.988216 run osmo-msc_10.42.42.6: Starting osmo-msc 04:38:10.573147 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25995): Launched 04:38:10.908773 run osmo-msc_10.42.42.6(pid=25996): Launched 04:38:11.268250 run osmo-stp_10.42.42.5(pid=25993): ERR: Terminated: ERROR {rc=1} [trial-2354↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25993)] 04:38:11.546497 run osmo-stp_10.42.42.5(pid=25993): stdout: | (launched: 2022-12-09_04:38:09.428429) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:38:11.726745 run osmo-stp_10.42.42.5(pid=25993): stderr: | 20221209043809728 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043809728 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043809728 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043809729 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043809729 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043809729 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043809729 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:38:11.863842 run osmo-stp_10.42.42.5(pid=25993): stdout: | (launched: 2022-12-09_04:38:09.428429) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:38:11.994257 run osmo-stp_10.42.42.5(pid=25993): stderr: | 20221209043809728 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043809728 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043809728 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043809729 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043809729 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043809729 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043809729 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:38:12.149593 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=25993): Process ended prematurely: osmo-stp_10.42.42.5(pid=25993) [trial-2354↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25993)] [trial-2354↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32] 04:38:12.159540 tst emergency_preemptive_call.py:32: Test FAILED (7.4 sec) 04:38:12.192025 run osmo-hlr_10.42.42.2(pid=25990): ERR: Terminated: ERROR {rc=237} [trial-2354↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25990)] 04:38:12.245399 run osmo-hlr_10.42.42.2(pid=25990): stdout: | (launched: 2022-12-09_04:38:08.186514) 04:38:12.300377 run osmo-hlr_10.42.42.2(pid=25990): stderr: | 20221209043808495 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209043808495 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209043808495 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209043808495 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209043808495 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209043808496 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209043808512 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/emergency:nanobts+band-1900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209043808520 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209043808520 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209043808520 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:38:12.376634 run osmo-msc_10.42.42.6(pid=25996): ERR: Terminated: ERROR {rc=2} [trial-2354↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25996)] 04:38:12.430960 run osmo-msc_10.42.42.6(pid=25996): stdout: | (launched: 2022-12-09_04:38:10.847786) 04:38:12.486039 run osmo-msc_10.42.42.6(pid=25996): stderr: | 20221209043811347 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209043811353 DLGLOBAL DEBUG validating counter group 0x7fcb4dcf1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209043811353 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209043811353 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209043811353 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209043811354 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209043811355 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209043811356 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209043811356 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209043811356 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:38:12.541689 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25989): Terminating (SIGTERM) 04:38:12.586865 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25992): Terminating (SIGTERM) 04:38:12.632544 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25995): Terminating (SIGTERM) 04:38:12.680089 --- ParallelTerminationStrategy: PID 25989 died... 04:38:12.701441 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25989): Terminated: ok {rc=0} 04:38:12.753237 --- ParallelTerminationStrategy: PID 25992 died... 04:38:12.774117 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25992): Terminated: ok {rc=0} 04:38:12.824338 --- ParallelTerminationStrategy: PID 25995 died... 04:38:12.845274 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25995): Terminated: ok {rc=0} 04:38:12.938834 bus /sierra_9: Setting Powered False 04:38:14.042753 bus /sierra_9: Setting Powered False 04:38:15.162706 bus /sierra_8: Setting Powered False 04:38:16.287445 bus /sierra_8: Setting Powered False 04:38:17.435998 bus /sierra_3: Setting Powered False 04:38:18.535559 bus /sierra_3: Setting Powered False 04:38:19.655336 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 emergency:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 gprs:nanobts+band-1900 --------------------------------------------------------------------- 04:38:20.931186 tst gprs:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:38:20.937025 tst gprs:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 04:38:20.962220 tst gprs:nanobts+band-1900: Verifying 9 x ip_address (candidates: 9) 04:38:21.002817 tst gprs:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 04:38:21.089952 tst gprs:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 04:38:21.114402 tst gprs:nanobts+band-1900: Reserving 9 x ip_address (candidates: 9) 04:38:21.154111 tst gprs:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 04:38:21.746335 tst gprs:nanobts+band-1900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2354 gprs:nanobts+band-1900 cs_paging_gprs_active.py ---------------------------------------------- 04:38:21.800110 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:38:21.811716 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 04:38:21.851962 tst cs_paging_gprs_active.py: using LAC 19124 04:38:21.972205 tst cs_paging_gprs_active.py: using RAC 254 04:38:22.097736 tst cs_paging_gprs_active.py: using CellId 19124 04:38:22.222960 tst cs_paging_gprs_active.py: using BVCI 19125 04:38:22.337724 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:38:22.349655 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:38:22.361434 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:38:22.372913 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:38:22.384068 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:38:22.397901 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:38:22.409899 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:38:22.421990 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:38:22.435617 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 04:38:22.555512 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 04:38:22.675287 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 04:38:22.885187 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:38:23.214144 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26001): Launched 04:38:23.494555 run iperf3-srv_10.42.42.10(pid=26002): Launched 04:38:23.615375 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 04:38:23.832320 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:38:24.155102 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26003): Launched 04:38:24.435640 run iperf3-srv_10.42.42.10(pid=26004): Launched 04:38:24.556357 tst cs_paging_gprs_active.py:38: start network... 04:38:24.772904 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:38:25.271344 run create_hlr_db(pid=26005): Launched 04:38:25.393590 bus /sierra_2: Setting Powered False 04:38:26.457312 run create_hlr_db(pid=26005): Terminated: ok {rc=0} 04:38:26.886425 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26007): Launched 04:38:27.186775 run osmo-hlr_10.42.42.2(pid=26008): Launched 04:38:27.301204 run osmo-stp_10.42.42.5: Starting osmo-stp 04:38:27.821396 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26010): Launched 04:38:28.122832 run osmo-stp_10.42.42.5(pid=26011): Launched 04:38:28.237767 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:38:28.754542 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26013): Launched 04:38:28.869367 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:38:29.123721 run patchelf(pid=26014): Launched 04:38:29.291329 run osmo-stp_10.42.42.5(pid=26011): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26011)] 04:38:29.418760 run osmo-stp_10.42.42.5(pid=26011): stdout: | (launched: 2022-12-09_04:38:28.067083) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:38:29.547574 run osmo-stp_10.42.42.5(pid=26011): stderr: | 20221209043828238 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043828239 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043828239 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043828239 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043828240 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043828240 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043828240 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:38:29.676803 run osmo-stp_10.42.42.5(pid=26011): stdout: | (launched: 2022-12-09_04:38:28.067083) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:38:29.800581 run osmo-stp_10.42.42.5(pid=26011): stderr: | 20221209043828238 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043828239 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043828239 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043828239 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043828240 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043828240 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043828240 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:38:29.947193 run patchelf(pid=26014): Terminating (SIGINT) 04:38:30.117367 run patchelf(pid=26014): Terminated: ok {rc=0} 04:38:30.239953 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=26011): Process ended prematurely: osmo-stp_10.42.42.5(pid=26011) [trial-2354↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26011)] [trial-2354↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38] 04:38:30.249776 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 04:38:30.277591 run osmo-hlr_10.42.42.2(pid=26008): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26008)] 04:38:30.325717 run osmo-hlr_10.42.42.2(pid=26008): stdout: | (launched: 2022-12-09_04:38:27.131092) 04:38:30.375360 run osmo-hlr_10.42.42.2(pid=26008): stderr: | 20221209043827308 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209043827308 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209043827308 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209043827308 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209043827308 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209043827308 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209043827320 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:nanobts+band-1900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209043827329 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209043827329 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209043827329 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:38:30.425982 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26001): Terminating (SIGTERM) 04:38:30.466031 run iperf3-srv_10.42.42.10(pid=26002): Terminating (SIGTERM) 04:38:30.505912 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26003): Terminating (SIGTERM) 04:38:30.545800 run iperf3-srv_10.42.42.10(pid=26004): Terminating (SIGTERM) 04:38:30.585722 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26007): Terminating (SIGTERM) 04:38:30.625615 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26010): Terminating (SIGTERM) 04:38:30.665335 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26013): Terminating (SIGTERM) 04:38:30.705468 --- ParallelTerminationStrategy: PID 26001 died... 04:38:30.724571 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26001): Terminated: ok {rc=0} 04:38:30.769032 --- ParallelTerminationStrategy: PID 26002 died... 04:38:30.787753 run iperf3-srv_10.42.42.10(pid=26002): Terminated {rc=256} 04:38:30.831742 --- ParallelTerminationStrategy: PID 26003 died... 04:38:30.850825 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26003): Terminated: ok {rc=0} 04:38:30.896246 --- ParallelTerminationStrategy: PID 26004 died... 04:38:30.929584 run iperf3-srv_10.42.42.10(pid=26004): Terminated {rc=256} 04:38:30.974328 --- ParallelTerminationStrategy: PID 26007 died... 04:38:30.993692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26007): Terminated: ok {rc=0} 04:38:31.047759 --- ParallelTerminationStrategy: PID 26010 died... 04:38:31.077082 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26010): Terminated: ok {rc=0} 04:38:31.125633 --- ParallelTerminationStrategy: PID 26013 died... 04:38:31.146669 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26013): Terminated: ok {rc=0} 04:38:31.246939 bus /gobi_0: Setting Powered False 04:38:32.362318 bus /gobi_0: Setting Powered False 04:38:33.477459 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:nanobts+band-1900 iperf3.py ---------------------------------------------- 04:38:34.627646 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:38:34.639451 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 04:38:34.679793 tst iperf3.py: using LAC 19125 04:38:34.805385 tst iperf3.py: using RAC 255 04:38:34.930317 tst iperf3.py: using CellId 19125 04:38:35.055351 tst iperf3.py: using BVCI 19126 04:38:35.171860 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:38:35.183315 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:38:35.194398 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:38:35.205616 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:38:35.216822 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:38:35.228021 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:38:35.239473 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:38:35.250534 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:38:35.261757 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 04:38:35.380208 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 04:38:35.581286 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:38:35.892404 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26015): Launched 04:38:36.153536 run iperf3-srv_10.42.42.10(pid=26016): Launched 04:38:36.266264 tst iperf3.py:8: start network... 04:38:36.465779 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:38:36.929996 run create_hlr_db(pid=26017): Launched 04:38:37.052594 bus /gobi_6: Setting Powered False 04:38:38.112851 run create_hlr_db(pid=26017): Terminated: ok {rc=0} 04:38:38.553055 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26019): Launched 04:38:38.875823 run osmo-hlr_10.42.42.2(pid=26020): Launched 04:38:38.998942 run osmo-stp_10.42.42.5: Starting osmo-stp 04:38:39.551245 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26022): Launched 04:38:39.873327 run osmo-stp_10.42.42.5(pid=26023): Launched 04:38:39.995721 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:38:40.551653 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26025): Launched 04:38:40.675342 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:38:40.948588 run patchelf(pid=26026): Launched 04:38:41.127842 run osmo-stp_10.42.42.5(pid=26023): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26023)] 04:38:41.263871 run osmo-stp_10.42.42.5(pid=26023): stdout: | (launched: 2022-12-09_04:38:39.814305) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:38:41.401517 run osmo-stp_10.42.42.5(pid=26023): stderr: | 20221209043840006 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043840007 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043840007 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043840007 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043840009 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043840010 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043840010 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:38:41.539120 run osmo-stp_10.42.42.5(pid=26023): stdout: | (launched: 2022-12-09_04:38:39.814305) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:38:41.671127 run osmo-stp_10.42.42.5(pid=26023): stderr: | 20221209043840006 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043840007 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043840007 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043840007 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043840009 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043840010 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043840010 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:38:41.827195 run patchelf(pid=26026): Terminating (SIGINT) 04:38:42.007460 run patchelf(pid=26026): Terminated: ok {rc=0} 04:38:42.137478 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26023): Process ended prematurely: osmo-stp_10.42.42.5(pid=26023) [trial-2354↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26023)] [trial-2354↪gprs:nanobts+band-1900↪iperf3.py:8] 04:38:42.147655 tst iperf3.py:8: Test FAILED (7.6 sec) 04:38:42.177418 run osmo-hlr_10.42.42.2(pid=26020): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:nanobts+band-1900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26020)] 04:38:42.228203 run osmo-hlr_10.42.42.2(pid=26020): stdout: | (launched: 2022-12-09_04:38:38.816705) 04:38:42.280706 run osmo-hlr_10.42.42.2(pid=26020): stderr: | 20221209043839017 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209043839017 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209043839017 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209043839017 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209043839017 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209043839018 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209043839030 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:nanobts+band-1900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209043839039 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209043839039 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209043839039 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:38:42.333755 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26015): Terminating (SIGTERM) 04:38:42.375978 run iperf3-srv_10.42.42.10(pid=26016): Terminating (SIGTERM) 04:38:42.417991 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26019): Terminating (SIGTERM) 04:38:42.460337 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26022): Terminating (SIGTERM) 04:38:42.502533 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26025): Terminating (SIGTERM) 04:38:42.545132 --- ParallelTerminationStrategy: PID 26015 died... 04:38:42.565236 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26015): Terminated: ok {rc=0} 04:38:42.612107 --- ParallelTerminationStrategy: PID 26016 died... 04:38:42.631710 run iperf3-srv_10.42.42.10(pid=26016): Terminated {rc=256} 04:38:42.678504 --- ParallelTerminationStrategy: PID 26019 died... 04:38:42.698111 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26019): Terminated: ok {rc=0} 04:38:42.744644 --- ParallelTerminationStrategy: PID 26022 died... 04:38:42.764380 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26022): Terminated: ok {rc=0} 04:38:42.811080 --- ParallelTerminationStrategy: PID 26025 died... 04:38:42.830786 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26025): Terminated: ok {rc=0} 04:38:42.919994 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:nanobts+band-1900 iperf3m4.py ---------------------------------------------- 04:38:44.069646 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:38:44.081405 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 04:38:44.121313 tst iperf3m4.py: using LAC 19126 04:38:44.250267 tst iperf3m4.py: using RAC 1 04:38:44.377312 tst iperf3m4.py: using CellId 19126 04:38:44.502157 tst iperf3m4.py: using BVCI 19127 04:38:44.621670 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:38:44.632743 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:38:44.643793 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:38:44.655072 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:38:44.666181 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:38:44.677750 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:38:44.689022 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:38:44.700031 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:38:44.711252 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 04:38:44.829578 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 04:38:44.945734 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 04:38:45.064621 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 04:38:45.181753 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 04:38:45.399426 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:38:45.724444 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26027): Launched 04:38:46.046044 run iperf3-srv_10.42.42.10(pid=26028): Launched 04:38:46.176646 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 04:38:46.409584 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:38:46.741688 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26029): Launched 04:38:47.025713 run iperf3-srv_10.42.42.10(pid=26030): Launched 04:38:47.147946 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 04:38:47.350892 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:38:47.654127 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26031): Launched 04:38:47.917641 run iperf3-srv_10.42.42.10(pid=26032): Launched 04:38:48.030675 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 04:38:48.231094 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:38:48.533337 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26033): Launched 04:38:48.795692 run iperf3-srv_10.42.42.10(pid=26034): Launched 04:38:48.908541 tst iperf3m4.py:8: start network... 04:38:49.109135 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:38:49.574473 run create_hlr_db(pid=26035): Launched 04:38:49.697214 bus /gobi_6: Setting Powered False 04:38:50.757328 run create_hlr_db(pid=26035): Terminated: ok {rc=0} 04:38:51.198385 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26037): Launched 04:38:51.522355 run osmo-hlr_10.42.42.2(pid=26038): Launched 04:38:51.646676 run osmo-stp_10.42.42.5: Starting osmo-stp 04:38:52.206176 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26040): Launched 04:38:52.529888 run osmo-stp_10.42.42.5(pid=26041): Launched 04:38:52.653889 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:38:53.211792 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26043): Launched 04:38:53.335589 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:38:53.608016 run patchelf(pid=26044): Launched 04:38:53.789141 run osmo-stp_10.42.42.5(pid=26041): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26041)] 04:38:53.925786 run osmo-stp_10.42.42.5(pid=26041): stdout: | (launched: 2022-12-09_04:38:52.470290) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:38:54.063903 run osmo-stp_10.42.42.5(pid=26041): stderr: | 20221209043852661 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043852662 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043852662 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043852662 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043852663 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043852663 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043852663 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:38:54.202706 run osmo-stp_10.42.42.5(pid=26041): stdout: | (launched: 2022-12-09_04:38:52.470290) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:38:54.335036 run osmo-stp_10.42.42.5(pid=26041): stderr: | 20221209043852661 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043852662 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043852662 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043852662 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043852663 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043852663 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043852663 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:38:54.491994 run patchelf(pid=26044): Terminating (SIGINT) 04:38:54.673584 run patchelf(pid=26044): Terminated: ok {rc=0} 04:38:54.804315 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26041): Process ended prematurely: osmo-stp_10.42.42.5(pid=26041) [trial-2354↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26041)] [trial-2354↪gprs:nanobts+band-1900↪iperf3m4.py:8] 04:38:54.814577 tst iperf3m4.py:8: Test FAILED (10.8 sec) 04:38:54.843981 run osmo-hlr_10.42.42.2(pid=26038): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:nanobts+band-1900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26038)] 04:38:54.894667 run osmo-hlr_10.42.42.2(pid=26038): stdout: | (launched: 2022-12-09_04:38:51.462839) 04:38:54.946942 run osmo-hlr_10.42.42.2(pid=26038): stderr: | 20221209043851661 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209043851661 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209043851661 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209043851661 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209043851661 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209043851661 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209043851673 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:nanobts+band-1900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209043851681 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209043851681 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209043851681 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:38:54.999556 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26027): Terminating (SIGTERM) 04:38:55.041772 run iperf3-srv_10.42.42.10(pid=26028): Terminating (SIGTERM) 04:38:55.083849 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26029): Terminating (SIGTERM) 04:38:55.126107 run iperf3-srv_10.42.42.10(pid=26030): Terminating (SIGTERM) 04:38:55.168076 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26031): Terminating (SIGTERM) 04:38:55.210741 run iperf3-srv_10.42.42.10(pid=26032): Terminating (SIGTERM) 04:38:55.253072 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26033): Terminating (SIGTERM) 04:38:55.295203 run iperf3-srv_10.42.42.10(pid=26034): Terminating (SIGTERM) 04:38:55.337406 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26037): Terminating (SIGTERM) 04:38:55.379551 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26040): Terminating (SIGTERM) 04:38:55.421708 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26043): Terminating (SIGTERM) 04:38:55.464236 --- ParallelTerminationStrategy: PID 26027 died... 04:38:55.484184 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26027): Terminated: ok {rc=0} 04:38:55.531328 --- ParallelTerminationStrategy: PID 26028 died... 04:38:55.551004 run iperf3-srv_10.42.42.10(pid=26028): Terminated {rc=256} 04:38:55.597687 --- ParallelTerminationStrategy: PID 26029 died... 04:38:55.617426 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26029): Terminated: ok {rc=0} 04:38:55.664220 --- ParallelTerminationStrategy: PID 26030 died... 04:38:55.683805 run iperf3-srv_10.42.42.10(pid=26030): Terminated {rc=256} 04:38:55.730266 --- ParallelTerminationStrategy: PID 26031 died... 04:38:55.749889 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26031): Terminated: ok {rc=0} 04:38:55.796630 --- ParallelTerminationStrategy: PID 26032 died... 04:38:55.816335 run iperf3-srv_10.42.42.10(pid=26032): Terminated {rc=256} 04:38:55.862986 --- ParallelTerminationStrategy: PID 26033 died... 04:38:55.882719 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26033): Terminated: ok {rc=0} 04:38:55.929677 --- ParallelTerminationStrategy: PID 26034 died... 04:38:55.949413 run iperf3-srv_10.42.42.10(pid=26034): Terminated {rc=256} 04:38:55.996043 --- ParallelTerminationStrategy: PID 26037 died... 04:38:56.015735 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26037): Terminated: ok {rc=0} 04:38:56.062648 --- ParallelTerminationStrategy: PID 26040 died... 04:38:56.082274 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26040): Terminated: ok {rc=0} 04:38:56.129054 --- ParallelTerminationStrategy: PID 26043 died... 04:38:56.148776 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26043): Terminated: ok {rc=0} 04:38:56.237914 bus /gobi_4: Setting Powered False 04:38:57.338200 bus /gobi_4: Setting Powered False 04:38:58.458684 bus /gobi_1: Setting Powered False 04:38:59.558061 bus /gobi_1: Setting Powered False 04:39:00.674128 bus /gobi_0: Setting Powered False 04:39:01.776415 bus /gobi_0: Setting Powered False 04:39:02.898087 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:nanobts+band-1900 ping.py ---------------------------------------------- 04:39:04.002059 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:39:04.013593 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 04:39:04.055941 tst ping.py: using LAC 19127 04:39:04.170524 tst ping.py: using RAC 2 04:39:04.284422 tst ping.py: using CellId 19127 04:39:04.398307 tst ping.py: using BVCI 19128 04:39:04.505046 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:39:04.515609 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:39:04.526200 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:39:04.537074 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:39:04.547548 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:39:04.558203 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:39:04.568746 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:39:04.579312 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 04:39:04.692131 tst ping.py:19: start network... 04:39:04.889120 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:39:05.345605 run create_hlr_db(pid=26045): Launched 04:39:05.466395 bus /gobi_6: Setting Powered False 04:39:06.525563 run create_hlr_db(pid=26045): Terminated: ok {rc=0} 04:39:06.936074 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26047): Launched 04:39:07.230652 run osmo-hlr_10.42.42.2(pid=26048): Launched 04:39:07.342923 run osmo-stp_10.42.42.5: Starting osmo-stp 04:39:07.850275 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26050): Launched 04:39:08.146433 run osmo-stp_10.42.42.5(pid=26051): Launched 04:39:08.259362 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:39:08.767911 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26053): Launched 04:39:08.881528 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:39:09.131387 run patchelf(pid=26054): Launched 04:39:09.295585 run osmo-stp_10.42.42.5(pid=26051): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26051)] 04:39:09.420726 run osmo-stp_10.42.42.5(pid=26051): stdout: | (launched: 2022-12-09_04:39:08.091810) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:39:09.547293 run osmo-stp_10.42.42.5(pid=26051): stderr: | 20221209043908262 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043908262 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043908262 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043908262 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043908263 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043908263 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043908263 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:39:09.673713 run osmo-stp_10.42.42.5(pid=26051): stdout: | (launched: 2022-12-09_04:39:08.091810) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:39:09.794866 run osmo-stp_10.42.42.5(pid=26051): stderr: | 20221209043908262 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043908262 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043908262 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043908262 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043908263 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043908263 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043908263 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:39:09.938414 run patchelf(pid=26054): Terminating (SIGINT) 04:39:10.107021 run patchelf(pid=26054): Terminated: ok {rc=0} 04:39:10.227058 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=26051): Process ended prematurely: osmo-stp_10.42.42.5(pid=26051) [trial-2354↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26051)] [trial-2354↪gprs:nanobts+band-1900↪ping.py:22] 04:39:10.235983 tst ping.py:22: Test FAILED (6.2 sec) 04:39:10.262809 run osmo-hlr_10.42.42.2(pid=26048): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:nanobts+band-1900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26048)] 04:39:10.310455 run osmo-hlr_10.42.42.2(pid=26048): stdout: | (launched: 2022-12-09_04:39:07.176241) 04:39:10.359455 run osmo-hlr_10.42.42.2(pid=26048): stderr: | 20221209043907352 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209043907352 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209043907352 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209043907352 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209043907352 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209043907352 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209043907364 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:nanobts+band-1900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209043907373 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209043907373 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209043907373 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:39:10.408870 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26047): Terminating (SIGTERM) 04:39:10.448740 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26050): Terminating (SIGTERM) 04:39:10.488621 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26053): Terminating (SIGTERM) 04:39:10.528630 --- ParallelTerminationStrategy: PID 26047 died... 04:39:10.547833 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26047): Terminated: ok {rc=0} 04:39:10.592074 --- ParallelTerminationStrategy: PID 26050 died... 04:39:10.611550 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26050): Terminated: ok {rc=0} 04:39:10.655655 --- ParallelTerminationStrategy: PID 26053 died... 04:39:10.674599 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26053): Terminated: ok {rc=0} 04:39:10.760510 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:nanobts+band-1900 ping_idle_ping.py ---------------------------------------------- 04:39:11.850213 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:39:11.862148 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 04:39:11.902227 tst ping_idle_ping.py: using LAC 19128 04:39:12.019928 tst ping_idle_ping.py: using RAC 3 04:39:12.136212 tst ping_idle_ping.py: using CellId 19128 04:39:12.253377 tst ping_idle_ping.py: using BVCI 19129 04:39:12.360413 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:39:12.371069 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:39:12.381662 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:39:12.392162 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:39:12.402567 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:39:12.412900 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:39:12.423436 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:39:12.434036 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 04:39:12.552530 tst ping_idle_ping.py:24: start network... 04:39:12.766188 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:39:13.261284 run create_hlr_db(pid=26055): Launched 04:39:13.382870 bus /gobi_6: Setting Powered False 04:39:14.446271 run create_hlr_db(pid=26055): Terminated: ok {rc=0} 04:39:14.871346 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26057): Launched 04:39:15.167647 run osmo-hlr_10.42.42.2(pid=26058): Launched 04:39:15.280612 run osmo-stp_10.42.42.5: Starting osmo-stp 04:39:15.811673 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26060): Launched 04:39:16.131846 run osmo-stp_10.42.42.5(pid=26061): Launched 04:39:16.357795 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:39:16.917407 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26063): Launched 04:39:17.051793 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:39:17.327904 run patchelf(pid=26064): Launched 04:39:17.505362 run osmo-stp_10.42.42.5(pid=26061): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26061)] 04:39:17.639841 run osmo-stp_10.42.42.5(pid=26061): stdout: | (launched: 2022-12-09_04:39:16.069868) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:39:17.775947 run osmo-stp_10.42.42.5(pid=26061): stderr: | 20221209043916280 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043916280 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043916280 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043916280 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043916281 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043916281 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043916281 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:39:17.912092 run osmo-stp_10.42.42.5(pid=26061): stdout: | (launched: 2022-12-09_04:39:16.069868) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:39:18.042600 run osmo-stp_10.42.42.5(pid=26061): stderr: | 20221209043916280 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043916280 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043916280 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043916280 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043916281 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043916281 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043916281 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:39:18.198014 run patchelf(pid=26064): Terminating (SIGINT) 04:39:18.376798 run patchelf(pid=26064): Terminated: ok {rc=0} 04:39:18.505355 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=26061): Process ended prematurely: osmo-stp_10.42.42.5(pid=26061) [trial-2354↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26061)] [trial-2354↪gprs:nanobts+band-1900↪ping_idle_ping.py:27] 04:39:18.514852 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 04:39:18.543742 run osmo-hlr_10.42.42.2(pid=26058): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:nanobts+band-1900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26058)] 04:39:18.594674 run osmo-hlr_10.42.42.2(pid=26058): stdout: | (launched: 2022-12-09_04:39:15.113191) 04:39:18.647166 run osmo-hlr_10.42.42.2(pid=26058): stderr: | 20221209043915290 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209043915290 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209043915290 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209043915290 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209043915290 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209043915291 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209043915302 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:nanobts+band-1900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209043915311 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209043915312 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209043915312 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:39:18.700216 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26057): Terminating (SIGTERM) 04:39:18.742681 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26060): Terminating (SIGTERM) 04:39:18.785102 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26063): Terminating (SIGTERM) 04:39:18.828426 --- ParallelTerminationStrategy: PID 26057 died... 04:39:18.848443 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26057): Terminated: ok {rc=0} 04:39:18.895750 --- ParallelTerminationStrategy: PID 26060 died... 04:39:18.915498 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26060): Terminated: ok {rc=0} 04:39:18.962401 --- ParallelTerminationStrategy: PID 26063 died... 04:39:18.982175 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26063): Terminated: ok {rc=0} 04:39:19.071722 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2354 gprs:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 gprs:nanobts+band-1900+mod-bts0-egprs --------------------------------------------------------------------- 04:39:20.375496 tst gprs:nanobts+band-1900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:39:20.383046 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 04:39:20.407694 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 04:39:20.445734 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 04:39:20.529815 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 04:39:20.553132 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 04:39:20.590929 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 04:39:21.186887 tst gprs:nanobts+band-1900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2354 gprs:nanobts+band-1900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 04:39:21.234725 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:39:21.245603 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:39:21.284379 tst cs_paging_gprs_active.py: using LAC 19129 04:39:21.399814 tst cs_paging_gprs_active.py: using RAC 4 04:39:21.516215 tst cs_paging_gprs_active.py: using CellId 19129 04:39:21.632502 tst cs_paging_gprs_active.py: using BVCI 19130 04:39:21.740313 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:39:21.751201 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:39:21.761789 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:39:21.772368 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:39:21.782954 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:39:21.793639 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:39:21.804682 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:39:21.815178 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:39:21.826101 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:39:21.943752 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:39:22.064808 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 04:39:22.282893 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:39:22.605683 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26068): Launched 04:39:22.886208 run iperf3-srv_10.42.42.10(pid=26069): Launched 04:39:23.006910 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 04:39:23.223774 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:39:23.546485 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26070): Launched 04:39:23.826491 run iperf3-srv_10.42.42.10(pid=26071): Launched 04:39:23.946932 tst cs_paging_gprs_active.py:38: start network... 04:39:24.163591 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:39:24.662497 run create_hlr_db(pid=26072): Launched 04:39:24.785984 bus /gobi_6: Setting Powered False 04:39:25.849930 run create_hlr_db(pid=26072): Terminated: ok {rc=0} 04:39:26.280593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26074): Launched 04:39:26.581586 run osmo-hlr_10.42.42.2(pid=26075): Launched 04:39:26.696355 run osmo-stp_10.42.42.5: Starting osmo-stp 04:39:27.212139 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26077): Launched 04:39:27.512614 run osmo-stp_10.42.42.5(pid=26078): Launched 04:39:27.627779 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:39:28.160261 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26080): Launched 04:39:28.275716 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:39:28.529957 run patchelf(pid=26081): Launched 04:39:28.697358 run osmo-stp_10.42.42.5(pid=26078): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26078)] 04:39:28.824012 run osmo-stp_10.42.42.5(pid=26078): stdout: | (launched: 2022-12-09_04:39:27.457381) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:39:28.952138 run osmo-stp_10.42.42.5(pid=26078): stderr: | 20221209043927629 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043927629 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043927629 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043927630 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043927630 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043927630 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043927630 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:39:29.080415 run osmo-stp_10.42.42.5(pid=26078): stdout: | (launched: 2022-12-09_04:39:27.457381) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:39:29.203575 run osmo-stp_10.42.42.5(pid=26078): stderr: | 20221209043927629 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043927629 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043927629 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043927630 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043927630 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043927630 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043927630 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:39:29.349484 run patchelf(pid=26081): Terminating (SIGINT) 04:39:29.518918 run patchelf(pid=26081): Terminated: ok {rc=0} 04:39:29.640827 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=26078): Process ended prematurely: osmo-stp_10.42.42.5(pid=26078) [trial-2354↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26078)] [trial-2354↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 04:39:29.650362 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 04:39:29.677759 run osmo-hlr_10.42.42.2(pid=26075): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26075)] 04:39:29.725537 run osmo-hlr_10.42.42.2(pid=26075): stdout: | (launched: 2022-12-09_04:39:26.526275) 04:39:29.775056 run osmo-hlr_10.42.42.2(pid=26075): stderr: | 20221209043926705 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209043926705 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209043926705 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209043926705 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209043926705 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209043926705 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209043926717 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:nanobts+band-1900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209043926726 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209043926726 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209043926727 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:39:29.825259 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26068): Terminating (SIGTERM) 04:39:29.864978 run iperf3-srv_10.42.42.10(pid=26069): Terminating (SIGTERM) 04:39:29.904523 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26070): Terminating (SIGTERM) 04:39:29.944208 run iperf3-srv_10.42.42.10(pid=26071): Terminating (SIGTERM) 04:39:29.983916 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26074): Terminating (SIGTERM) 04:39:30.023624 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26077): Terminating (SIGTERM) 04:39:30.063242 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26080): Terminating (SIGTERM) 04:39:30.103166 --- ParallelTerminationStrategy: PID 26068 died... 04:39:30.122284 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26068): Terminated: ok {rc=0} 04:39:30.166723 --- ParallelTerminationStrategy: PID 26069 died... 04:39:30.185558 run iperf3-srv_10.42.42.10(pid=26069): Terminated {rc=256} 04:39:30.229597 --- ParallelTerminationStrategy: PID 26070 died... 04:39:30.248236 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26070): Terminated: ok {rc=0} 04:39:30.292026 --- ParallelTerminationStrategy: PID 26071 died... 04:39:30.310567 run iperf3-srv_10.42.42.10(pid=26071): Terminated {rc=256} 04:39:30.354285 --- ParallelTerminationStrategy: PID 26074 died... 04:39:30.372891 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26074): Terminated: ok {rc=0} 04:39:30.416536 --- ParallelTerminationStrategy: PID 26077 died... 04:39:30.435197 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26077): Terminated: ok {rc=0} 04:39:30.479256 --- ParallelTerminationStrategy: PID 26080 died... 04:39:30.498029 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26080): Terminated: ok {rc=0} 04:39:30.583682 bus /gobi_0: Setting Powered False 04:39:31.680863 bus /gobi_0: Setting Powered False 04:39:32.795422 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:nanobts+band-1900+mod-bts0-egprs iperf3.py ---------------------------------------------- 04:39:33.943955 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:39:33.956122 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:39:34.000794 tst iperf3.py: using LAC 19130 04:39:34.126645 tst iperf3.py: using RAC 5 04:39:34.254952 tst iperf3.py: using CellId 19130 04:39:34.385660 tst iperf3.py: using BVCI 19131 04:39:34.503887 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:39:34.515258 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:39:34.526557 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:39:34.538060 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:39:34.549413 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:39:34.560691 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:39:34.572267 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:39:34.583866 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:39:34.595549 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:39:34.715091 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 04:39:34.932499 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:39:35.255855 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26082): Launched 04:39:35.538009 run iperf3-srv_10.42.42.10(pid=26083): Launched 04:39:35.659669 tst iperf3.py:8: start network... 04:39:35.877153 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:39:36.378390 run create_hlr_db(pid=26084): Launched 04:39:36.501666 bus /gobi_6: Setting Powered False 04:39:37.565827 run create_hlr_db(pid=26084): Terminated: ok {rc=0} 04:39:38.015284 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26086): Launched 04:39:38.339267 run osmo-hlr_10.42.42.2(pid=26087): Launched 04:39:38.462984 run osmo-stp_10.42.42.5: Starting osmo-stp 04:39:39.018352 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26089): Launched 04:39:39.341874 run osmo-stp_10.42.42.5(pid=26090): Launched 04:39:39.466424 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:39:40.023022 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26092): Launched 04:39:40.146823 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:39:40.421315 run patchelf(pid=26093): Launched 04:39:40.601043 run osmo-stp_10.42.42.5(pid=26090): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26090)] 04:39:40.737308 run osmo-stp_10.42.42.5(pid=26090): stdout: | (launched: 2022-12-09_04:39:39.282496) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:39:40.875115 run osmo-stp_10.42.42.5(pid=26090): stderr: | 20221209043939476 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043939476 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043939477 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043939477 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043939478 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043939478 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043939478 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:39:41.013326 run osmo-stp_10.42.42.5(pid=26090): stdout: | (launched: 2022-12-09_04:39:39.282496) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:39:41.145360 run osmo-stp_10.42.42.5(pid=26090): stderr: | 20221209043939476 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043939476 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043939477 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043939477 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043939478 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043939478 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043939478 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:39:41.301959 run patchelf(pid=26093): Terminating (SIGINT) 04:39:41.483114 run patchelf(pid=26093): Terminated: ok {rc=0} 04:39:41.613896 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26090): Process ended prematurely: osmo-stp_10.42.42.5(pid=26090) [trial-2354↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26090)] [trial-2354↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8] 04:39:41.624073 tst iperf3.py:8: Test FAILED (7.7 sec) 04:39:41.653620 run osmo-hlr_10.42.42.2(pid=26087): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26087)] 04:39:41.704608 run osmo-hlr_10.42.42.2(pid=26087): stdout: | (launched: 2022-12-09_04:39:38.280134) 04:39:41.757486 run osmo-hlr_10.42.42.2(pid=26087): stderr: | 20221209043938480 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209043938480 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209043938480 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209043938480 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209043938480 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209043938480 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209043938494 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209043938503 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209043938503 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209043938503 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:39:41.810718 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26082): Terminating (SIGTERM) 04:39:41.853037 run iperf3-srv_10.42.42.10(pid=26083): Terminating (SIGTERM) 04:39:41.895696 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26086): Terminating (SIGTERM) 04:39:41.938180 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26089): Terminating (SIGTERM) 04:39:41.980501 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26092): Terminating (SIGTERM) 04:39:42.023360 --- ParallelTerminationStrategy: PID 26082 died... 04:39:42.043633 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26082): Terminated: ok {rc=0} 04:39:42.091175 --- ParallelTerminationStrategy: PID 26083 died... 04:39:42.110908 run iperf3-srv_10.42.42.10(pid=26083): Terminated {rc=256} 04:39:42.157706 --- ParallelTerminationStrategy: PID 26086 died... 04:39:42.177392 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26086): Terminated: ok {rc=0} 04:39:42.224483 --- ParallelTerminationStrategy: PID 26089 died... 04:39:42.244096 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26089): Terminated: ok {rc=0} 04:39:42.291395 --- ParallelTerminationStrategy: PID 26092 died... 04:39:42.311188 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26092): Terminated: ok {rc=0} 04:39:42.399485 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:nanobts+band-1900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 04:39:43.547184 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:39:43.558742 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:39:43.599767 tst iperf3m4.py: using LAC 19131 04:39:43.728236 tst iperf3m4.py: using RAC 6 04:39:43.854704 tst iperf3m4.py: using CellId 19131 04:39:43.981354 tst iperf3m4.py: using BVCI 19132 04:39:44.099431 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:39:44.111189 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:39:44.122859 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:39:44.134895 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:39:44.146737 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:39:44.158335 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:39:44.170149 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:39:44.181643 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:39:44.193112 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:39:44.313255 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:39:44.431162 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:39:44.549260 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:39:44.666932 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 04:39:44.868695 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:39:45.171125 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26094): Launched 04:39:45.435283 run iperf3-srv_10.42.42.10(pid=26095): Launched 04:39:45.549092 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 04:39:45.751072 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:39:46.098760 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26096): Launched 04:39:46.406916 run iperf3-srv_10.42.42.10(pid=26097): Launched 04:39:46.541438 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 04:39:46.769016 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:39:47.105923 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26098): Launched 04:39:47.397333 run iperf3-srv_10.42.42.10(pid=26099): Launched 04:39:47.518962 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 04:39:47.737169 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:39:48.061939 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26100): Launched 04:39:48.344574 run iperf3-srv_10.42.42.10(pid=26101): Launched 04:39:48.466376 tst iperf3m4.py:8: start network... 04:39:48.683866 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:39:49.186821 run create_hlr_db(pid=26102): Launched 04:39:49.310601 bus /gobi_6: Setting Powered False 04:39:50.375282 run create_hlr_db(pid=26102): Terminated: ok {rc=0} 04:39:50.824475 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26104): Launched 04:39:51.147753 run osmo-hlr_10.42.42.2(pid=26105): Launched 04:39:51.272109 run osmo-stp_10.42.42.5: Starting osmo-stp 04:39:51.831586 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26107): Launched 04:39:52.154505 run osmo-stp_10.42.42.5(pid=26108): Launched 04:39:52.278510 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:39:52.835086 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26110): Launched 04:39:52.960630 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:39:53.233959 run patchelf(pid=26111): Launched 04:39:53.413558 run osmo-stp_10.42.42.5(pid=26108): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26108)] 04:39:53.549897 run osmo-stp_10.42.42.5(pid=26108): stdout: | (launched: 2022-12-09_04:39:52.095170) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:39:53.687976 run osmo-stp_10.42.42.5(pid=26108): stderr: | 20221209043952288 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043952288 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043952288 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043952289 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043952289 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043952289 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043952289 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:39:53.826535 run osmo-stp_10.42.42.5(pid=26108): stdout: | (launched: 2022-12-09_04:39:52.095170) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:39:53.959174 run osmo-stp_10.42.42.5(pid=26108): stderr: | 20221209043952288 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209043952288 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209043952288 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209043952289 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209043952289 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209043952289 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209043952289 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:39:54.115964 run patchelf(pid=26111): Terminating (SIGINT) 04:39:54.298120 run patchelf(pid=26111): Terminated: ok {rc=0} 04:39:54.429433 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26108): Process ended prematurely: osmo-stp_10.42.42.5(pid=26108) [trial-2354↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26108)] [trial-2354↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8] 04:39:54.439594 tst iperf3m4.py:8: Test FAILED (10.9 sec) 04:39:54.469429 run osmo-hlr_10.42.42.2(pid=26105): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26105)] 04:39:54.520599 run osmo-hlr_10.42.42.2(pid=26105): stdout: | (launched: 2022-12-09_04:39:51.088356) 04:39:54.573655 run osmo-hlr_10.42.42.2(pid=26105): stderr: | 20221209043951288 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209043951288 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209043951288 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209043951288 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209043951288 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209043951288 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209043951299 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209043951308 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209043951308 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209043951308 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:39:54.627081 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26094): Terminating (SIGTERM) 04:39:54.669806 run iperf3-srv_10.42.42.10(pid=26095): Terminating (SIGTERM) 04:39:54.712271 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26096): Terminating (SIGTERM) 04:39:54.755147 run iperf3-srv_10.42.42.10(pid=26097): Terminating (SIGTERM) 04:39:54.797862 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26098): Terminating (SIGTERM) 04:39:54.840359 run iperf3-srv_10.42.42.10(pid=26099): Terminating (SIGTERM) 04:39:54.882905 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26100): Terminating (SIGTERM) 04:39:54.925532 run iperf3-srv_10.42.42.10(pid=26101): Terminating (SIGTERM) 04:39:54.967966 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26104): Terminating (SIGTERM) 04:39:55.010478 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26107): Terminating (SIGTERM) 04:39:55.052938 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26110): Terminating (SIGTERM) 04:39:55.095922 --- ParallelTerminationStrategy: PID 26094 died... 04:39:55.116161 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26094): Terminated: ok {rc=0} 04:39:55.163998 --- ParallelTerminationStrategy: PID 26095 died... 04:39:55.183689 run iperf3-srv_10.42.42.10(pid=26095): Terminated {rc=256} 04:39:55.231207 --- ParallelTerminationStrategy: PID 26096 died... 04:39:55.251088 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26096): Terminated: ok {rc=0} 04:39:55.298627 --- ParallelTerminationStrategy: PID 26097 died... 04:39:55.318706 run iperf3-srv_10.42.42.10(pid=26097): Terminated {rc=256} 04:39:55.365645 --- ParallelTerminationStrategy: PID 26098 died... 04:39:55.385509 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26098): Terminated: ok {rc=0} 04:39:55.432348 --- ParallelTerminationStrategy: PID 26099 died... 04:39:55.452187 run iperf3-srv_10.42.42.10(pid=26099): Terminated {rc=256} 04:39:55.498837 --- ParallelTerminationStrategy: PID 26100 died... 04:39:55.518575 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26100): Terminated: ok {rc=0} 04:39:55.565320 --- ParallelTerminationStrategy: PID 26101 died... 04:39:55.585022 run iperf3-srv_10.42.42.10(pid=26101): Terminated {rc=256} 04:39:55.631738 --- ParallelTerminationStrategy: PID 26104 died... 04:39:55.651472 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26104): Terminated: ok {rc=0} 04:39:55.698302 --- ParallelTerminationStrategy: PID 26107 died... 04:39:55.717974 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26107): Terminated: ok {rc=0} 04:39:55.764654 --- ParallelTerminationStrategy: PID 26110 died... 04:39:55.784454 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26110): Terminated: ok {rc=0} 04:39:55.872719 bus /gobi_4: Setting Powered False 04:39:56.973167 bus /gobi_4: Setting Powered False 04:39:58.089457 bus /gobi_1: Setting Powered False 04:39:59.187733 bus /gobi_1: Setting Powered False 04:40:00.305129 bus /gobi_0: Setting Powered False 04:40:01.401963 bus /gobi_0: Setting Powered False 04:40:02.520572 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:nanobts+band-1900+mod-bts0-egprs ping.py ---------------------------------------------- 04:40:03.625352 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:40:03.637489 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:40:03.679995 tst ping.py: using LAC 19132 04:40:03.805335 tst ping.py: using RAC 7 04:40:03.930406 tst ping.py: using CellId 19132 04:40:04.054141 tst ping.py: using BVCI 19133 04:40:04.171145 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:40:04.182577 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:40:04.193932 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:40:04.205513 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:40:04.217204 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:40:04.228500 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:40:04.240157 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:40:04.251605 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:40:04.369046 tst ping.py:19: start network... 04:40:04.567527 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:40:05.022888 run create_hlr_db(pid=26115): Launched 04:40:05.144184 bus /gobi_6: Setting Powered False 04:40:06.203232 run create_hlr_db(pid=26115): Terminated: ok {rc=0} 04:40:06.615651 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26117): Launched 04:40:06.910857 run osmo-hlr_10.42.42.2(pid=26118): Launched 04:40:07.022859 run osmo-stp_10.42.42.5: Starting osmo-stp 04:40:07.531062 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26120): Launched 04:40:07.826083 run osmo-stp_10.42.42.5(pid=26121): Launched 04:40:07.938701 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:40:08.447799 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26123): Launched 04:40:08.562065 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:40:08.811769 run patchelf(pid=26124): Launched 04:40:08.976232 run osmo-stp_10.42.42.5(pid=26121): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26121)] 04:40:09.101233 run osmo-stp_10.42.42.5(pid=26121): stdout: | (launched: 2022-12-09_04:40:07.771325) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:40:09.227672 run osmo-stp_10.42.42.5(pid=26121): stderr: | 20221209044007942 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044007943 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044007943 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044007943 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044007944 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044007944 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044007944 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:40:09.354009 run osmo-stp_10.42.42.5(pid=26121): stdout: | (launched: 2022-12-09_04:40:07.771325) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:40:09.475073 run osmo-stp_10.42.42.5(pid=26121): stderr: | 20221209044007942 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044007943 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044007943 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044007943 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044007944 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044007944 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044007944 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:40:09.618518 run patchelf(pid=26124): Terminating (SIGINT) 04:40:09.785591 run patchelf(pid=26124): Terminated: ok {rc=0} 04:40:09.905560 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=26121): Process ended prematurely: osmo-stp_10.42.42.5(pid=26121) [trial-2354↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26121)] [trial-2354↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22] 04:40:09.914366 tst ping.py:22: Test FAILED (6.3 sec) 04:40:09.941420 run osmo-hlr_10.42.42.2(pid=26118): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26118)] 04:40:09.989148 run osmo-hlr_10.42.42.2(pid=26118): stdout: | (launched: 2022-12-09_04:40:06.856154) 04:40:10.038211 run osmo-hlr_10.42.42.2(pid=26118): stderr: | 20221209044007032 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209044007032 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209044007032 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209044007032 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209044007032 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209044007032 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209044007045 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:nanobts+band-1900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209044007053 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209044007053 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209044007053 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:40:10.088051 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26117): Terminating (SIGTERM) 04:40:10.127593 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26120): Terminating (SIGTERM) 04:40:10.167128 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26123): Terminating (SIGTERM) 04:40:10.207164 --- ParallelTerminationStrategy: PID 26117 died... 04:40:10.226332 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26117): Terminated: ok {rc=0} 04:40:10.270502 --- ParallelTerminationStrategy: PID 26120 died... 04:40:10.289033 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26120): Terminated: ok {rc=0} 04:40:10.332882 --- ParallelTerminationStrategy: PID 26123 died... 04:40:10.351600 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26123): Terminated: ok {rc=0} 04:40:10.437079 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:nanobts+band-1900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 04:40:11.526091 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:40:11.538070 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:40:11.580056 tst ping_idle_ping.py: using LAC 19133 04:40:11.697981 tst ping_idle_ping.py: using RAC 8 04:40:11.814247 tst ping_idle_ping.py: using CellId 19133 04:40:11.932391 tst ping_idle_ping.py: using BVCI 19134 04:40:12.039704 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:40:12.050748 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:40:12.061474 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:40:12.072205 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:40:12.082907 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:40:12.093632 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:40:12.104433 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:40:12.115199 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:40:12.233704 tst ping_idle_ping.py:24: start network... 04:40:12.447764 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:40:12.946849 run create_hlr_db(pid=26125): Launched 04:40:13.067945 bus /gobi_6: Setting Powered False 04:40:14.131997 run create_hlr_db(pid=26125): Terminated: ok {rc=0} 04:40:14.575621 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26127): Launched 04:40:14.893196 run osmo-hlr_10.42.42.2(pid=26128): Launched 04:40:15.015568 run osmo-stp_10.42.42.5: Starting osmo-stp 04:40:15.566282 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26130): Launched 04:40:15.905316 run osmo-stp_10.42.42.5(pid=26131): Launched 04:40:16.148369 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:40:16.835764 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26133): Launched 04:40:16.962192 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:40:17.217160 run patchelf(pid=26134): Launched 04:40:17.381305 run osmo-stp_10.42.42.5(pid=26131): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26131)] 04:40:17.506353 run osmo-stp_10.42.42.5(pid=26131): stdout: | (launched: 2022-12-09_04:40:15.825333) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:40:17.633134 run osmo-stp_10.42.42.5(pid=26131): stderr: | 20221209044016174 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044016174 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044016174 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044016175 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044016175 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044016175 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044016175 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:40:17.759568 run osmo-stp_10.42.42.5(pid=26131): stdout: | (launched: 2022-12-09_04:40:15.825333) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:40:17.880761 run osmo-stp_10.42.42.5(pid=26131): stderr: | 20221209044016174 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044016174 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044016174 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044016175 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044016175 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044016175 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044016175 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:40:18.023846 run patchelf(pid=26134): Terminating (SIGINT) 04:40:18.190268 run patchelf(pid=26134): Terminated: ok {rc=0} 04:40:18.310552 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=26131): Process ended prematurely: osmo-stp_10.42.42.5(pid=26131) [trial-2354↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26131)] [trial-2354↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27] 04:40:18.319191 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 04:40:18.346074 run osmo-hlr_10.42.42.2(pid=26128): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26128)] 04:40:18.393806 run osmo-hlr_10.42.42.2(pid=26128): stdout: | (launched: 2022-12-09_04:40:14.834899) 04:40:18.443110 run osmo-hlr_10.42.42.2(pid=26128): stderr: | 20221209044015032 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209044015032 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209044015032 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209044015032 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209044015032 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209044015032 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209044015045 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:nanobts+band-1900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209044015053 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209044015053 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209044015053 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:40:18.492841 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26127): Terminating (SIGTERM) 04:40:18.532453 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26130): Terminating (SIGTERM) 04:40:18.572398 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26133): Terminating (SIGTERM) 04:40:18.612193 --- ParallelTerminationStrategy: PID 26127 died... 04:40:18.631240 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26127): Terminated: ok {rc=0} 04:40:18.675280 --- ParallelTerminationStrategy: PID 26130 died... 04:40:18.693835 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26130): Terminated: ok {rc=0} 04:40:18.737466 --- ParallelTerminationStrategy: PID 26133 died... 04:40:18.756043 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26133): Terminated: ok {rc=0} 04:40:18.839912 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2354 gprs:nanobts+band-1900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 gprs:nanobts+band-1900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 04:40:20.129673 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:40:20.136409 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 04:40:20.159748 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 04:40:20.197559 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 04:40:20.282800 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 04:40:20.306004 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 04:40:20.343432 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 04:40:20.939832 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2354 gprs:nanobts+band-1900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 04:40:20.987824 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:40:20.998686 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:40:21.057331 tst cs_paging_gprs_active.py: using LAC 19134 04:40:21.174359 tst cs_paging_gprs_active.py: using RAC 9 04:40:21.293599 tst cs_paging_gprs_active.py: using CellId 19134 04:40:21.413285 tst cs_paging_gprs_active.py: using BVCI 19135 04:40:21.523142 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:40:21.534163 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:40:21.544741 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:40:21.555500 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:40:21.566255 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:40:21.577009 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:40:21.587844 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:40:21.598431 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:40:21.609303 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:40:21.728183 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:40:21.848254 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 04:40:22.065374 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:40:22.389575 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26139): Launched 04:40:22.672026 run iperf3-srv_10.42.42.10(pid=26140): Launched 04:40:22.792835 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 04:40:23.009399 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:40:23.334652 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26141): Launched 04:40:23.614887 run iperf3-srv_10.42.42.10(pid=26142): Launched 04:40:23.735798 tst cs_paging_gprs_active.py:38: start network... 04:40:23.952133 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:40:24.450423 run create_hlr_db(pid=26143): Launched 04:40:24.572812 bus /gobi_6: Setting Powered False 04:40:25.636684 run create_hlr_db(pid=26143): Terminated: ok {rc=0} 04:40:26.064826 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26145): Launched 04:40:26.366922 run osmo-hlr_10.42.42.2(pid=26146): Launched 04:40:26.481903 run osmo-stp_10.42.42.5: Starting osmo-stp 04:40:27.001055 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26148): Launched 04:40:27.301913 run osmo-stp_10.42.42.5(pid=26149): Launched 04:40:27.416175 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:40:27.934310 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26151): Launched 04:40:28.049176 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:40:28.303178 run patchelf(pid=26152): Launched 04:40:28.470784 run osmo-stp_10.42.42.5(pid=26149): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26149)] 04:40:28.598099 run osmo-stp_10.42.42.5(pid=26149): stdout: | (launched: 2022-12-09_04:40:27.246143) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:40:28.727711 run osmo-stp_10.42.42.5(pid=26149): stderr: | 20221209044027417 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044027417 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044027417 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044027418 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044027418 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044027418 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044027418 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:40:28.856476 run osmo-stp_10.42.42.5(pid=26149): stdout: | (launched: 2022-12-09_04:40:27.246143) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:40:28.979601 run osmo-stp_10.42.42.5(pid=26149): stderr: | 20221209044027417 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044027417 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044027417 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044027418 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044027418 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044027418 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044027418 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:40:29.125538 run patchelf(pid=26152): Terminating (SIGINT) 04:40:29.295340 run patchelf(pid=26152): Terminated: ok {rc=0} 04:40:29.417454 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=26149): Process ended prematurely: osmo-stp_10.42.42.5(pid=26149) [trial-2354↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26149)] [trial-2354↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 04:40:29.426832 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 04:40:29.454120 run osmo-hlr_10.42.42.2(pid=26146): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26146)] 04:40:29.501682 run osmo-hlr_10.42.42.2(pid=26146): stdout: | (launched: 2022-12-09_04:40:26.311063) 04:40:29.551091 run osmo-hlr_10.42.42.2(pid=26146): stderr: | 20221209044026487 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209044026487 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209044026487 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209044026488 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209044026488 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209044026488 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209044026500 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209044026509 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209044026509 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209044026509 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:40:29.600810 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26139): Terminating (SIGTERM) 04:40:29.640576 run iperf3-srv_10.42.42.10(pid=26140): Terminating (SIGTERM) 04:40:29.680145 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26141): Terminating (SIGTERM) 04:40:29.719775 run iperf3-srv_10.42.42.10(pid=26142): Terminating (SIGTERM) 04:40:29.759374 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26145): Terminating (SIGTERM) 04:40:29.799281 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26148): Terminating (SIGTERM) 04:40:29.839006 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26151): Terminating (SIGTERM) 04:40:29.879059 --- ParallelTerminationStrategy: PID 26139 died... 04:40:29.898369 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26139): Terminated: ok {rc=0} 04:40:29.942552 --- ParallelTerminationStrategy: PID 26140 died... 04:40:29.961205 run iperf3-srv_10.42.42.10(pid=26140): Terminated {rc=256} 04:40:30.005362 --- ParallelTerminationStrategy: PID 26141 died... 04:40:30.024007 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26141): Terminated: ok {rc=0} 04:40:30.068772 --- ParallelTerminationStrategy: PID 26142 died... 04:40:30.087466 run iperf3-srv_10.42.42.10(pid=26142): Terminated {rc=256} 04:40:30.131384 --- ParallelTerminationStrategy: PID 26145 died... 04:40:30.150110 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26145): Terminated: ok {rc=0} 04:40:30.194006 --- ParallelTerminationStrategy: PID 26148 died... 04:40:30.212745 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26148): Terminated: ok {rc=0} 04:40:30.256652 --- ParallelTerminationStrategy: PID 26151 died... 04:40:30.275344 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26151): Terminated: ok {rc=0} 04:40:30.359758 bus /gobi_0: Setting Powered False 04:40:31.455670 bus /gobi_0: Setting Powered False 04:40:32.580852 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 04:40:33.726704 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:40:33.738183 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:40:33.799391 tst iperf3.py: using LAC 19135 04:40:33.918741 tst iperf3.py: using RAC 10 04:40:34.040753 tst iperf3.py: using CellId 19135 04:40:34.158326 tst iperf3.py: using BVCI 19136 04:40:34.268097 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:40:34.278972 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:40:34.289710 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:40:34.300432 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:40:34.311203 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:40:34.321919 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:40:34.332662 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:40:34.343325 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:40:34.354256 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:40:34.470569 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 04:40:34.672458 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:40:34.974152 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26153): Launched 04:40:35.236545 run iperf3-srv_10.42.42.10(pid=26154): Launched 04:40:35.349406 tst iperf3.py:8: start network... 04:40:35.549658 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:40:36.017226 run create_hlr_db(pid=26155): Launched 04:40:36.142095 bus /gobi_6: Setting Powered False 04:40:37.206077 run create_hlr_db(pid=26155): Terminated: ok {rc=0} 04:40:37.654744 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26157): Launched 04:40:37.975758 run osmo-hlr_10.42.42.2(pid=26158): Launched 04:40:38.099375 run osmo-stp_10.42.42.5: Starting osmo-stp 04:40:38.657237 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26160): Launched 04:40:38.979383 run osmo-stp_10.42.42.5(pid=26161): Launched 04:40:39.102944 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:40:39.658841 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26163): Launched 04:40:39.782591 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:40:40.055487 run patchelf(pid=26164): Launched 04:40:40.235414 run osmo-stp_10.42.42.5(pid=26161): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26161)] 04:40:40.371966 run osmo-stp_10.42.42.5(pid=26161): stdout: | (launched: 2022-12-09_04:40:38.920340) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:40:40.509755 run osmo-stp_10.42.42.5(pid=26161): stderr: | 20221209044039112 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044039112 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044039112 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044039113 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044039113 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044039113 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044039113 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:40:40.647730 run osmo-stp_10.42.42.5(pid=26161): stdout: | (launched: 2022-12-09_04:40:38.920340) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:40:40.779925 run osmo-stp_10.42.42.5(pid=26161): stderr: | 20221209044039112 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044039112 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044039112 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044039113 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044039113 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044039113 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044039113 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:40:40.936124 run patchelf(pid=26164): Terminating (SIGINT) 04:40:41.117792 run patchelf(pid=26164): Terminated: ok {rc=0} 04:40:41.248780 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26161): Process ended prematurely: osmo-stp_10.42.42.5(pid=26161) [trial-2354↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26161)] [trial-2354↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8] 04:40:41.259196 tst iperf3.py:8: Test FAILED (7.6 sec) 04:40:41.288673 run osmo-hlr_10.42.42.2(pid=26158): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26158)] 04:40:41.339371 run osmo-hlr_10.42.42.2(pid=26158): stdout: | (launched: 2022-12-09_04:40:37.917295) 04:40:41.391897 run osmo-hlr_10.42.42.2(pid=26158): stderr: | 20221209044038115 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209044038115 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209044038115 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209044038115 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209044038115 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209044038115 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209044038127 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209044038135 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209044038136 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209044038136 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:40:41.444709 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26153): Terminating (SIGTERM) 04:40:41.487035 run iperf3-srv_10.42.42.10(pid=26154): Terminating (SIGTERM) 04:40:41.530573 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26157): Terminating (SIGTERM) 04:40:41.573283 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26160): Terminating (SIGTERM) 04:40:41.615506 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26163): Terminating (SIGTERM) 04:40:41.658032 --- ParallelTerminationStrategy: PID 26153 died... 04:40:41.678102 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26153): Terminated: ok {rc=0} 04:40:41.725111 --- ParallelTerminationStrategy: PID 26154 died... 04:40:41.744746 run iperf3-srv_10.42.42.10(pid=26154): Terminated {rc=256} 04:40:41.791529 --- ParallelTerminationStrategy: PID 26157 died... 04:40:41.811308 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26157): Terminated: ok {rc=0} 04:40:41.857965 --- ParallelTerminationStrategy: PID 26160 died... 04:40:41.877693 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26160): Terminated: ok {rc=0} 04:40:41.926123 --- ParallelTerminationStrategy: PID 26163 died... 04:40:41.946656 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26163): Terminated: ok {rc=0} 04:40:42.035665 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 04:40:43.182870 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:40:43.194594 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:40:43.255509 tst iperf3m4.py: using LAC 19136 04:40:43.373741 tst iperf3m4.py: using RAC 11 04:40:43.491056 tst iperf3m4.py: using CellId 19136 04:40:43.608269 tst iperf3m4.py: using BVCI 19137 04:40:43.718326 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:40:43.729365 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:40:43.740061 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:40:43.750871 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:40:43.761548 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:40:43.772200 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:40:43.783102 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:40:43.793748 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:40:43.804511 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:40:43.923622 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:40:44.042448 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:40:44.156825 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:40:44.276826 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 04:40:44.478294 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:40:44.780780 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26165): Launched 04:40:45.043569 run iperf3-srv_10.42.42.10(pid=26166): Launched 04:40:45.157017 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 04:40:45.356404 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:40:45.657475 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26167): Launched 04:40:45.941543 run iperf3-srv_10.42.42.10(pid=26168): Launched 04:40:46.086208 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 04:40:46.311076 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:40:46.649258 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26169): Launched 04:40:46.948446 run iperf3-srv_10.42.42.10(pid=26170): Launched 04:40:47.087575 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 04:40:47.307185 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:40:47.630626 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26171): Launched 04:40:47.910704 run iperf3-srv_10.42.42.10(pid=26172): Launched 04:40:48.031444 tst iperf3m4.py:8: start network... 04:40:48.247673 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:40:48.745736 run create_hlr_db(pid=26173): Launched 04:40:48.870223 bus /gobi_6: Setting Powered False 04:40:49.934482 run create_hlr_db(pid=26173): Terminated: ok {rc=0} 04:40:50.384059 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26175): Launched 04:40:50.706784 run osmo-hlr_10.42.42.2(pid=26176): Launched 04:40:50.829435 run osmo-stp_10.42.42.5: Starting osmo-stp 04:40:51.388887 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26178): Launched 04:40:51.710792 run osmo-stp_10.42.42.5(pid=26179): Launched 04:40:51.833168 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:40:52.387883 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26181): Launched 04:40:52.511200 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:40:52.784273 run patchelf(pid=26182): Launched 04:40:52.963452 run osmo-stp_10.42.42.5(pid=26179): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26179)] 04:40:53.099821 run osmo-stp_10.42.42.5(pid=26179): stdout: | (launched: 2022-12-09_04:40:51.651659) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:40:53.238725 run osmo-stp_10.42.42.5(pid=26179): stderr: | 20221209044051844 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044051845 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044051845 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044051845 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044051846 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044051846 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044051846 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:40:53.376743 run osmo-stp_10.42.42.5(pid=26179): stdout: | (launched: 2022-12-09_04:40:51.651659) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:40:53.508903 run osmo-stp_10.42.42.5(pid=26179): stderr: | 20221209044051844 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044051845 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044051845 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044051845 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044051846 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044051846 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044051846 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:40:53.665762 run patchelf(pid=26182): Terminating (SIGINT) 04:40:53.846630 run patchelf(pid=26182): Terminated: ok {rc=0} 04:40:53.977618 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26179): Process ended prematurely: osmo-stp_10.42.42.5(pid=26179) [trial-2354↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26179)] [trial-2354↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 04:40:53.987841 tst iperf3m4.py:8: Test FAILED (10.8 sec) 04:40:54.017526 run osmo-hlr_10.42.42.2(pid=26176): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26176)] 04:40:54.068938 run osmo-hlr_10.42.42.2(pid=26176): stdout: | (launched: 2022-12-09_04:40:50.647503) 04:40:54.121881 run osmo-hlr_10.42.42.2(pid=26176): stderr: | 20221209044050848 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209044050849 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209044050849 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209044050849 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209044050849 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209044050849 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209044050865 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209044050875 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209044050875 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209044050875 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:40:54.174993 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26165): Terminating (SIGTERM) 04:40:54.218147 run iperf3-srv_10.42.42.10(pid=26166): Terminating (SIGTERM) 04:40:54.261159 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26167): Terminating (SIGTERM) 04:40:54.303639 run iperf3-srv_10.42.42.10(pid=26168): Terminating (SIGTERM) 04:40:54.346139 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26169): Terminating (SIGTERM) 04:40:54.388564 run iperf3-srv_10.42.42.10(pid=26170): Terminating (SIGTERM) 04:40:54.431047 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26171): Terminating (SIGTERM) 04:40:54.473549 run iperf3-srv_10.42.42.10(pid=26172): Terminating (SIGTERM) 04:40:54.516387 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26175): Terminating (SIGTERM) 04:40:54.559036 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26178): Terminating (SIGTERM) 04:40:54.601511 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26181): Terminating (SIGTERM) 04:40:54.644376 --- ParallelTerminationStrategy: PID 26165 died... 04:40:54.664613 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26165): Terminated: ok {rc=0} 04:40:54.711800 --- ParallelTerminationStrategy: PID 26166 died... 04:40:54.731582 run iperf3-srv_10.42.42.10(pid=26166): Terminated {rc=256} 04:40:54.778600 --- ParallelTerminationStrategy: PID 26167 died... 04:40:54.798391 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26167): Terminated: ok {rc=0} 04:40:54.845451 --- ParallelTerminationStrategy: PID 26168 died... 04:40:54.865406 run iperf3-srv_10.42.42.10(pid=26168): Terminated {rc=256} 04:40:54.912141 --- ParallelTerminationStrategy: PID 26169 died... 04:40:54.932001 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26169): Terminated: ok {rc=0} 04:40:54.979090 --- ParallelTerminationStrategy: PID 26170 died... 04:40:54.998852 run iperf3-srv_10.42.42.10(pid=26170): Terminated {rc=256} 04:40:55.045474 --- ParallelTerminationStrategy: PID 26171 died... 04:40:55.065223 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26171): Terminated: ok {rc=0} 04:40:55.112177 --- ParallelTerminationStrategy: PID 26172 died... 04:40:55.131888 run iperf3-srv_10.42.42.10(pid=26172): Terminated {rc=256} 04:40:55.178486 --- ParallelTerminationStrategy: PID 26175 died... 04:40:55.198239 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26175): Terminated: ok {rc=0} 04:40:55.245323 --- ParallelTerminationStrategy: PID 26178 died... 04:40:55.264756 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26178): Terminated: ok {rc=0} 04:40:55.312162 --- ParallelTerminationStrategy: PID 26181 died... 04:40:55.331977 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26181): Terminated: ok {rc=0} 04:40:55.420034 bus /gobi_4: Setting Powered False 04:40:56.520552 bus /gobi_4: Setting Powered False 04:40:57.637311 bus /gobi_1: Setting Powered False 04:40:58.737390 bus /gobi_1: Setting Powered False 04:40:59.851645 bus /gobi_0: Setting Powered False 04:41:00.960467 bus /gobi_0: Setting Powered False 04:41:02.091246 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 04:41:03.200038 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:41:03.212544 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:41:03.275654 tst ping.py: using LAC 19137 04:41:03.399229 tst ping.py: using RAC 12 04:41:03.527465 tst ping.py: using CellId 19137 04:41:03.651447 tst ping.py: using BVCI 19138 04:41:03.766211 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:41:03.777699 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:41:03.788876 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:41:03.800397 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:41:03.811793 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:41:03.823161 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:41:03.834640 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:41:03.846183 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:41:03.961256 tst ping.py:19: start network... 04:41:04.159621 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:41:04.618089 run create_hlr_db(pid=26183): Launched 04:41:04.738579 bus /gobi_6: Setting Powered False 04:41:05.798544 run create_hlr_db(pid=26183): Terminated: ok {rc=0} 04:41:06.212649 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26185): Launched 04:41:06.508417 run osmo-hlr_10.42.42.2(pid=26186): Launched 04:41:06.621353 run osmo-stp_10.42.42.5: Starting osmo-stp 04:41:07.148411 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26188): Launched 04:41:07.442978 run osmo-stp_10.42.42.5(pid=26189): Launched 04:41:07.556687 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:41:08.077137 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26191): Launched 04:41:08.190172 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:41:08.438148 run patchelf(pid=26192): Launched 04:41:08.601285 run osmo-stp_10.42.42.5(pid=26189): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26189)] 04:41:08.725344 run osmo-stp_10.42.42.5(pid=26189): stdout: | (launched: 2022-12-09_04:41:07.388310) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:41:08.850748 run osmo-stp_10.42.42.5(pid=26189): stderr: | 20221209044107556 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044107556 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044107557 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044107557 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044107558 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044107558 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044107558 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:41:08.976725 run osmo-stp_10.42.42.5(pid=26189): stdout: | (launched: 2022-12-09_04:41:07.388310) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:41:09.096628 run osmo-stp_10.42.42.5(pid=26189): stderr: | 20221209044107556 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044107556 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044107557 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044107557 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044107558 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044107558 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044107558 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:41:09.238647 run patchelf(pid=26192): Terminating (SIGINT) 04:41:09.403960 run patchelf(pid=26192): Terminated: ok {rc=0} 04:41:09.523382 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=26189): Process ended prematurely: osmo-stp_10.42.42.5(pid=26189) [trial-2354↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26189)] [trial-2354↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22] 04:41:09.532205 tst ping.py:22: Test FAILED (6.3 sec) 04:41:09.558906 run osmo-hlr_10.42.42.2(pid=26186): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26186)] 04:41:09.606255 run osmo-hlr_10.42.42.2(pid=26186): stdout: | (launched: 2022-12-09_04:41:06.453880) 04:41:09.655439 run osmo-hlr_10.42.42.2(pid=26186): stderr: | 20221209044106630 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209044106630 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209044106630 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209044106630 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209044106630 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209044106630 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209044106642 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209044106651 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209044106652 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209044106652 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:41:09.704931 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26185): Terminating (SIGTERM) 04:41:09.744217 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26188): Terminating (SIGTERM) 04:41:09.783253 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26191): Terminating (SIGTERM) 04:41:09.822845 --- ParallelTerminationStrategy: PID 26185 died... 04:41:09.841888 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26185): Terminated: ok {rc=0} 04:41:09.885609 --- ParallelTerminationStrategy: PID 26188 died... 04:41:09.904055 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26188): Terminated: ok {rc=0} 04:41:09.947585 --- ParallelTerminationStrategy: PID 26191 died... 04:41:09.966178 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26191): Terminated: ok {rc=0} 04:41:10.049525 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 04:41:11.134943 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:41:11.147523 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:41:11.210600 tst ping_idle_ping.py: using LAC 19138 04:41:11.335142 tst ping_idle_ping.py: using RAC 13 04:41:11.459909 tst ping_idle_ping.py: using CellId 19138 04:41:11.584581 tst ping_idle_ping.py: using BVCI 19139 04:41:11.700879 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:41:11.712330 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:41:11.723650 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:41:11.735116 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:41:11.746435 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:41:11.757760 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:41:11.769398 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:41:11.780708 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:41:11.894914 tst ping_idle_ping.py:24: start network... 04:41:12.091012 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:41:12.549254 run create_hlr_db(pid=26193): Launched 04:41:12.670302 bus /gobi_6: Setting Powered False 04:41:13.729467 run create_hlr_db(pid=26193): Terminated: ok {rc=0} 04:41:14.162988 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26195): Launched 04:41:14.480191 run osmo-hlr_10.42.42.2(pid=26196): Launched 04:41:14.602679 run osmo-stp_10.42.42.5: Starting osmo-stp 04:41:15.151277 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26198): Launched 04:41:15.468144 run osmo-stp_10.42.42.5(pid=26199): Launched 04:41:15.590260 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:41:16.162158 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26201): Launched 04:41:16.290347 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:41:16.550528 run patchelf(pid=26202): Launched 04:41:16.735955 run osmo-stp_10.42.42.5(pid=26199): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26199)] 04:41:16.865081 run osmo-stp_10.42.42.5(pid=26199): stdout: | (launched: 2022-12-09_04:41:15.409927) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:41:16.994673 run osmo-stp_10.42.42.5(pid=26199): stderr: | 20221209044115601 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044115601 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044115601 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044115602 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044115602 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044115602 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044115602 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:41:17.125593 run osmo-stp_10.42.42.5(pid=26199): stdout: | (launched: 2022-12-09_04:41:15.409927) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:41:17.248179 run osmo-stp_10.42.42.5(pid=26199): stderr: | 20221209044115601 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044115601 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044115601 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044115602 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044115602 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044115602 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044115602 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:41:17.392694 run patchelf(pid=26202): Terminating (SIGINT) 04:41:17.559729 run patchelf(pid=26202): Terminated: ok {rc=0} 04:41:17.680363 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=26199): Process ended prematurely: osmo-stp_10.42.42.5(pid=26199) [trial-2354↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26199)] [trial-2354↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 04:41:17.689319 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 04:41:17.717230 run osmo-hlr_10.42.42.2(pid=26196): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26196)] 04:41:17.765683 run osmo-hlr_10.42.42.2(pid=26196): stdout: | (launched: 2022-12-09_04:41:14.422253) 04:41:17.816157 run osmo-hlr_10.42.42.2(pid=26196): stderr: | 20221209044114619 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209044114619 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209044114619 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209044114619 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209044114619 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209044114619 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209044114631 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209044114639 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209044114639 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209044114639 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:41:17.867055 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26195): Terminating (SIGTERM) 04:41:17.907418 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26198): Terminating (SIGTERM) 04:41:17.947955 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26201): Terminating (SIGTERM) 04:41:17.988408 --- ParallelTerminationStrategy: PID 26195 died... 04:41:18.007656 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26195): Terminated: ok {rc=0} 04:41:18.052920 --- ParallelTerminationStrategy: PID 26198 died... 04:41:18.071787 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26198): Terminated: ok {rc=0} 04:41:18.117016 --- ParallelTerminationStrategy: PID 26201 died... 04:41:18.135721 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26201): Terminated: ok {rc=0} 04:41:18.222718 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2354 gprs:nanobts+band-1900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 04:41:19.515224 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:41:19.522996 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 04:41:19.550381 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 04:41:19.585503 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 04:41:19.639336 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 04:41:19.663467 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 04:41:19.698802 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 04:41:20.261739 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2354 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 04:41:20.266948 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:41:20.278884 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 04:41:20.340844 tst switch_tch_pdch.py: using LAC 19139 04:41:20.464926 tst switch_tch_pdch.py: using RAC 14 04:41:20.589699 tst switch_tch_pdch.py: using CellId 19139 04:41:20.713241 tst switch_tch_pdch.py: using BVCI 19140 04:41:20.828030 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:41:20.839970 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:41:20.851873 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:41:20.863873 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:41:20.875905 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:41:20.887855 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:41:20.899975 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:41:20.912104 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:41:21.027452 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:41:21.149037 tst switch_tch_pdch.py:51: start network... 04:41:21.362928 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:41:21.851628 run create_hlr_db(pid=26206): Launched 04:41:21.972096 bus /gobi_6: Setting Powered False 04:41:23.035128 run create_hlr_db(pid=26206): Terminated: ok {rc=0} 04:41:23.458042 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26208): Launched 04:41:23.752688 run osmo-hlr_10.42.42.2(pid=26209): Launched 04:41:23.865269 run osmo-stp_10.42.42.5: Starting osmo-stp 04:41:24.371635 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26211): Launched 04:41:24.666374 run osmo-stp_10.42.42.5(pid=26212): Launched 04:41:24.778254 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:41:25.287887 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26214): Launched 04:41:25.400315 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:41:25.648866 run patchelf(pid=26215): Launched 04:41:25.812781 run osmo-stp_10.42.42.5(pid=26212): ERR: Terminated: ERROR {rc=1} [trial-2354↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26212)] 04:41:25.936942 run osmo-stp_10.42.42.5(pid=26212): stdout: | (launched: 2022-12-09_04:41:24.611105) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:41:26.062951 run osmo-stp_10.42.42.5(pid=26212): stderr: | 20221209044124781 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044124782 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044124782 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044124782 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044124784 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044124785 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044124785 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:41:26.188476 run osmo-stp_10.42.42.5(pid=26212): stdout: | (launched: 2022-12-09_04:41:24.611105) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:41:26.309229 run osmo-stp_10.42.42.5(pid=26212): stderr: | 20221209044124781 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044124782 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044124782 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044124782 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044124784 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044124785 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044124785 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:41:26.452298 run patchelf(pid=26215): Terminating (SIGINT) 04:41:26.618324 run patchelf(pid=26215): Terminated: ok {rc=0} 04:41:26.737823 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=26212): Process ended prematurely: osmo-stp_10.42.42.5(pid=26212) [trial-2354↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26212)] [trial-2354↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 04:41:26.746658 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 04:41:26.773291 run osmo-hlr_10.42.42.2(pid=26209): ERR: Terminated: ERROR {rc=237} [trial-2354↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26209)] 04:41:26.820537 run osmo-hlr_10.42.42.2(pid=26209): stdout: | (launched: 2022-12-09_04:41:23.697942) 04:41:26.869754 run osmo-hlr_10.42.42.2(pid=26209): stderr: | 20221209044123873 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209044123873 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209044123873 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209044123873 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209044123873 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209044123873 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209044123886 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209044123896 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209044123896 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209044123896 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:41:26.919593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26208): Terminating (SIGTERM) 04:41:26.959258 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26211): Terminating (SIGTERM) 04:41:26.998756 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26214): Terminating (SIGTERM) 04:41:27.038668 --- ParallelTerminationStrategy: PID 26208 died... 04:41:27.057731 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26208): Terminated: ok {rc=0} 04:41:27.102060 --- ParallelTerminationStrategy: PID 26211 died... 04:41:27.120995 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26211): Terminated: ok {rc=0} 04:41:27.164493 --- ParallelTerminationStrategy: PID 26214 died... 04:41:27.183089 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26214): Terminated: ok {rc=0} 04:41:27.268655 bus /gobi_0: Setting Powered False 04:41:28.367654 bus /gobi_0: Setting Powered False 04:41:29.483511 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2354 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 sms:nanobts+band-900 --------------------------------------------------------------------- 04:41:30.727083 tst sms:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:41:30.731679 tst sms:nanobts+band-900: Verifying 1 x bts (candidates: 11) 04:41:30.763271 tst sms:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 04:41:30.789452 tst sms:nanobts+band-900: Verifying 2 x modem (candidates: 12) 04:41:30.859988 tst sms:nanobts+band-900: Reserving 1 x bts (candidates: 11) 04:41:30.896577 tst sms:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 04:41:30.923612 tst sms:nanobts+band-900: Reserving 2 x modem (candidates: 12) 04:41:31.461146 tst sms:nanobts+band-900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 sms:nanobts+band-900 mo_mt_sms.py ---------------------------------------------- 04:41:31.466687 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 04:41:31.478277 tst sms:nanobts+band-900: Using 1 x bts (candidates: 1) 04:41:31.524885 tst mo_mt_sms.py: using LAC 19140 04:41:31.642224 tst mo_mt_sms.py: using RAC 15 04:41:31.780428 tst mo_mt_sms.py: using CellId 19140 04:41:31.927303 tst mo_mt_sms.py: using BVCI 19141 04:41:32.085626 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 04:41:32.101312 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 04:41:32.118298 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 04:41:32.135390 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 04:41:32.152365 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 04:41:32.169782 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 04:41:32.299061 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 04:41:32.419736 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:41:32.909605 run create_hlr_db(pid=26220): Launched 04:41:33.030482 bus /gobi_6: Setting Powered False 04:41:34.093604 run create_hlr_db(pid=26220): Terminated: ok {rc=0} 04:41:34.516215 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26222): Launched 04:41:34.835220 run osmo-hlr_10.42.42.2(pid=26223): Launched 04:41:34.956048 run osmo-stp_10.42.42.5: Starting osmo-stp 04:41:35.502116 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26225): Launched 04:41:35.818830 run osmo-stp_10.42.42.5(pid=26226): Launched 04:41:35.940496 run osmo-msc_10.42.42.6: Starting osmo-msc 04:41:36.514071 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26228): Launched 04:41:36.831811 run osmo-msc_10.42.42.6(pid=26229): Launched 04:41:37.009686 run osmo-stp_10.42.42.5(pid=26226): ERR: Terminated: ERROR {rc=1} [trial-2354↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26226)] 04:41:37.144244 run osmo-stp_10.42.42.5(pid=26226): stdout: | (launched: 2022-12-09_04:41:35.760267) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:41:37.280381 run osmo-stp_10.42.42.5(pid=26226): stderr: | 20221209044135950 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044135950 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044135950 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044135951 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044135951 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044135951 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044135951 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:41:37.415295 run osmo-stp_10.42.42.5(pid=26226): stdout: | (launched: 2022-12-09_04:41:35.760267) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:41:37.541760 run osmo-stp_10.42.42.5(pid=26226): stderr: | 20221209044135950 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044135950 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044135950 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044135951 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044135951 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044135951 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044135951 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:41:37.692573 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=26226): Process ended prematurely: osmo-stp_10.42.42.5(pid=26226) [trial-2354↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26226)] [trial-2354↪sms:nanobts+band-900↪mo_mt_sms.py:16] 04:41:37.701800 tst mo_mt_sms.py:16: Test FAILED (6.2 sec) 04:41:37.730231 run osmo-hlr_10.42.42.2(pid=26223): ERR: Terminated: ERROR {rc=237} [trial-2354↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26223)] 04:41:37.781119 run osmo-hlr_10.42.42.2(pid=26223): stdout: | (launched: 2022-12-09_04:41:34.776770) 04:41:37.833652 run osmo-hlr_10.42.42.2(pid=26223): stderr: | 20221209044134972 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209044134972 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209044134972 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209044134972 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209044134972 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209044134972 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209044134984 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/sms:nanobts+band-900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209044134993 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209044134993 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209044134993 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:41:37.906627 run osmo-msc_10.42.42.6(pid=26229): ERR: Terminated: ERROR {rc=2} [trial-2354↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26229)] 04:41:37.957268 run osmo-msc_10.42.42.6(pid=26229): stdout: | (launched: 2022-12-09_04:41:36.773108) 04:41:38.009505 run osmo-msc_10.42.42.6(pid=26229): stderr: | 20221209044137094 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209044137094 DLGLOBAL DEBUG validating counter group 0x7f5ca4110c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209044137094 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209044137094 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209044137094 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209044137095 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209044137096 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209044137097 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209044137097 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209044137097 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:41:38.062381 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26222): Terminating (SIGTERM) 04:41:38.104767 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26225): Terminating (SIGTERM) 04:41:38.147536 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26228): Terminating (SIGTERM) 04:41:38.190441 --- ParallelTerminationStrategy: PID 26222 died... 04:41:38.210766 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26222): Terminated: ok {rc=0} 04:41:38.258179 --- ParallelTerminationStrategy: PID 26225 died... 04:41:38.278409 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26225): Terminated: ok {rc=0} 04:41:38.325559 --- ParallelTerminationStrategy: PID 26228 died... 04:41:38.345358 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26228): Terminated: ok {rc=0} 04:41:38.434798 bus /sierra_3: Setting Powered False 04:41:39.534822 bus /sierra_3: Setting Powered False 04:41:40.653544 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 sms:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 nitb_ussd:nanobts+band-900 --------------------------------------------------------------------- 04:41:41.885267 tst nitb_ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:41:41.890184 tst nitb_ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 04:41:41.921890 tst nitb_ussd:nanobts+band-900: Verifying 1 x ip_address (candidates: 9) 04:41:41.928429 tst nitb_ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 04:41:41.964408 tst nitb_ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 04:41:41.998159 tst nitb_ussd:nanobts+band-900: Reserving 1 x ip_address (candidates: 9) 04:41:42.005204 tst nitb_ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 04:41:42.521296 tst nitb_ussd:nanobts+band-900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2354 nitb_ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 04:41:42.527289 tst nitb_ussd:nanobts+band-900: Using 1 x ip_address (candidates: 1) 04:41:42.538583 tst nitb_ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 04:41:42.587337 tst assert_extension.py: using LAC 19141 04:41:42.702918 tst assert_extension.py: using RAC 16 04:41:42.816716 tst assert_extension.py: using CellId 19141 04:41:42.930580 tst assert_extension.py: using BVCI 19142 04:41:43.036334 tst nitb_ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 04:41:43.150957 tst assert_extension.py:10: start nitb and bts... 04:41:43.364892 run osmo-nitb_10.42.42.2: Starting osmo-nitb 04:41:44.009077 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26234): Launched 04:41:44.326152 run osmo-nitb_10.42.42.2(pid=26235): Launched 04:41:44.502382 run osmo-nitb_10.42.42.2(pid=26235): ERR: Terminated: ERROR {rc=2} [trial-2354↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26235)] 04:41:44.644666 run osmo-nitb_10.42.42.2(pid=26235): stdout: | (launched: 2022-12-09_04:41:44.268108) 04:41:44.788498 run osmo-nitb_10.42.42.2(pid=26235): stderr: | (launched: 2022-12-09_04:41:44.315267) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:41:44.932274 run osmo-nitb_10.42.42.2(pid=26235): stdout: | (launched: 2022-12-09_04:41:44.268108) 04:41:45.070611 run osmo-nitb_10.42.42.2(pid=26235): stderr: | (launched: 2022-12-09_04:41:44.315267) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f4d467d3268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=26235): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26235) [trial-2354↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26235)] 04:41:45.445891 tst osmo-nitb_10.42.42.2(pid=26235): stdout: | (launched: 2022-12-09_04:41:44.268108) 04:41:45.574229 tst osmo-nitb_10.42.42.2(pid=26235): stderr: | (launched: 2022-12-09_04:41:44.315267) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:41:45.724854 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=26235): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26235) [trial-2354↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26235)] [trial-2354↪nitb_ussd:nanobts+band-900↪assert_extension.py:12] 04:41:45.733847 tst assert_extension.py:12: Test FAILED (3.2 sec) 04:41:45.740631 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26234): Terminating (SIGTERM) 04:41:45.951971 --- ParallelTerminationStrategy: PID 26234 died... 04:41:45.972152 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26234): Terminated: ok {rc=0} 04:41:46.064096 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 nitb_ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 ussd:nanobts+band-900 --------------------------------------------------------------------- 04:41:47.252198 tst ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:41:47.258440 tst ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 04:41:47.292731 tst ussd:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 04:41:47.320189 tst ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 04:41:47.356819 tst ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 04:41:47.388502 tst ussd:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 04:41:47.414690 tst ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 04:41:47.946495 tst ussd:nanobts+band-900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2354 ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 04:41:47.951655 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 04:41:47.962783 tst ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 04:41:48.010978 tst assert_extension.py: using LAC 19142 04:41:48.128120 tst assert_extension.py: using RAC 17 04:41:48.245031 tst assert_extension.py: using CellId 19142 04:41:48.361253 tst assert_extension.py: using BVCI 19143 04:41:48.467956 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 04:41:48.478685 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 04:41:48.489189 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 04:41:48.499597 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 04:41:48.510276 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 04:41:48.520713 tst ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 04:41:48.636501 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:41:49.126694 run create_hlr_db(pid=26240): Launched 04:41:49.247715 bus /sierra_2: Setting Powered False 04:41:50.310519 run create_hlr_db(pid=26240): Terminated: ok {rc=0} 04:41:50.734616 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26242): Launched 04:41:51.030035 run osmo-hlr_10.42.42.2(pid=26243): Launched 04:41:51.142820 run osmo-stp_10.42.42.5: Starting osmo-stp 04:41:51.657499 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26245): Launched 04:41:51.953330 run osmo-stp_10.42.42.5(pid=26246): Launched 04:41:52.065270 run osmo-msc_10.42.42.6: Starting osmo-msc 04:41:52.596522 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26248): Launched 04:41:52.891541 run osmo-msc_10.42.42.6(pid=26249): Launched 04:41:53.056638 run osmo-stp_10.42.42.5(pid=26246): ERR: Terminated: ERROR {rc=1} [trial-2354↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26246)] 04:41:53.180889 run osmo-stp_10.42.42.5(pid=26246): stdout: | (launched: 2022-12-09_04:41:51.897492) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:41:53.306638 run osmo-stp_10.42.42.5(pid=26246): stderr: | 20221209044152068 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044152068 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044152069 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044152069 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044152070 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044152070 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044152070 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:41:53.430165 run osmo-stp_10.42.42.5(pid=26246): stdout: | (launched: 2022-12-09_04:41:51.897492) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:41:53.547129 run osmo-stp_10.42.42.5(pid=26246): stderr: | 20221209044152068 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044152068 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044152069 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044152069 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044152070 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044152070 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044152070 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:41:53.687251 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=26246): Process ended prematurely: osmo-stp_10.42.42.5(pid=26246) [trial-2354↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26246)] [trial-2354↪ussd:nanobts+band-900↪assert_extension.py:17] 04:41:53.695720 tst assert_extension.py:17: Test FAILED (5.7 sec) 04:41:53.721898 run osmo-hlr_10.42.42.2(pid=26243): ERR: Terminated: ERROR {rc=237} [trial-2354↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26243)] 04:41:53.769924 run osmo-hlr_10.42.42.2(pid=26243): stdout: | (launched: 2022-12-09_04:41:50.975494) 04:41:53.819979 run osmo-hlr_10.42.42.2(pid=26243): stderr: | 20221209044151148 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209044151148 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209044151148 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209044151148 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209044151148 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209044151148 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209044151161 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/ussd:nanobts+band-900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209044151169 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209044151170 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209044151170 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:41:53.889413 run osmo-msc_10.42.42.6(pid=26249): ERR: Terminated: ERROR {rc=2} [trial-2354↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26249)] 04:41:53.937212 run osmo-msc_10.42.42.6(pid=26249): stdout: | (launched: 2022-12-09_04:41:52.837126) 04:41:53.986687 run osmo-msc_10.42.42.6(pid=26249): stderr: | 20221209044153109 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209044153109 DLGLOBAL DEBUG validating counter group 0x7f7da4f9ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209044153109 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209044153109 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209044153109 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209044153109 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209044153111 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209044153111 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209044153111 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209044153112 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:41:54.036682 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26242): Terminating (SIGTERM) 04:41:54.076551 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26245): Terminating (SIGTERM) 04:41:54.116378 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26248): Terminating (SIGTERM) 04:41:54.156522 --- ParallelTerminationStrategy: PID 26242 died... 04:41:54.175617 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26242): Terminated: ok {rc=0} 04:41:54.220218 --- ParallelTerminationStrategy: PID 26245 died... 04:41:54.239137 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26245): Terminated: ok {rc=0} 04:41:54.283228 --- ParallelTerminationStrategy: PID 26248 died... 04:41:54.302013 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26248): Terminated: ok {rc=0} 04:41:54.385913 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 04:41:55.596372 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:41:55.603726 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 04:41:55.635357 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 04:41:55.661584 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 04:41:55.711221 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 04:41:55.742770 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 04:41:55.768909 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 04:41:56.325775 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 04:41:56.380359 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:41:56.392112 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 04:41:56.459996 tst mo_mt_call.py: using LAC 19143 04:41:56.588682 tst mo_mt_call.py: using RAC 18 04:41:56.714608 tst mo_mt_call.py: using CellId 19143 04:41:56.838761 tst mo_mt_call.py: using BVCI 19144 04:41:56.955262 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:41:56.966828 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:41:56.978225 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:41:56.990478 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:41:57.003459 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:41:57.014902 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 04:41:57.131899 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 04:41:57.250124 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:41:57.750204 run create_hlr_db(pid=26254): Launched 04:41:57.872637 bus /sierra_2: Setting Powered False 04:41:58.936571 run create_hlr_db(pid=26254): Terminated: ok {rc=0} 04:41:59.366508 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26256): Launched 04:41:59.665913 run osmo-hlr_10.42.42.2(pid=26257): Launched 04:41:59.779659 run osmo-stp_10.42.42.5: Starting osmo-stp 04:42:00.294773 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26259): Launched 04:42:00.594717 run osmo-stp_10.42.42.5(pid=26260): Launched 04:42:00.709277 run osmo-msc_10.42.42.6: Starting osmo-msc 04:42:01.372617 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26267): Launched 04:42:01.719776 run osmo-msc_10.42.42.6(pid=26268): Launched 04:42:02.021531 run osmo-stp_10.42.42.5(pid=26260): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26260)] 04:42:02.206465 run osmo-stp_10.42.42.5(pid=26260): stdout: | (launched: 2022-12-09_04:42:00.539170) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:42:02.388297 run osmo-stp_10.42.42.5(pid=26260): stderr: | 20221209044200710 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044200710 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044200710 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044200711 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044200713 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044200713 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044200713 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:42:02.526510 run osmo-stp_10.42.42.5(pid=26260): stdout: | (launched: 2022-12-09_04:42:00.539170) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:42:02.655562 run osmo-stp_10.42.42.5(pid=26260): stderr: | 20221209044200710 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044200710 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044200710 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044200711 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044200713 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044200713 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044200713 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:42:02.809312 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26260): Process ended prematurely: osmo-stp_10.42.42.5(pid=26260) [trial-2354↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26260)] [trial-2354↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 04:42:02.819064 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 04:42:02.848179 run osmo-hlr_10.42.42.2(pid=26257): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26257)] 04:42:02.899275 run osmo-hlr_10.42.42.2(pid=26257): stdout: | (launched: 2022-12-09_04:41:59.610494) 04:42:02.952044 run osmo-hlr_10.42.42.2(pid=26257): stderr: | 20221209044159787 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209044159787 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209044159787 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209044159787 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209044159787 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209044159787 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209044159833 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209044159842 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209044159842 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209044159842 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:42:03.025839 run osmo-msc_10.42.42.6(pid=26268): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26268)] 04:42:03.077109 run osmo-msc_10.42.42.6(pid=26268): stdout: | (launched: 2022-12-09_04:42:01.655895) 04:42:03.129989 run osmo-msc_10.42.42.6(pid=26268): stderr: | 20221209044202235 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209044202235 DLGLOBAL DEBUG validating counter group 0x7efd4b93cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209044202235 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209044202235 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209044202236 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209044202236 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209044202239 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209044202240 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209044202240 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209044202240 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:42:03.183228 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26256): Terminating (SIGTERM) 04:42:03.225990 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26259): Terminating (SIGTERM) 04:42:03.268680 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26267): Terminating (SIGTERM) 04:42:03.312125 --- ParallelTerminationStrategy: PID 26256 died... 04:42:03.332584 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26256): Terminated: ok {rc=0} 04:42:03.379902 --- ParallelTerminationStrategy: PID 26259 died... 04:42:03.399900 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26259): Terminated: ok {rc=0} 04:42:03.447199 --- ParallelTerminationStrategy: PID 26267 died... 04:42:03.467051 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26267): Terminated: ok {rc=0} 04:42:03.556099 bus /sierra_3: Setting Powered False 04:42:04.655833 bus /sierra_3: Setting Powered False 04:42:05.773079 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2354 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 04:42:06.921660 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:42:06.933835 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 04:42:07.002022 tst mo_mt_call_osmux.py: using LAC 19144 04:42:07.129463 tst mo_mt_call_osmux.py: using RAC 19 04:42:07.258671 tst mo_mt_call_osmux.py: using CellId 19144 04:42:07.386678 tst mo_mt_call_osmux.py: using BVCI 19145 04:42:07.503881 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:42:07.515405 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:42:07.526733 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:42:07.538413 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:42:07.550141 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:42:07.561783 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 04:42:07.678606 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 04:42:07.798089 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:42:08.299953 run create_hlr_db(pid=26270): Launched 04:42:08.423222 bus /sierra_2: Setting Powered False 04:42:09.487796 run create_hlr_db(pid=26270): Terminated: ok {rc=0} 04:42:09.917695 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26272): Launched 04:42:10.218682 run osmo-hlr_10.42.42.2(pid=26273): Launched 04:42:10.334993 run osmo-stp_10.42.42.5: Starting osmo-stp 04:42:10.868822 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26275): Launched 04:42:11.170792 run osmo-stp_10.42.42.5(pid=26276): Launched 04:42:11.285275 run osmo-msc_10.42.42.6: Starting osmo-msc 04:42:11.828372 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26278): Launched 04:42:12.130526 run osmo-msc_10.42.42.6(pid=26279): Launched 04:42:12.299045 run osmo-stp_10.42.42.5(pid=26276): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26276)] 04:42:12.427819 run osmo-stp_10.42.42.5(pid=26276): stdout: | (launched: 2022-12-09_04:42:11.115047) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:42:12.555116 run osmo-stp_10.42.42.5(pid=26276): stderr: | 20221209044211287 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044211287 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044211288 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044211288 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044211288 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044211289 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044211289 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:42:12.680384 run osmo-stp_10.42.42.5(pid=26276): stdout: | (launched: 2022-12-09_04:42:11.115047) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:42:12.799992 run osmo-stp_10.42.42.5(pid=26276): stderr: | 20221209044211287 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044211287 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044211288 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044211288 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044211288 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044211289 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044211289 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:42:12.943211 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26276): Process ended prematurely: osmo-stp_10.42.42.5(pid=26276) [trial-2354↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26276)] [trial-2354↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 04:42:12.952032 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 04:42:12.978631 run osmo-hlr_10.42.42.2(pid=26273): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26273)] 04:42:13.026442 run osmo-hlr_10.42.42.2(pid=26273): stdout: | (launched: 2022-12-09_04:42:10.163249) 04:42:13.075885 run osmo-hlr_10.42.42.2(pid=26273): stderr: | 20221209044210341 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209044210341 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209044210341 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209044210341 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209044210341 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209044210341 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209044210353 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209044210362 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209044210362 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209044210363 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:42:13.145349 run osmo-msc_10.42.42.6(pid=26279): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26279)] 04:42:13.193278 run osmo-msc_10.42.42.6(pid=26279): stdout: | (launched: 2022-12-09_04:42:12.074551) 04:42:13.242354 run osmo-msc_10.42.42.6(pid=26279): stderr: | 20221209044212348 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209044212348 DLGLOBAL DEBUG validating counter group 0x7fa561661c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209044212348 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209044212348 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209044212348 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209044212350 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209044212351 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209044212352 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209044212352 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209044212352 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:42:13.291903 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26272): Terminating (SIGTERM) 04:42:13.331595 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26275): Terminating (SIGTERM) 04:42:13.371188 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26278): Terminating (SIGTERM) 04:42:13.411013 --- ParallelTerminationStrategy: PID 26272 died... 04:42:13.430235 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26272): Terminated: ok {rc=0} 04:42:13.474874 --- ParallelTerminationStrategy: PID 26275 died... 04:42:13.493597 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26275): Terminated: ok {rc=0} 04:42:13.537495 --- ParallelTerminationStrategy: PID 26278 died... 04:42:13.556239 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26278): Terminated: ok {rc=0} 04:42:13.641687 bus /sierra_3: Setting Powered False 04:42:14.741512 bus /sierra_3: Setting Powered False 04:42:15.864908 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 04:42:17.134965 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:42:17.143258 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 04:42:17.179585 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 04:42:17.208849 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 04:42:17.264500 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 04:42:17.299550 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 04:42:17.327355 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 04:42:17.875139 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 04:42:17.928172 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:42:17.939942 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 04:42:18.010647 tst mo_mt_call.py: using LAC 19145 04:42:18.138366 tst mo_mt_call.py: using RAC 20 04:42:18.269720 tst mo_mt_call.py: using CellId 19145 04:42:18.396662 tst mo_mt_call.py: using BVCI 19146 04:42:18.513058 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:42:18.524715 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:42:18.536412 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:42:18.548749 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:42:18.561596 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:42:18.574636 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 04:42:18.692167 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 04:42:18.806593 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:42:19.271520 run create_hlr_db(pid=26284): Launched 04:42:19.395349 bus /sierra_2: Setting Powered False 04:42:20.455193 run create_hlr_db(pid=26284): Terminated: ok {rc=0} 04:42:20.873262 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26286): Launched 04:42:21.172073 run osmo-hlr_10.42.42.2(pid=26287): Launched 04:42:21.285366 run osmo-stp_10.42.42.5: Starting osmo-stp 04:42:21.802229 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26289): Launched 04:42:22.102354 run osmo-stp_10.42.42.5(pid=26290): Launched 04:42:22.216093 run osmo-msc_10.42.42.6: Starting osmo-msc 04:42:22.758949 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26292): Launched 04:42:23.058565 run osmo-msc_10.42.42.6(pid=26293): Launched 04:42:23.226751 run osmo-stp_10.42.42.5(pid=26290): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26290)] 04:42:23.353788 run osmo-stp_10.42.42.5(pid=26290): stdout: | (launched: 2022-12-09_04:42:22.047100) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:42:23.480628 run osmo-stp_10.42.42.5(pid=26290): stderr: | 20221209044222218 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044222218 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044222218 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044222218 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044222221 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044222221 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044222221 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:42:23.606487 run osmo-stp_10.42.42.5(pid=26290): stdout: | (launched: 2022-12-09_04:42:22.047100) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:42:23.725945 run osmo-stp_10.42.42.5(pid=26290): stderr: | 20221209044222218 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044222218 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044222218 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044222218 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044222221 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044222221 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044222221 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:42:23.868873 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26290): Process ended prematurely: osmo-stp_10.42.42.5(pid=26290) [trial-2354↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26290)] [trial-2354↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 04:42:23.877947 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 04:42:23.904632 run osmo-hlr_10.42.42.2(pid=26287): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26287)] 04:42:23.952404 run osmo-hlr_10.42.42.2(pid=26287): stdout: | (launched: 2022-12-09_04:42:21.117117) 04:42:24.002451 run osmo-hlr_10.42.42.2(pid=26287): stderr: | 20221209044221293 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209044221293 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209044221293 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209044221293 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209044221293 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209044221293 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209044221330 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209044221341 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209044221342 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209044221342 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:42:24.071916 run osmo-msc_10.42.42.6(pid=26293): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26293)] 04:42:24.119786 run osmo-msc_10.42.42.6(pid=26293): stdout: | (launched: 2022-12-09_04:42:23.003353) 04:42:24.169084 run osmo-msc_10.42.42.6(pid=26293): stderr: | 20221209044223273 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209044223273 DLGLOBAL DEBUG validating counter group 0x7f2b63c45c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209044223273 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209044223273 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209044223274 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209044223274 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209044223277 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209044223277 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209044223277 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209044223277 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:42:24.218741 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26286): Terminating (SIGTERM) 04:42:24.258544 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26289): Terminating (SIGTERM) 04:42:24.298364 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26292): Terminating (SIGTERM) 04:42:24.338437 --- ParallelTerminationStrategy: PID 26286 died... 04:42:24.357651 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26286): Terminated: ok {rc=0} 04:42:24.402098 --- ParallelTerminationStrategy: PID 26289 died... 04:42:24.420643 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26289): Terminated: ok {rc=0} 04:42:24.464818 --- ParallelTerminationStrategy: PID 26292 died... 04:42:24.483495 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26292): Terminated: ok {rc=0} 04:42:24.569897 bus /sierra_3: Setting Powered False 04:42:25.671336 bus /sierra_3: Setting Powered False 04:42:26.787642 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2354 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 04:42:27.934025 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:42:27.945738 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 04:42:28.011758 tst mo_mt_call_osmux.py: using LAC 19146 04:42:28.134717 tst mo_mt_call_osmux.py: using RAC 21 04:42:28.251614 tst mo_mt_call_osmux.py: using CellId 19146 04:42:28.367862 tst mo_mt_call_osmux.py: using BVCI 19147 04:42:28.476033 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:42:28.487055 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:42:28.497963 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:42:28.508753 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:42:28.519651 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:42:28.530447 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 04:42:28.648665 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 04:42:28.765588 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:42:29.229237 run create_hlr_db(pid=26295): Launched 04:42:29.352521 bus /sierra_2: Setting Powered False 04:42:30.412767 run create_hlr_db(pid=26295): Terminated: ok {rc=0} 04:42:30.867739 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26297): Launched 04:42:31.211913 run osmo-hlr_10.42.42.2(pid=26298): Launched 04:42:31.454154 run osmo-stp_10.42.42.5: Starting osmo-stp 04:42:32.093540 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26300): Launched 04:42:32.411090 run osmo-stp_10.42.42.5(pid=26301): Launched 04:42:32.525926 run osmo-msc_10.42.42.6: Starting osmo-msc 04:42:33.084067 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26303): Launched 04:42:33.384185 run osmo-msc_10.42.42.6(pid=26304): Launched 04:42:33.551930 run osmo-stp_10.42.42.5(pid=26301): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26301)] 04:42:33.679740 run osmo-stp_10.42.42.5(pid=26301): stdout: | (launched: 2022-12-09_04:42:32.355626) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:42:33.806731 run osmo-stp_10.42.42.5(pid=26301): stderr: | 20221209044232526 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044232526 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044232526 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044232527 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044232527 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044232527 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044232527 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:42:33.931468 run osmo-stp_10.42.42.5(pid=26301): stdout: | (launched: 2022-12-09_04:42:32.355626) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:42:34.051210 run osmo-stp_10.42.42.5(pid=26301): stderr: | 20221209044232526 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044232526 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044232526 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044232527 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044232527 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044232527 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044232527 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:42:34.194681 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26301): Process ended prematurely: osmo-stp_10.42.42.5(pid=26301) [trial-2354↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26301)] [trial-2354↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 04:42:34.203505 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 04:42:34.229953 run osmo-hlr_10.42.42.2(pid=26298): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26298)] 04:42:34.277636 run osmo-hlr_10.42.42.2(pid=26298): stdout: | (launched: 2022-12-09_04:42:31.151325) 04:42:34.326983 run osmo-hlr_10.42.42.2(pid=26298): stderr: | 20221209044231462 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209044231462 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209044231462 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209044231462 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209044231462 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209044231463 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209044231483 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209044231495 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209044231495 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209044231495 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:42:34.396128 run osmo-msc_10.42.42.6(pid=26304): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26304)] 04:42:34.443797 run osmo-msc_10.42.42.6(pid=26304): stdout: | (launched: 2022-12-09_04:42:33.328607) 04:42:34.492912 run osmo-msc_10.42.42.6(pid=26304): stderr: | 20221209044233603 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209044233603 DLGLOBAL DEBUG validating counter group 0x7fa6b46cec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209044233603 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209044233603 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209044233603 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209044233603 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209044233605 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209044233606 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209044233606 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209044233606 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:42:34.542499 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26297): Terminating (SIGTERM) 04:42:34.582034 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26300): Terminating (SIGTERM) 04:42:34.621500 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26303): Terminating (SIGTERM) 04:42:34.661525 --- ParallelTerminationStrategy: PID 26297 died... 04:42:34.680214 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26297): Terminated: ok {rc=0} 04:42:34.723851 --- ParallelTerminationStrategy: PID 26300 died... 04:42:34.742516 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26300): Terminated: ok {rc=0} 04:42:34.786073 --- ParallelTerminationStrategy: PID 26303 died... 04:42:34.804577 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26303): Terminated: ok {rc=0} 04:42:34.888288 bus /sierra_3: Setting Powered False 04:42:35.986730 bus /sierra_3: Setting Powered False 04:42:37.104360 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 04:42:38.351245 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:42:38.358778 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 04:42:38.390564 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 04:42:38.416736 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 04:42:38.467973 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 04:42:38.499556 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 04:42:38.525649 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 04:42:39.077936 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 04:42:39.132429 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:42:39.144169 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 04:42:39.212304 tst mo_mt_call.py: using LAC 19147 04:42:39.342654 tst mo_mt_call.py: using RAC 22 04:42:39.468284 tst mo_mt_call.py: using CellId 19147 04:42:39.591814 tst mo_mt_call.py: using BVCI 19148 04:42:39.709455 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:42:39.720918 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:42:39.732520 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:42:39.744255 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:42:39.756013 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:42:39.767732 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 04:42:39.883410 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 04:42:39.999097 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:42:40.465931 run create_hlr_db(pid=26309): Launched 04:42:40.588369 bus /sierra_2: Setting Powered False 04:42:41.649195 run create_hlr_db(pid=26309): Terminated: ok {rc=0} 04:42:42.090996 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26311): Launched 04:42:42.414652 run osmo-hlr_10.42.42.2(pid=26312): Launched 04:42:42.538070 run osmo-stp_10.42.42.5: Starting osmo-stp 04:42:43.093321 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26314): Launched 04:42:43.416395 run osmo-stp_10.42.42.5(pid=26315): Launched 04:42:43.539031 run osmo-msc_10.42.42.6: Starting osmo-msc 04:42:44.121720 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26317): Launched 04:42:44.444905 run osmo-msc_10.42.42.6(pid=26318): Launched 04:42:44.624745 run osmo-stp_10.42.42.5(pid=26315): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26315)] 04:42:44.761567 run osmo-stp_10.42.42.5(pid=26315): stdout: | (launched: 2022-12-09_04:42:43.357339) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:42:44.898399 run osmo-stp_10.42.42.5(pid=26315): stderr: | 20221209044243548 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044243548 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044243549 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044243549 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044243549 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044243549 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044243550 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:42:45.034091 run osmo-stp_10.42.42.5(pid=26315): stdout: | (launched: 2022-12-09_04:42:43.357339) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:42:45.162469 run osmo-stp_10.42.42.5(pid=26315): stderr: | 20221209044243548 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044243548 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044243549 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044243549 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044243549 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044243549 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044243550 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:42:45.316604 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26315): Process ended prematurely: osmo-stp_10.42.42.5(pid=26315) [trial-2354↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26315)] [trial-2354↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 04:42:45.326207 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 04:42:45.355045 run osmo-hlr_10.42.42.2(pid=26312): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26312)] 04:42:45.405781 run osmo-hlr_10.42.42.2(pid=26312): stdout: | (launched: 2022-12-09_04:42:42.355686) 04:42:45.458314 run osmo-hlr_10.42.42.2(pid=26312): stderr: | 20221209044242552 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209044242552 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209044242552 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209044242552 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209044242552 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209044242552 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209044242564 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209044242572 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209044242573 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209044242573 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:42:45.531717 run osmo-msc_10.42.42.6(pid=26318): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26318)] 04:42:45.582648 run osmo-msc_10.42.42.6(pid=26318): stdout: | (launched: 2022-12-09_04:42:44.385570) 04:42:45.635198 run osmo-msc_10.42.42.6(pid=26318): stderr: | 20221209044244708 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209044244708 DLGLOBAL DEBUG validating counter group 0x7f069765ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209044244708 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209044244708 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209044244708 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209044244709 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209044244710 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209044244711 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209044244711 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209044244711 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:42:45.688286 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26311): Terminating (SIGTERM) 04:42:45.731010 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26314): Terminating (SIGTERM) 04:42:45.773439 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26317): Terminating (SIGTERM) 04:42:45.816029 --- ParallelTerminationStrategy: PID 26311 died... 04:42:45.845107 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26311): Terminated: ok {rc=0} 04:42:45.900411 --- ParallelTerminationStrategy: PID 26314 died... 04:42:45.920769 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26314): Terminated: ok {rc=0} 04:42:45.968345 --- ParallelTerminationStrategy: PID 26317 died... 04:42:45.988585 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26317): Terminated: ok {rc=0} 04:42:46.081830 bus /sierra_3: Setting Powered False 04:42:47.184617 bus /sierra_3: Setting Powered False 04:42:48.310947 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2354 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 04:42:49.461660 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:42:49.474033 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 04:42:49.542078 tst mo_mt_call_osmux.py: using LAC 19148 04:42:49.668859 tst mo_mt_call_osmux.py: using RAC 23 04:42:49.795024 tst mo_mt_call_osmux.py: using CellId 19148 04:42:49.920911 tst mo_mt_call_osmux.py: using BVCI 19149 04:42:50.038018 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:42:50.049739 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:42:50.061179 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:42:50.072800 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:42:50.084461 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:42:50.096550 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 04:42:50.215899 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 04:42:50.341623 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:42:50.842226 run create_hlr_db(pid=26320): Launched 04:42:50.965418 bus /sierra_2: Setting Powered False 04:42:52.027297 run create_hlr_db(pid=26320): Terminated: ok {rc=0} 04:42:52.477268 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26322): Launched 04:42:52.799756 run osmo-hlr_10.42.42.2(pid=26323): Launched 04:42:52.924053 run osmo-stp_10.42.42.5: Starting osmo-stp 04:42:53.481568 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26325): Launched 04:42:53.804647 run osmo-stp_10.42.42.5(pid=26326): Launched 04:42:53.928262 run osmo-msc_10.42.42.6: Starting osmo-msc 04:42:54.511073 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26328): Launched 04:42:54.834077 run osmo-msc_10.42.42.6(pid=26329): Launched 04:42:55.014382 run osmo-stp_10.42.42.5(pid=26326): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26326)] 04:42:55.150544 run osmo-stp_10.42.42.5(pid=26326): stdout: | (launched: 2022-12-09_04:42:53.743876) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:42:55.287137 run osmo-stp_10.42.42.5(pid=26326): stderr: | 20221209044253936 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044253936 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044253937 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044253937 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044253938 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044253938 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044253938 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:42:55.423621 run osmo-stp_10.42.42.5(pid=26326): stdout: | (launched: 2022-12-09_04:42:53.743876) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:42:55.552081 run osmo-stp_10.42.42.5(pid=26326): stderr: | 20221209044253936 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044253936 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044253937 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044253937 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044253938 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044253938 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044253938 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:42:55.705548 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26326): Process ended prematurely: osmo-stp_10.42.42.5(pid=26326) [trial-2354↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26326)] [trial-2354↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 04:42:55.715135 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 04:42:55.743712 run osmo-hlr_10.42.42.2(pid=26323): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26323)] 04:42:55.794624 run osmo-hlr_10.42.42.2(pid=26323): stdout: | (launched: 2022-12-09_04:42:52.740489) 04:42:55.847118 run osmo-hlr_10.42.42.2(pid=26323): stderr: | 20221209044252939 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209044252939 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209044252939 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209044252939 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209044252939 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209044252939 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209044252954 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209044252965 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209044252965 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209044252965 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:42:55.920335 run osmo-msc_10.42.42.6(pid=26329): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26329)] 04:42:55.970846 run osmo-msc_10.42.42.6(pid=26329): stdout: | (launched: 2022-12-09_04:42:54.774780) 04:42:56.023032 run osmo-msc_10.42.42.6(pid=26329): stderr: | 20221209044255095 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209044255095 DLGLOBAL DEBUG validating counter group 0x7fd3f65e1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209044255095 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209044255095 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209044255096 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209044255096 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209044255098 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209044255098 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209044255098 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209044255098 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:42:56.075596 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26322): Terminating (SIGTERM) 04:42:56.117954 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26325): Terminating (SIGTERM) 04:42:56.160134 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26328): Terminating (SIGTERM) 04:42:56.202694 --- ParallelTerminationStrategy: PID 26322 died... 04:42:56.222942 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26322): Terminated: ok {rc=0} 04:42:56.270077 --- ParallelTerminationStrategy: PID 26325 died... 04:42:56.289747 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26325): Terminated: ok {rc=0} 04:42:56.337029 --- ParallelTerminationStrategy: PID 26328 died... 04:42:56.356801 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26328): Terminated: ok {rc=0} 04:42:56.445129 bus /sierra_3: Setting Powered False 04:42:57.544617 bus /sierra_3: Setting Powered False 04:42:58.661425 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 04:42:59.916153 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:42:59.924423 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 04:42:59.957450 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 04:42:59.985016 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 04:43:00.037506 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 04:43:00.070244 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 04:43:00.096995 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 04:43:00.651320 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 04:43:00.702910 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:43:00.714524 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 04:43:00.781883 tst mo_mt_call.py: using LAC 19149 04:43:00.922957 tst mo_mt_call.py: using RAC 24 04:43:01.054250 tst mo_mt_call.py: using CellId 19149 04:43:01.174066 tst mo_mt_call.py: using BVCI 19150 04:43:01.307244 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:43:01.319362 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:43:01.331460 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:43:01.343190 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:43:01.355606 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:43:01.367217 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 04:43:01.485451 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 04:43:01.608341 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:43:02.135954 run create_hlr_db(pid=26334): Launched 04:43:02.297313 bus /sierra_2: Setting Powered False 04:43:03.357990 run create_hlr_db(pid=26334): Terminated: ok {rc=0} 04:43:03.798649 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26336): Launched 04:43:04.122445 run osmo-hlr_10.42.42.2(pid=26337): Launched 04:43:04.245765 run osmo-stp_10.42.42.5: Starting osmo-stp 04:43:04.763556 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26339): Launched 04:43:05.063072 run osmo-stp_10.42.42.5(pid=26340): Launched 04:43:05.176809 run osmo-msc_10.42.42.6: Starting osmo-msc 04:43:05.716502 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26342): Launched 04:43:06.016152 run osmo-msc_10.42.42.6(pid=26343): Launched 04:43:06.183845 run osmo-stp_10.42.42.5(pid=26340): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26340)] 04:43:06.310624 run osmo-stp_10.42.42.5(pid=26340): stdout: | (launched: 2022-12-09_04:43:05.007729) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:43:06.437169 run osmo-stp_10.42.42.5(pid=26340): stderr: | 20221209044305178 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044305178 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044305178 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044305179 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044305179 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044305179 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044305179 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:43:06.561954 run osmo-stp_10.42.42.5(pid=26340): stdout: | (launched: 2022-12-09_04:43:05.007729) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:43:06.680885 run osmo-stp_10.42.42.5(pid=26340): stderr: | 20221209044305178 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044305178 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044305178 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044305179 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044305179 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044305179 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044305179 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:43:06.823104 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26340): Process ended prematurely: osmo-stp_10.42.42.5(pid=26340) [trial-2354↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26340)] [trial-2354↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 04:43:06.831849 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 04:43:06.858237 run osmo-hlr_10.42.42.2(pid=26337): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26337)] 04:43:06.905868 run osmo-hlr_10.42.42.2(pid=26337): stdout: | (launched: 2022-12-09_04:43:04.062851) 04:43:06.955183 run osmo-hlr_10.42.42.2(pid=26337): stderr: | 20221209044304261 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209044304261 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209044304261 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209044304261 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209044304261 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209044304261 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209044304272 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209044304280 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209044304281 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209044304281 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:43:07.023943 run osmo-msc_10.42.42.6(pid=26343): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26343)] 04:43:07.071270 run osmo-msc_10.42.42.6(pid=26343): stdout: | (launched: 2022-12-09_04:43:05.960893) 04:43:07.120451 run osmo-msc_10.42.42.6(pid=26343): stderr: | 20221209044306231 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209044306231 DLGLOBAL DEBUG validating counter group 0x7f61cff5dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209044306231 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209044306231 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209044306231 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209044306233 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209044306234 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209044306235 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209044306235 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209044306235 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:43:07.169921 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26336): Terminating (SIGTERM) 04:43:07.209388 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26339): Terminating (SIGTERM) 04:43:07.248752 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26342): Terminating (SIGTERM) 04:43:07.288510 --- ParallelTerminationStrategy: PID 26336 died... 04:43:07.307645 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26336): Terminated: ok {rc=0} 04:43:07.351877 --- ParallelTerminationStrategy: PID 26339 died... 04:43:07.370595 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26339): Terminated: ok {rc=0} 04:43:07.414155 --- ParallelTerminationStrategy: PID 26342 died... 04:43:07.432604 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26342): Terminated: ok {rc=0} 04:43:07.517000 bus /sierra_3: Setting Powered False 04:43:08.613574 bus /sierra_3: Setting Powered False 04:43:09.727581 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2354 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 04:43:10.876235 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:43:10.888669 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 04:43:10.958062 tst mo_mt_call_osmux.py: using LAC 19150 04:43:11.085148 tst mo_mt_call_osmux.py: using RAC 25 04:43:11.213300 tst mo_mt_call_osmux.py: using CellId 19150 04:43:11.340449 tst mo_mt_call_osmux.py: using BVCI 19151 04:43:11.457524 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:43:11.469254 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:43:11.480586 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:43:11.492521 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:43:11.504586 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:43:11.516282 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 04:43:11.635859 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 04:43:11.752219 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:43:12.218305 run create_hlr_db(pid=26345): Launched 04:43:12.341450 bus /sierra_2: Setting Powered False 04:43:13.401804 run create_hlr_db(pid=26345): Terminated: ok {rc=0} 04:43:13.820225 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26347): Launched 04:43:14.120541 run osmo-hlr_10.42.42.2(pid=26348): Launched 04:43:14.234153 run osmo-stp_10.42.42.5: Starting osmo-stp 04:43:14.752924 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26350): Launched 04:43:15.054399 run osmo-stp_10.42.42.5(pid=26351): Launched 04:43:15.169236 run osmo-msc_10.42.42.6: Starting osmo-msc 04:43:15.711582 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26353): Launched 04:43:16.018322 run osmo-msc_10.42.42.6(pid=26354): Launched 04:43:16.697388 run osmo-stp_10.42.42.5(pid=26351): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26351)] 04:43:17.020073 run osmo-stp_10.42.42.5(pid=26351): stdout: | (launched: 2022-12-09_04:43:14.998504) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:43:17.147651 run osmo-stp_10.42.42.5(pid=26351): stderr: | 20221209044315169 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044315169 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044315169 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044315170 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044315170 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044315170 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044315170 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:43:17.274605 run osmo-stp_10.42.42.5(pid=26351): stdout: | (launched: 2022-12-09_04:43:14.998504) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:43:17.394907 run osmo-stp_10.42.42.5(pid=26351): stderr: | 20221209044315169 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044315169 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044315169 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044315170 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044315170 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044315170 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044315170 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:43:17.538144 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26351): Process ended prematurely: osmo-stp_10.42.42.5(pid=26351) [trial-2354↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26351)] [trial-2354↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 04:43:17.547116 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 04:43:17.573872 run osmo-hlr_10.42.42.2(pid=26348): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26348)] 04:43:17.621815 run osmo-hlr_10.42.42.2(pid=26348): stdout: | (launched: 2022-12-09_04:43:14.065159) 04:43:17.671478 run osmo-hlr_10.42.42.2(pid=26348): stderr: | 20221209044314243 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209044314243 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209044314243 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209044314243 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209044314243 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209044314243 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209044314256 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209044314265 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209044314265 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209044314265 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:43:17.741090 run osmo-msc_10.42.42.6(pid=26354): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26354)] 04:43:17.788815 run osmo-msc_10.42.42.6(pid=26354): stdout: | (launched: 2022-12-09_04:43:15.959223) 04:43:17.838377 run osmo-msc_10.42.42.6(pid=26354): stderr: | 20221209044316586 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209044316586 DLGLOBAL DEBUG validating counter group 0x7f8ec15e0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209044316587 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209044316587 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209044316587 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209044316587 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209044316592 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209044316593 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209044316593 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209044316594 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:43:17.888087 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26347): Terminating (SIGTERM) 04:43:17.928152 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26350): Terminating (SIGTERM) 04:43:17.968386 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26353): Terminating (SIGTERM) 04:43:18.008862 --- ParallelTerminationStrategy: PID 26347 died... 04:43:18.028269 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26347): Terminated: ok {rc=0} 04:43:18.072816 --- ParallelTerminationStrategy: PID 26350 died... 04:43:18.092241 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26350): Terminated: ok {rc=0} 04:43:18.136547 --- ParallelTerminationStrategy: PID 26353 died... 04:43:18.155426 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26353): Terminated: ok {rc=0} 04:43:18.242659 bus /sierra_3: Setting Powered False 04:43:19.346753 bus /sierra_3: Setting Powered False 04:43:20.465336 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 04:43:21.713525 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:43:21.720684 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 04:43:21.752288 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 04:43:21.778399 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 04:43:21.830504 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 04:43:21.862537 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 04:43:21.888677 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 04:43:22.441122 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 04:43:22.489029 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:43:22.500176 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 04:43:22.566552 tst mo_mt_call.py: using LAC 19151 04:43:22.694898 tst mo_mt_call.py: using RAC 26 04:43:22.821423 tst mo_mt_call.py: using CellId 19151 04:43:22.951827 tst mo_mt_call.py: using BVCI 19152 04:43:23.070548 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:43:23.082514 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:43:23.094322 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:43:23.106720 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:43:23.119166 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:43:23.131154 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:43:23.246673 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:43:23.363328 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:43:23.828899 run create_hlr_db(pid=26360): Launched 04:43:23.952648 bus /sierra_2: Setting Powered False 04:43:25.012934 run create_hlr_db(pid=26360): Terminated: ok {rc=0} 04:43:25.454078 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26362): Launched 04:43:25.776424 run osmo-hlr_10.42.42.2(pid=26363): Launched 04:43:25.899572 run osmo-stp_10.42.42.5: Starting osmo-stp 04:43:26.456831 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26365): Launched 04:43:26.778214 run osmo-stp_10.42.42.5(pid=26366): Launched 04:43:26.900861 run osmo-msc_10.42.42.6: Starting osmo-msc 04:43:27.483331 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26368): Launched 04:43:27.805099 run osmo-msc_10.42.42.6(pid=26369): Launched 04:43:27.984563 run osmo-stp_10.42.42.5(pid=26366): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26366)] 04:43:28.121808 run osmo-stp_10.42.42.5(pid=26366): stdout: | (launched: 2022-12-09_04:43:26.719399) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:43:28.259666 run osmo-stp_10.42.42.5(pid=26366): stderr: | 20221209044326912 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044326913 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044326913 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044326913 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044326914 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044326914 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044326914 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:43:28.395697 run osmo-stp_10.42.42.5(pid=26366): stdout: | (launched: 2022-12-09_04:43:26.719399) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:43:28.524177 run osmo-stp_10.42.42.5(pid=26366): stderr: | 20221209044326912 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044326913 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044326913 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044326913 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044326914 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044326914 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044326914 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:43:28.677632 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26366): Process ended prematurely: osmo-stp_10.42.42.5(pid=26366) [trial-2354↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26366)] [trial-2354↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 04:43:28.687237 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 04:43:28.716182 run osmo-hlr_10.42.42.2(pid=26363): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26363)] 04:43:28.766849 run osmo-hlr_10.42.42.2(pid=26363): stdout: | (launched: 2022-12-09_04:43:25.717589) 04:43:28.819249 run osmo-hlr_10.42.42.2(pid=26363): stderr: | 20221209044325915 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209044325915 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209044325915 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209044325915 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209044325916 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209044325916 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209044325927 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209044325936 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209044325936 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209044325936 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:43:28.892205 run osmo-msc_10.42.42.6(pid=26369): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26369)] 04:43:28.942842 run osmo-msc_10.42.42.6(pid=26369): stdout: | (launched: 2022-12-09_04:43:27.746014) 04:43:28.995361 run osmo-msc_10.42.42.6(pid=26369): stderr: | 20221209044328066 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209044328067 DLGLOBAL DEBUG validating counter group 0x7f719134dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209044328067 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209044328067 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209044328067 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209044328067 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209044328069 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209044328069 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209044328069 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209044328069 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:43:29.048139 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26362): Terminating (SIGTERM) 04:43:29.090368 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26365): Terminating (SIGTERM) 04:43:29.132594 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26368): Terminating (SIGTERM) 04:43:29.175107 --- ParallelTerminationStrategy: PID 26362 died... 04:43:29.195388 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26362): Terminated: ok {rc=0} 04:43:29.242866 --- ParallelTerminationStrategy: PID 26365 died... 04:43:29.262498 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26365): Terminated: ok {rc=0} 04:43:29.309276 --- ParallelTerminationStrategy: PID 26368 died... 04:43:29.329319 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26368): Terminated: ok {rc=0} 04:43:29.419010 bus /sierra_3: Setting Powered False 04:43:30.517673 bus /sierra_3: Setting Powered False 04:43:31.634985 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2354 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 04:43:32.780698 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:43:32.792702 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 04:43:32.860240 tst mo_mt_call_osmux.py: using LAC 19152 04:43:32.987261 tst mo_mt_call_osmux.py: using RAC 27 04:43:33.114856 tst mo_mt_call_osmux.py: using CellId 19152 04:43:33.240774 tst mo_mt_call_osmux.py: using BVCI 19153 04:43:33.360143 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:43:33.371917 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:43:33.383472 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:43:33.395158 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:43:33.406917 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:43:33.418477 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:43:33.540061 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:43:33.661410 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:43:34.161096 run create_hlr_db(pid=26371): Launched 04:43:34.284355 bus /sierra_2: Setting Powered False 04:43:35.349750 run create_hlr_db(pid=26371): Terminated: ok {rc=0} 04:43:35.781088 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26373): Launched 04:43:36.081636 run osmo-hlr_10.42.42.2(pid=26374): Launched 04:43:36.197447 run osmo-stp_10.42.42.5: Starting osmo-stp 04:43:36.714411 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26376): Launched 04:43:37.014704 run osmo-stp_10.42.42.5(pid=26377): Launched 04:43:37.129716 run osmo-msc_10.42.42.6: Starting osmo-msc 04:43:37.672414 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26379): Launched 04:43:37.973748 run osmo-msc_10.42.42.6(pid=26380): Launched 04:43:38.142865 run osmo-stp_10.42.42.5(pid=26377): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26377)] 04:43:38.270141 run osmo-stp_10.42.42.5(pid=26377): stdout: | (launched: 2022-12-09_04:43:36.959303) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:43:38.397473 run osmo-stp_10.42.42.5(pid=26377): stderr: | 20221209044337127 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044337127 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044337127 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044337127 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044337130 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044337130 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044337130 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:43:38.523141 run osmo-stp_10.42.42.5(pid=26377): stdout: | (launched: 2022-12-09_04:43:36.959303) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:43:38.643184 run osmo-stp_10.42.42.5(pid=26377): stderr: | 20221209044337127 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044337127 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044337127 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044337127 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044337130 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044337130 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044337130 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:43:38.786731 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26377): Process ended prematurely: osmo-stp_10.42.42.5(pid=26377) [trial-2354↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26377)] [trial-2354↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 04:43:38.795592 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 04:43:38.822151 run osmo-hlr_10.42.42.2(pid=26374): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26374)] 04:43:38.870126 run osmo-hlr_10.42.42.2(pid=26374): stdout: | (launched: 2022-12-09_04:43:36.026056) 04:43:38.919681 run osmo-hlr_10.42.42.2(pid=26374): stderr: | 20221209044336205 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209044336205 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209044336205 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209044336205 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209044336205 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209044336205 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209044336224 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209044336233 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209044336233 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209044336233 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:43:38.989271 run osmo-msc_10.42.42.6(pid=26380): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26380)] 04:43:39.036876 run osmo-msc_10.42.42.6(pid=26380): stdout: | (launched: 2022-12-09_04:43:37.917983) 04:43:39.086440 run osmo-msc_10.42.42.6(pid=26380): stderr: | 20221209044338190 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209044338190 DLGLOBAL DEBUG validating counter group 0x7fbddd16bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209044338190 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209044338190 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209044338191 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209044338191 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209044338194 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209044338194 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209044338194 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209044338194 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:43:39.136375 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26373): Terminating (SIGTERM) 04:43:39.175896 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26376): Terminating (SIGTERM) 04:43:39.215575 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26379): Terminating (SIGTERM) 04:43:39.255805 --- ParallelTerminationStrategy: PID 26373 died... 04:43:39.275191 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26373): Terminated: ok {rc=0} 04:43:39.319621 --- ParallelTerminationStrategy: PID 26376 died... 04:43:39.338673 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26376): Terminated: ok {rc=0} 04:43:39.382745 --- ParallelTerminationStrategy: PID 26379 died... 04:43:39.401506 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26379): Terminated: ok {rc=0} 04:43:39.485291 bus /sierra_3: Setting Powered False 04:43:40.584029 bus /sierra_3: Setting Powered False 04:43:41.701776 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 04:43:42.954082 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:43:42.961633 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 04:43:42.995284 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 04:43:43.022569 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 04:43:43.075234 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 04:43:43.108615 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 04:43:43.136009 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 04:43:43.689230 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 04:43:43.741134 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 04:43:43.752781 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 04:43:43.803757 tst mo_mt_call.py: using LAC 19153 04:43:43.930893 tst mo_mt_call.py: using RAC 28 04:43:44.056122 tst mo_mt_call.py: using CellId 19153 04:43:44.184751 tst mo_mt_call.py: using BVCI 19154 04:43:44.302608 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 04:43:44.314553 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 04:43:44.326127 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 04:43:44.338449 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 04:43:44.350832 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 04:43:44.363078 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 04:43:44.478312 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 04:43:44.597401 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:43:45.097264 run create_hlr_db(pid=26385): Launched 04:43:45.220528 bus /sierra_2: Setting Powered False 04:43:46.283334 run create_hlr_db(pid=26385): Terminated: ok {rc=0} 04:43:46.764774 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26387): Launched 04:43:47.173970 run osmo-hlr_10.42.42.2(pid=26388): Launched 04:43:47.326353 run osmo-stp_10.42.42.5: Starting osmo-stp 04:43:47.838448 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26390): Launched 04:43:48.135510 run osmo-stp_10.42.42.5(pid=26391): Launched 04:43:48.249279 run osmo-msc_10.42.42.6: Starting osmo-msc 04:43:48.783537 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26393): Launched 04:43:49.080177 run osmo-msc_10.42.42.6(pid=26394): Launched 04:43:49.246084 run osmo-stp_10.42.42.5(pid=26391): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26391)] 04:43:49.370706 run osmo-stp_10.42.42.5(pid=26391): stdout: | (launched: 2022-12-09_04:43:48.080634) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:43:49.496534 run osmo-stp_10.42.42.5(pid=26391): stderr: | 20221209044348252 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044348252 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044348252 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044348253 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044348253 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044348253 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044348253 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:43:49.620359 run osmo-stp_10.42.42.5(pid=26391): stdout: | (launched: 2022-12-09_04:43:48.080634) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:43:49.739043 run osmo-stp_10.42.42.5(pid=26391): stderr: | 20221209044348252 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044348252 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044348252 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044348253 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044348253 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044348253 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044348253 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:43:49.880394 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26391): Process ended prematurely: osmo-stp_10.42.42.5(pid=26391) [trial-2354↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26391)] [trial-2354↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 04:43:49.889512 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 04:43:49.916234 run osmo-hlr_10.42.42.2(pid=26388): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26388)] 04:43:49.964082 run osmo-hlr_10.42.42.2(pid=26388): stdout: | (launched: 2022-12-09_04:43:47.105362) 04:43:50.013754 run osmo-hlr_10.42.42.2(pid=26388): stderr: | 20221209044347340 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209044347340 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209044347340 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209044347340 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209044347340 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209044347340 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209044347354 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209044347363 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209044347363 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209044347363 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:43:50.082902 run osmo-msc_10.42.42.6(pid=26394): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26394)] 04:43:50.130447 run osmo-msc_10.42.42.6(pid=26394): stdout: | (launched: 2022-12-09_04:43:49.025245) 04:43:50.179692 run osmo-msc_10.42.42.6(pid=26394): stderr: | 20221209044349298 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209044349299 DLGLOBAL DEBUG validating counter group 0x7f0a6870dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209044349299 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209044349299 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209044349299 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209044349299 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209044349301 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209044349301 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209044349302 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209044349302 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:43:50.229908 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26387): Terminating (SIGTERM) 04:43:50.269733 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26390): Terminating (SIGTERM) 04:43:50.309114 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26393): Terminating (SIGTERM) 04:43:50.349154 --- ParallelTerminationStrategy: PID 26387 died... 04:43:50.368040 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26387): Terminated: ok {rc=0} 04:43:50.412563 --- ParallelTerminationStrategy: PID 26390 died... 04:43:50.431168 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26390): Terminated: ok {rc=0} 04:43:50.475243 --- ParallelTerminationStrategy: PID 26393 died... 04:43:50.494090 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26393): Terminated: ok {rc=0} 04:43:50.580152 bus /sierra_3: Setting Powered False 04:43:51.680472 bus /sierra_3: Setting Powered False 04:43:52.793956 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2354 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 04:43:53.943837 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 04:43:53.956274 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 04:43:54.007785 tst mo_mt_call_osmux.py: using LAC 19154 04:43:54.134358 tst mo_mt_call_osmux.py: using RAC 29 04:43:54.261399 tst mo_mt_call_osmux.py: using CellId 19154 04:43:54.389283 tst mo_mt_call_osmux.py: using BVCI 19155 04:43:54.499214 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 04:43:54.510633 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 04:43:54.521984 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 04:43:54.533710 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 04:43:54.545525 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 04:43:54.557060 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 04:43:54.676807 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 04:43:54.792847 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:43:55.257127 run create_hlr_db(pid=26396): Launched 04:43:55.379824 bus /sierra_2: Setting Powered False 04:43:56.440754 run create_hlr_db(pid=26396): Terminated: ok {rc=0} 04:43:56.877617 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26398): Launched 04:43:57.198116 run osmo-hlr_10.42.42.2(pid=26399): Launched 04:43:57.319898 run osmo-stp_10.42.42.5: Starting osmo-stp 04:43:57.873882 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26401): Launched 04:43:58.193249 run osmo-stp_10.42.42.5(pid=26402): Launched 04:43:58.316095 run osmo-msc_10.42.42.6: Starting osmo-msc 04:43:58.893975 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26404): Launched 04:43:59.214454 run osmo-msc_10.42.42.6(pid=26405): Launched 04:43:59.394152 run osmo-stp_10.42.42.5(pid=26402): ERR: Terminated: ERROR {rc=1} [trial-2354↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26402)] 04:43:59.529295 run osmo-stp_10.42.42.5(pid=26402): stdout: | (launched: 2022-12-09_04:43:58.134958) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:43:59.664591 run osmo-stp_10.42.42.5(pid=26402): stderr: | 20221209044358330 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044358330 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044358330 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044358331 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044358331 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044358331 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044358331 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:43:59.799659 run osmo-stp_10.42.42.5(pid=26402): stdout: | (launched: 2022-12-09_04:43:58.134958) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:43:59.927312 run osmo-stp_10.42.42.5(pid=26402): stderr: | 20221209044358330 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044358330 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044358330 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044358331 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044358331 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044358331 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044358331 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:44:00.080266 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26402): Process ended prematurely: osmo-stp_10.42.42.5(pid=26402) [trial-2354↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26402)] [trial-2354↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 04:44:00.090105 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 04:44:00.118878 run osmo-hlr_10.42.42.2(pid=26399): ERR: Terminated: ERROR {rc=237} [trial-2354↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26399)] 04:44:00.169701 run osmo-hlr_10.42.42.2(pid=26399): stdout: | (launched: 2022-12-09_04:43:57.139953) 04:44:00.222316 run osmo-hlr_10.42.42.2(pid=26399): stderr: | 20221209044357337 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209044357337 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209044357337 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209044357337 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209044357337 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209044357337 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209044357349 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209044357357 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209044357357 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209044357357 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:44:00.295866 run osmo-msc_10.42.42.6(pid=26405): ERR: Terminated: ERROR {rc=2} [trial-2354↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26405)] 04:44:00.347027 run osmo-msc_10.42.42.6(pid=26405): stdout: | (launched: 2022-12-09_04:43:59.156175) 04:44:00.399440 run osmo-msc_10.42.42.6(pid=26405): stderr: | 20221209044359475 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209044359475 DLGLOBAL DEBUG validating counter group 0x7f8977444c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209044359476 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209044359476 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209044359476 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209044359476 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209044359478 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209044359478 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209044359478 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209044359478 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:44:00.452602 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26398): Terminating (SIGTERM) 04:44:00.495103 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26401): Terminating (SIGTERM) 04:44:00.537319 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26404): Terminating (SIGTERM) 04:44:00.579843 --- ParallelTerminationStrategy: PID 26398 died... 04:44:00.599857 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26398): Terminated: ok {rc=0} 04:44:00.647251 --- ParallelTerminationStrategy: PID 26401 died... 04:44:00.667148 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26401): Terminated: ok {rc=0} 04:44:00.714251 --- ParallelTerminationStrategy: PID 26404 died... 04:44:00.734087 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26404): Terminated: ok {rc=0} 04:44:00.822997 bus /sierra_3: Setting Powered False 04:44:01.926460 bus /sierra_3: Setting Powered False 04:44:03.041501 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 emergency:nanobts+band-900 --------------------------------------------------------------------- 04:44:04.297284 tst emergency:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:44:04.302972 tst emergency:nanobts+band-900: Verifying 1 x bts (candidates: 11) 04:44:04.337925 tst emergency:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 04:44:04.365683 tst emergency:nanobts+band-900: Verifying 4 x modem (candidates: 12) 04:44:04.451136 tst emergency:nanobts+band-900: Reserving 1 x bts (candidates: 11) 04:44:04.482709 tst emergency:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 04:44:04.508504 tst emergency:nanobts+band-900: Reserving 4 x modem (candidates: 12) 04:44:05.090188 tst emergency:nanobts+band-900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2354 emergency:nanobts+band-900 emergency_mo_mt_call.py ---------------------------------------------- 04:44:05.095274 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 04:44:05.106127 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 04:44:05.153650 tst emergency_mo_mt_call.py: using LAC 19155 04:44:05.272158 tst emergency_mo_mt_call.py: using RAC 30 04:44:05.388736 tst emergency_mo_mt_call.py: using CellId 19155 04:44:05.503981 tst emergency_mo_mt_call.py: using BVCI 19156 04:44:05.611352 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 04:44:05.622220 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 04:44:05.632483 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 04:44:05.643124 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 04:44:05.653627 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 04:44:05.664116 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 04:44:05.774335 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 04:44:05.891725 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:44:06.380140 run create_hlr_db(pid=26410): Launched 04:44:06.501631 bus /sierra_2: Setting Powered False 04:44:07.564363 run create_hlr_db(pid=26410): Terminated: ok {rc=0} 04:44:08.002299 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26412): Launched 04:44:08.316543 run osmo-hlr_10.42.42.2(pid=26413): Launched 04:44:08.438259 run osmo-stp_10.42.42.5: Starting osmo-stp 04:44:08.982900 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26415): Launched 04:44:09.296296 run osmo-stp_10.42.42.5(pid=26416): Launched 04:44:09.427144 tst emergency_mo_mt_call.py: using MSISDN 7028 04:44:09.587756 run osmo-msc_10.42.42.6: Starting osmo-msc 04:44:10.152524 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26418): Launched 04:44:10.470624 run osmo-msc_10.42.42.6(pid=26419): Launched 04:44:10.646827 run osmo-stp_10.42.42.5(pid=26416): ERR: Terminated: ERROR {rc=1} [trial-2354↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26416)] 04:44:10.780051 run osmo-stp_10.42.42.5(pid=26416): stdout: | (launched: 2022-12-09_04:44:09.239015) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:44:10.913846 run osmo-stp_10.42.42.5(pid=26416): stderr: | 20221209044409433 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044409433 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044409433 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044409434 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044409434 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044409434 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044409434 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:44:11.047026 run osmo-stp_10.42.42.5(pid=26416): stdout: | (launched: 2022-12-09_04:44:09.239015) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:44:11.172157 run osmo-stp_10.42.42.5(pid=26416): stderr: | 20221209044409433 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044409433 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044409433 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044409434 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044409434 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044409434 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044409434 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:44:11.322146 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=26416): Process ended prematurely: osmo-stp_10.42.42.5(pid=26416) [trial-2354↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26416)] [trial-2354↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19] 04:44:11.331091 tst emergency_mo_mt_call.py:19: Test FAILED (6.2 sec) 04:44:11.359520 run osmo-hlr_10.42.42.2(pid=26413): ERR: Terminated: ERROR {rc=237} [trial-2354↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26413)] 04:44:11.410667 run osmo-hlr_10.42.42.2(pid=26413): stdout: | (launched: 2022-12-09_04:44:08.259288) 04:44:11.463261 run osmo-hlr_10.42.42.2(pid=26413): stderr: | 20221209044408456 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209044408456 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209044408456 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209044408456 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209044408456 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209044408456 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209044408468 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/emergency:nanobts+band-900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209044408477 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209044408477 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209044408477 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:44:11.536317 run osmo-msc_10.42.42.6(pid=26419): ERR: Terminated: ERROR {rc=2} [trial-2354↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26419)] 04:44:11.587050 run osmo-msc_10.42.42.6(pid=26419): stdout: | (launched: 2022-12-09_04:44:10.413218) 04:44:11.639517 run osmo-msc_10.42.42.6(pid=26419): stderr: | 20221209044410736 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209044410736 DLGLOBAL DEBUG validating counter group 0x7fe726efac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209044410736 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209044410736 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209044410736 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209044410736 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209044410738 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209044410739 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209044410739 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209044410739 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:44:11.692320 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26412): Terminating (SIGTERM) 04:44:11.734659 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26415): Terminating (SIGTERM) 04:44:11.777051 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26418): Terminating (SIGTERM) 04:44:11.819725 --- ParallelTerminationStrategy: PID 26412 died... 04:44:11.839897 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26412): Terminated: ok {rc=0} 04:44:11.886800 --- ParallelTerminationStrategy: PID 26415 died... 04:44:11.906454 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26415): Terminated: ok {rc=0} 04:44:11.953335 --- ParallelTerminationStrategy: PID 26418 died... 04:44:11.972688 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26418): Terminated: ok {rc=0} 04:44:12.061721 bus /sierra_3: Setting Powered False 04:44:13.161259 bus /sierra_3: Setting Powered False 04:44:14.277916 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2354 emergency:nanobts+band-900 emergency_preemptive_call.py ---------------------------------------------- 04:44:15.365737 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 04:44:15.377533 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 04:44:15.426163 tst emergency_preemptive_call.py: using LAC 19156 04:44:15.549639 tst emergency_preemptive_call.py: using RAC 31 04:44:15.667649 tst emergency_preemptive_call.py: using CellId 19156 04:44:15.782856 tst emergency_preemptive_call.py: using BVCI 19157 04:44:15.896369 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 04:44:15.907617 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 04:44:15.928810 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 04:44:15.940026 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 04:44:15.950956 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 04:44:15.962228 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 04:44:16.091413 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 04:44:16.237293 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 04:44:16.385517 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 04:44:16.527889 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:44:17.071509 run create_hlr_db(pid=26421): Launched 04:44:17.232218 bus /sierra_2: Setting Powered False 04:44:18.291576 run create_hlr_db(pid=26421): Terminated: ok {rc=0} 04:44:18.702582 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26423): Launched 04:44:18.995456 run osmo-hlr_10.42.42.2(pid=26424): Launched 04:44:19.107088 run osmo-stp_10.42.42.5: Starting osmo-stp 04:44:19.609629 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26426): Launched 04:44:19.901692 run osmo-stp_10.42.42.5(pid=26427): Launched 04:44:20.022665 tst emergency_preemptive_call.py: using MSISDN 7029 04:44:20.172221 run osmo-msc_10.42.42.6: Starting osmo-msc 04:44:20.698305 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26429): Launched 04:44:20.991314 run osmo-msc_10.42.42.6(pid=26430): Launched 04:44:21.155550 run osmo-stp_10.42.42.5(pid=26427): ERR: Terminated: ERROR {rc=1} [trial-2354↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26427)] 04:44:21.279173 run osmo-stp_10.42.42.5(pid=26427): stdout: | (launched: 2022-12-09_04:44:19.848262) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:44:21.403997 run osmo-stp_10.42.42.5(pid=26427): stderr: | 20221209044420018 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044420018 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044420018 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044420019 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044420019 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044420019 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044420019 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:44:21.526871 run osmo-stp_10.42.42.5(pid=26427): stdout: | (launched: 2022-12-09_04:44:19.848262) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:44:21.643753 run osmo-stp_10.42.42.5(pid=26427): stderr: | 20221209044420018 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044420018 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044420018 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044420019 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044420019 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044420019 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044420019 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:44:21.783241 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=26427): Process ended prematurely: osmo-stp_10.42.42.5(pid=26427) [trial-2354↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26427)] [trial-2354↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32] 04:44:21.791697 tst emergency_preemptive_call.py:32: Test FAILED (6.4 sec) 04:44:21.818201 run osmo-hlr_10.42.42.2(pid=26424): ERR: Terminated: ERROR {rc=237} [trial-2354↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26424)] 04:44:21.866703 run osmo-hlr_10.42.42.2(pid=26424): stdout: | (launched: 2022-12-09_04:44:18.941639) 04:44:21.916533 run osmo-hlr_10.42.42.2(pid=26424): stderr: | 20221209044419116 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209044419116 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209044419116 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209044419116 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209044419116 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209044419116 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209044419128 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/emergency:nanobts+band-900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209044419137 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209044419137 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209044419137 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:44:21.986404 run osmo-msc_10.42.42.6(pid=26430): ERR: Terminated: ERROR {rc=2} [trial-2354↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26430)] 04:44:22.034367 run osmo-msc_10.42.42.6(pid=26430): stdout: | (launched: 2022-12-09_04:44:20.937439) 04:44:22.083791 run osmo-msc_10.42.42.6(pid=26430): stderr: | 20221209044421207 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209044421208 DLGLOBAL DEBUG validating counter group 0x7f4d2ede5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209044421208 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209044421208 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209044421209 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209044421209 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209044421211 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209044421211 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209044421211 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209044421211 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:44:22.133726 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26423): Terminating (SIGTERM) 04:44:22.173632 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26426): Terminating (SIGTERM) 04:44:22.213941 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26429): Terminating (SIGTERM) 04:44:22.254335 --- ParallelTerminationStrategy: PID 26423 died... 04:44:22.273675 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26423): Terminated: ok {rc=0} 04:44:22.318403 --- ParallelTerminationStrategy: PID 26426 died... 04:44:22.337411 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26426): Terminated: ok {rc=0} 04:44:22.381980 --- ParallelTerminationStrategy: PID 26429 died... 04:44:22.400918 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26429): Terminated: ok {rc=0} 04:44:22.485370 bus /sierra_9: Setting Powered False 04:44:23.581556 bus /sierra_9: Setting Powered False 04:44:24.696545 bus /sierra_8: Setting Powered False 04:44:25.796510 bus /sierra_8: Setting Powered False 04:44:26.912327 bus /sierra_3: Setting Powered False 04:44:28.011770 bus /sierra_3: Setting Powered False 04:44:29.130530 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 emergency:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 gprs:nanobts+band-900 --------------------------------------------------------------------- 04:44:30.404720 tst gprs:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:44:30.409927 tst gprs:nanobts+band-900: Verifying 1 x bts (candidates: 11) 04:44:30.441653 tst gprs:nanobts+band-900: Verifying 9 x ip_address (candidates: 9) 04:44:30.479115 tst gprs:nanobts+band-900: Verifying 4 x modem (candidates: 12) 04:44:30.564163 tst gprs:nanobts+band-900: Reserving 1 x bts (candidates: 11) 04:44:30.595653 tst gprs:nanobts+band-900: Reserving 9 x ip_address (candidates: 9) 04:44:30.633270 tst gprs:nanobts+band-900: Reserving 4 x modem (candidates: 12) 04:44:31.227765 tst gprs:nanobts+band-900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2354 gprs:nanobts+band-900 cs_paging_gprs_active.py ---------------------------------------------- 04:44:31.284050 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:44:31.296581 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 04:44:31.348280 tst cs_paging_gprs_active.py: using LAC 19157 04:44:31.513486 tst cs_paging_gprs_active.py: using RAC 32 04:44:31.643453 tst cs_paging_gprs_active.py: using CellId 19157 04:44:31.772640 tst cs_paging_gprs_active.py: using BVCI 19158 04:44:31.887604 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:44:31.898699 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:44:31.909607 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:44:31.920560 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:44:31.931372 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:44:31.942370 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:44:31.953525 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:44:31.964093 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:44:31.975148 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 04:44:32.094143 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 04:44:32.222456 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 04:44:32.423544 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:44:32.724389 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26435): Launched 04:44:32.984737 run iperf3-srv_10.42.42.10(pid=26436): Launched 04:44:33.096745 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 04:44:33.295789 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:44:33.595103 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26437): Launched 04:44:33.854933 run iperf3-srv_10.42.42.10(pid=26438): Launched 04:44:33.966560 tst cs_paging_gprs_active.py:38: start network... 04:44:34.164741 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:44:34.625542 run create_hlr_db(pid=26439): Launched 04:44:34.748582 bus /sierra_2: Setting Powered False 04:44:35.809289 run create_hlr_db(pid=26439): Terminated: ok {rc=0} 04:44:36.246140 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26441): Launched 04:44:36.576587 run osmo-hlr_10.42.42.2(pid=26442): Launched 04:44:36.700381 run osmo-stp_10.42.42.5: Starting osmo-stp 04:44:37.254890 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26444): Launched 04:44:37.576185 run osmo-stp_10.42.42.5(pid=26445): Launched 04:44:37.699751 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:44:38.252307 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26447): Launched 04:44:38.375437 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:44:38.647666 run patchelf(pid=26448): Launched 04:44:38.826934 run osmo-stp_10.42.42.5(pid=26445): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26445)] 04:44:38.962890 run osmo-stp_10.42.42.5(pid=26445): stdout: | (launched: 2022-12-09_04:44:37.518159) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:44:39.100224 run osmo-stp_10.42.42.5(pid=26445): stderr: | 20221209044437711 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044437711 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044437712 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044437712 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044437712 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044437712 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044437713 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:44:39.237866 run osmo-stp_10.42.42.5(pid=26445): stdout: | (launched: 2022-12-09_04:44:37.518159) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:44:39.370187 run osmo-stp_10.42.42.5(pid=26445): stderr: | 20221209044437711 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044437711 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044437712 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044437712 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044437712 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044437712 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044437713 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:44:39.526593 run patchelf(pid=26448): Terminating (SIGINT) 04:44:39.707529 run patchelf(pid=26448): Terminated: ok {rc=0} 04:44:39.837828 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=26445): Process ended prematurely: osmo-stp_10.42.42.5(pid=26445) [trial-2354↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26445)] [trial-2354↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38] 04:44:39.848170 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 04:44:39.877878 run osmo-hlr_10.42.42.2(pid=26442): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:nanobts+band-900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26442)] 04:44:39.928937 run osmo-hlr_10.42.42.2(pid=26442): stdout: | (launched: 2022-12-09_04:44:36.518340) 04:44:39.981912 run osmo-hlr_10.42.42.2(pid=26442): stderr: | 20221209044436718 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209044436719 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209044436719 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209044436719 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209044436719 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209044436719 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209044436730 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:nanobts+band-900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209044436740 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209044436740 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209044436740 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:44:40.034815 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26435): Terminating (SIGTERM) 04:44:40.077171 run iperf3-srv_10.42.42.10(pid=26436): Terminating (SIGTERM) 04:44:40.119471 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26437): Terminating (SIGTERM) 04:44:40.161860 run iperf3-srv_10.42.42.10(pid=26438): Terminating (SIGTERM) 04:44:40.204053 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26441): Terminating (SIGTERM) 04:44:40.246504 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26444): Terminating (SIGTERM) 04:44:40.288800 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26447): Terminating (SIGTERM) 04:44:40.331721 --- ParallelTerminationStrategy: PID 26435 died... 04:44:40.351929 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26435): Terminated: ok {rc=0} 04:44:40.399532 --- ParallelTerminationStrategy: PID 26436 died... 04:44:40.419398 run iperf3-srv_10.42.42.10(pid=26436): Terminated {rc=256} 04:44:40.466387 --- ParallelTerminationStrategy: PID 26437 died... 04:44:40.486128 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26437): Terminated: ok {rc=0} 04:44:40.533326 --- ParallelTerminationStrategy: PID 26438 died... 04:44:40.552809 run iperf3-srv_10.42.42.10(pid=26438): Terminated {rc=256} 04:44:40.599911 --- ParallelTerminationStrategy: PID 26441 died... 04:44:40.619727 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26441): Terminated: ok {rc=0} 04:44:40.666981 --- ParallelTerminationStrategy: PID 26444 died... 04:44:40.686836 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26444): Terminated: ok {rc=0} 04:44:40.734414 --- ParallelTerminationStrategy: PID 26447 died... 04:44:40.754325 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26447): Terminated: ok {rc=0} 04:44:40.843396 bus /gobi_0: Setting Powered False 04:44:41.943287 bus /gobi_0: Setting Powered False 04:44:43.059751 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:nanobts+band-900 iperf3.py ---------------------------------------------- 04:44:44.209643 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:44:44.221337 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 04:44:44.273437 tst iperf3.py: using LAC 19158 04:44:44.392544 tst iperf3.py: using RAC 33 04:44:44.520606 tst iperf3.py: using CellId 19158 04:44:44.646526 tst iperf3.py: using BVCI 19159 04:44:44.763553 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:44:44.774900 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:44:44.785981 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:44:44.797398 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:44:44.808675 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:44:44.819754 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:44:44.831089 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:44:44.842349 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:44:44.853769 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 04:44:44.969575 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 04:44:45.169256 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:44:45.467664 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26449): Launched 04:44:45.728078 run iperf3-srv_10.42.42.10(pid=26450): Launched 04:44:45.854282 tst iperf3.py:8: start network... 04:44:46.068488 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:44:46.548588 run create_hlr_db(pid=26451): Launched 04:44:46.705994 bus /gobi_6: Setting Powered False 04:44:47.769860 run create_hlr_db(pid=26451): Terminated: ok {rc=0} 04:44:48.218054 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26453): Launched 04:44:48.540041 run osmo-hlr_10.42.42.2(pid=26454): Launched 04:44:48.663597 run osmo-stp_10.42.42.5: Starting osmo-stp 04:44:49.221862 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26456): Launched 04:44:49.543691 run osmo-stp_10.42.42.5(pid=26457): Launched 04:44:49.667099 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:44:50.218686 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26459): Launched 04:44:50.341905 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:44:50.612686 run patchelf(pid=26460): Launched 04:44:50.791371 run osmo-stp_10.42.42.5(pid=26457): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26457)] 04:44:50.927747 run osmo-stp_10.42.42.5(pid=26457): stdout: | (launched: 2022-12-09_04:44:49.485345) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:44:51.065739 run osmo-stp_10.42.42.5(pid=26457): stderr: | 20221209044449681 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044449681 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044449682 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044449682 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044449682 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044449682 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044449683 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:44:51.203775 run osmo-stp_10.42.42.5(pid=26457): stdout: | (launched: 2022-12-09_04:44:49.485345) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:44:51.335959 run osmo-stp_10.42.42.5(pid=26457): stderr: | 20221209044449681 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044449681 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044449682 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044449682 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044449682 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044449682 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044449683 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:44:51.492681 run patchelf(pid=26460): Terminating (SIGINT) 04:44:51.673308 run patchelf(pid=26460): Terminated: ok {rc=0} 04:44:51.803533 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26457): Process ended prematurely: osmo-stp_10.42.42.5(pid=26457) [trial-2354↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26457)] [trial-2354↪gprs:nanobts+band-900↪iperf3.py:8] 04:44:51.814062 tst iperf3.py:8: Test FAILED (7.6 sec) 04:44:51.843739 run osmo-hlr_10.42.42.2(pid=26454): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:nanobts+band-900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26454)] 04:44:51.894941 run osmo-hlr_10.42.42.2(pid=26454): stdout: | (launched: 2022-12-09_04:44:48.481671) 04:44:51.948008 run osmo-hlr_10.42.42.2(pid=26454): stderr: | 20221209044448681 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209044448681 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209044448681 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209044448681 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209044448681 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209044448681 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209044448694 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:nanobts+band-900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209044448702 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209044448702 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209044448702 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:44:52.001388 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26449): Terminating (SIGTERM) 04:44:52.044354 run iperf3-srv_10.42.42.10(pid=26450): Terminating (SIGTERM) 04:44:52.087266 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26453): Terminating (SIGTERM) 04:44:52.130424 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26456): Terminating (SIGTERM) 04:44:52.173238 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26459): Terminating (SIGTERM) 04:44:52.216261 --- ParallelTerminationStrategy: PID 26449 died... 04:44:52.236384 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26449): Terminated: ok {rc=0} 04:44:52.283892 --- ParallelTerminationStrategy: PID 26450 died... 04:44:52.303774 run iperf3-srv_10.42.42.10(pid=26450): Terminated {rc=256} 04:44:52.351018 --- ParallelTerminationStrategy: PID 26453 died... 04:44:52.371169 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26453): Terminated: ok {rc=0} 04:44:52.418421 --- ParallelTerminationStrategy: PID 26456 died... 04:44:52.438291 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26456): Terminated: ok {rc=0} 04:44:52.485622 --- ParallelTerminationStrategy: PID 26459 died... 04:44:52.505400 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26459): Terminated: ok {rc=0} 04:44:52.594874 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:nanobts+band-900 iperf3m4.py ---------------------------------------------- 04:44:53.747711 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:44:53.759378 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 04:44:53.812039 tst iperf3m4.py: using LAC 19159 04:44:53.939892 tst iperf3m4.py: using RAC 34 04:44:54.064631 tst iperf3m4.py: using CellId 19159 04:44:54.188446 tst iperf3m4.py: using BVCI 19160 04:44:54.298182 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:44:54.308942 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:44:54.319578 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:44:54.330117 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:44:54.340525 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:44:54.351396 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:44:54.362111 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:44:54.372316 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:44:54.382863 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 04:44:54.500780 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 04:44:54.621751 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 04:44:54.738785 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 04:44:54.854455 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 04:44:55.054476 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:44:55.354216 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26461): Launched 04:44:55.614030 run iperf3-srv_10.42.42.10(pid=26462): Launched 04:44:55.725821 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 04:44:55.924344 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:44:56.222679 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26463): Launched 04:44:56.482924 run iperf3-srv_10.42.42.10(pid=26464): Launched 04:44:56.595269 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 04:44:56.794921 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:44:57.095408 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26465): Launched 04:44:57.356153 run iperf3-srv_10.42.42.10(pid=26466): Launched 04:44:57.468643 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 04:44:57.667997 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:44:57.968119 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26467): Launched 04:44:58.229595 run iperf3-srv_10.42.42.10(pid=26468): Launched 04:44:58.342117 tst iperf3m4.py:8: start network... 04:44:58.542024 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:44:59.007234 run create_hlr_db(pid=26469): Launched 04:44:59.130437 bus /gobi_6: Setting Powered False 04:45:00.191327 run create_hlr_db(pid=26469): Terminated: ok {rc=0} 04:45:00.630593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26471): Launched 04:45:00.979091 run osmo-hlr_10.42.42.2(pid=26472): Launched 04:45:01.230278 run osmo-stp_10.42.42.5: Starting osmo-stp 04:45:01.856435 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26477): Launched 04:45:02.199466 run osmo-stp_10.42.42.5(pid=26478): Launched 04:45:02.396762 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:45:03.023646 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26480): Launched 04:45:03.147203 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:45:03.419075 run patchelf(pid=26481): Launched 04:45:03.598260 run osmo-stp_10.42.42.5(pid=26478): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26478)] 04:45:03.735061 run osmo-stp_10.42.42.5(pid=26478): stdout: | (launched: 2022-12-09_04:45:02.134237) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:45:03.873531 run osmo-stp_10.42.42.5(pid=26478): stderr: | 20221209044502389 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044502390 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044502390 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044502390 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044502391 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044502391 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044502391 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:45:04.011644 run osmo-stp_10.42.42.5(pid=26478): stdout: | (launched: 2022-12-09_04:45:02.134237) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:45:04.144362 run osmo-stp_10.42.42.5(pid=26478): stderr: | 20221209044502389 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044502390 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044502390 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044502390 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044502391 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044502391 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044502391 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:45:04.301786 run patchelf(pid=26481): Terminating (SIGINT) 04:45:04.484614 run patchelf(pid=26481): Terminated: ok {rc=0} 04:45:04.615983 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26478): Process ended prematurely: osmo-stp_10.42.42.5(pid=26478) [trial-2354↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26478)] [trial-2354↪gprs:nanobts+band-900↪iperf3m4.py:8] 04:45:04.626273 tst iperf3m4.py:8: Test FAILED (10.9 sec) 04:45:04.655969 run osmo-hlr_10.42.42.2(pid=26472): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:nanobts+band-900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26472)] 04:45:04.707213 run osmo-hlr_10.42.42.2(pid=26472): stdout: | (launched: 2022-12-09_04:45:00.910321) 04:45:04.760068 run osmo-hlr_10.42.42.2(pid=26472): stderr: | 20221209044501196 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209044501197 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209044501197 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209044501197 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209044501197 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209044501197 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209044501217 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:nanobts+band-900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209044501241 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209044501242 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209044501242 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:45:04.813403 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26461): Terminating (SIGTERM) 04:45:04.856775 run iperf3-srv_10.42.42.10(pid=26462): Terminating (SIGTERM) 04:45:04.899401 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26463): Terminating (SIGTERM) 04:45:04.942767 run iperf3-srv_10.42.42.10(pid=26464): Terminating (SIGTERM) 04:45:04.985395 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26465): Terminating (SIGTERM) 04:45:05.028123 run iperf3-srv_10.42.42.10(pid=26466): Terminating (SIGTERM) 04:45:05.070502 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26467): Terminating (SIGTERM) 04:45:05.113134 run iperf3-srv_10.42.42.10(pid=26468): Terminating (SIGTERM) 04:45:05.155888 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26471): Terminating (SIGTERM) 04:45:05.198653 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26477): Terminating (SIGTERM) 04:45:05.241314 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26480): Terminating (SIGTERM) 04:45:05.284279 --- ParallelTerminationStrategy: PID 26461 died... 04:45:05.304664 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26461): Terminated: ok {rc=0} 04:45:05.352225 --- ParallelTerminationStrategy: PID 26462 died... 04:45:05.372567 run iperf3-srv_10.42.42.10(pid=26462): Terminated {rc=256} 04:45:05.419641 --- ParallelTerminationStrategy: PID 26463 died... 04:45:05.439495 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26463): Terminated: ok {rc=0} 04:45:05.486497 --- ParallelTerminationStrategy: PID 26464 died... 04:45:05.506271 run iperf3-srv_10.42.42.10(pid=26464): Terminated {rc=256} 04:45:05.553122 --- ParallelTerminationStrategy: PID 26465 died... 04:45:05.573087 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26465): Terminated: ok {rc=0} 04:45:05.620058 --- ParallelTerminationStrategy: PID 26466 died... 04:45:05.639848 run iperf3-srv_10.42.42.10(pid=26466): Terminated {rc=256} 04:45:05.686338 --- ParallelTerminationStrategy: PID 26467 died... 04:45:05.706091 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26467): Terminated: ok {rc=0} 04:45:05.752767 --- ParallelTerminationStrategy: PID 26468 died... 04:45:05.772535 run iperf3-srv_10.42.42.10(pid=26468): Terminated {rc=256} 04:45:05.819088 --- ParallelTerminationStrategy: PID 26471 died... 04:45:05.838800 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26471): Terminated: ok {rc=0} 04:45:05.885606 --- ParallelTerminationStrategy: PID 26477 died... 04:45:05.905505 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26477): Terminated: ok {rc=0} 04:45:05.952350 --- ParallelTerminationStrategy: PID 26480 died... 04:45:05.972314 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26480): Terminated: ok {rc=0} 04:45:06.061323 bus /gobi_4: Setting Powered False 04:45:07.158772 bus /gobi_4: Setting Powered False 04:45:08.274318 bus /gobi_1: Setting Powered False 04:45:09.374242 bus /gobi_1: Setting Powered False 04:45:10.490955 bus /gobi_0: Setting Powered False 04:45:11.590234 bus /gobi_0: Setting Powered False 04:45:12.707073 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:nanobts+band-900 ping.py ---------------------------------------------- 04:45:13.809841 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:45:13.820699 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 04:45:13.869439 tst ping.py: using LAC 19160 04:45:14.000013 tst ping.py: using RAC 35 04:45:14.120381 tst ping.py: using CellId 19160 04:45:14.237203 tst ping.py: using BVCI 19161 04:45:14.343390 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:45:14.354374 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:45:14.364736 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:45:14.375225 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:45:14.385572 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:45:14.395847 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:45:14.406383 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:45:14.416733 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 04:45:14.531319 tst ping.py:19: start network... 04:45:14.727341 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:45:15.181546 run create_hlr_db(pid=26482): Launched 04:45:15.301433 bus /gobi_6: Setting Powered False 04:45:16.374609 run create_hlr_db(pid=26482): Terminated: ok {rc=0} 04:45:16.904194 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26484): Launched 04:45:17.232290 run osmo-hlr_10.42.42.2(pid=26485): Launched 04:45:17.354583 run osmo-stp_10.42.42.5: Starting osmo-stp 04:45:17.896324 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26487): Launched 04:45:18.210147 run osmo-stp_10.42.42.5(pid=26488): Launched 04:45:18.329820 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:45:18.873476 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26490): Launched 04:45:18.994525 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:45:19.260735 run patchelf(pid=26491): Launched 04:45:19.436649 run osmo-stp_10.42.42.5(pid=26488): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26488)] 04:45:19.570412 run osmo-stp_10.42.42.5(pid=26488): stdout: | (launched: 2022-12-09_04:45:18.153071) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:45:19.705348 run osmo-stp_10.42.42.5(pid=26488): stderr: | 20221209044518342 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044518342 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044518343 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044518343 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044518345 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044518345 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044518346 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:45:19.840259 run osmo-stp_10.42.42.5(pid=26488): stdout: | (launched: 2022-12-09_04:45:18.153071) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:45:19.969886 run osmo-stp_10.42.42.5(pid=26488): stderr: | 20221209044518342 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044518342 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044518343 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044518343 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044518345 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044518345 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044518346 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:45:20.123232 run patchelf(pid=26491): Terminating (SIGINT) 04:45:20.300845 run patchelf(pid=26491): Terminated: ok {rc=0} 04:45:20.429331 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=26488): Process ended prematurely: osmo-stp_10.42.42.5(pid=26488) [trial-2354↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26488)] [trial-2354↪gprs:nanobts+band-900↪ping.py:22] 04:45:20.438794 tst ping.py:22: Test FAILED (6.6 sec) 04:45:20.467686 run osmo-hlr_10.42.42.2(pid=26485): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:nanobts+band-900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26485)] 04:45:20.518318 run osmo-hlr_10.42.42.2(pid=26485): stdout: | (launched: 2022-12-09_04:45:17.173151) 04:45:20.570705 run osmo-hlr_10.42.42.2(pid=26485): stderr: | 20221209044517370 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209044517370 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209044517370 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209044517371 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209044517371 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209044517371 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209044517382 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:nanobts+band-900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209044517391 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209044517391 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209044517391 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:45:20.623837 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26484): Terminating (SIGTERM) 04:45:20.665948 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26487): Terminating (SIGTERM) 04:45:20.708110 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26490): Terminating (SIGTERM) 04:45:20.750704 --- ParallelTerminationStrategy: PID 26484 died... 04:45:20.770907 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26484): Terminated: ok {rc=0} 04:45:20.817750 --- ParallelTerminationStrategy: PID 26487 died... 04:45:20.837466 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26487): Terminated: ok {rc=0} 04:45:20.883990 --- ParallelTerminationStrategy: PID 26490 died... 04:45:20.903505 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26490): Terminated: ok {rc=0} 04:45:20.991537 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:nanobts+band-900 ping_idle_ping.py ---------------------------------------------- 04:45:22.079089 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:45:22.091425 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 04:45:22.141684 tst ping_idle_ping.py: using LAC 19161 04:45:22.268872 tst ping_idle_ping.py: using RAC 36 04:45:22.393160 tst ping_idle_ping.py: using CellId 19161 04:45:22.517048 tst ping_idle_ping.py: using BVCI 19162 04:45:22.631685 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:45:22.642747 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:45:22.653698 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:45:22.664682 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:45:22.675791 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:45:22.686782 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:45:22.698010 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:45:22.709117 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 04:45:22.824628 tst ping_idle_ping.py:24: start network... 04:45:23.023879 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:45:23.483483 run create_hlr_db(pid=26492): Launched 04:45:23.604242 bus /gobi_6: Setting Powered False 04:45:24.664019 run create_hlr_db(pid=26492): Terminated: ok {rc=0} 04:45:25.095485 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26494): Launched 04:45:25.393129 run osmo-hlr_10.42.42.2(pid=26495): Launched 04:45:25.504728 run osmo-stp_10.42.42.5: Starting osmo-stp 04:45:26.010091 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26497): Launched 04:45:26.304534 run osmo-stp_10.42.42.5(pid=26498): Launched 04:45:26.417396 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:45:26.923737 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26500): Launched 04:45:27.037332 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:45:27.285324 run patchelf(pid=26501): Launched 04:45:27.449525 run osmo-stp_10.42.42.5(pid=26498): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26498)] 04:45:27.574448 run osmo-stp_10.42.42.5(pid=26498): stdout: | (launched: 2022-12-09_04:45:26.250284) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:45:27.700806 run osmo-stp_10.42.42.5(pid=26498): stderr: | 20221209044526422 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044526422 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044526422 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044526423 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044526423 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044526423 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044526423 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:45:27.827452 run osmo-stp_10.42.42.5(pid=26498): stdout: | (launched: 2022-12-09_04:45:26.250284) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:45:27.948385 run osmo-stp_10.42.42.5(pid=26498): stderr: | 20221209044526422 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044526422 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044526422 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044526423 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044526423 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044526423 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044526423 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:45:28.091603 run patchelf(pid=26501): Terminating (SIGINT) 04:45:28.259006 run patchelf(pid=26501): Terminated: ok {rc=0} 04:45:28.379132 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=26498): Process ended prematurely: osmo-stp_10.42.42.5(pid=26498) [trial-2354↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26498)] [trial-2354↪gprs:nanobts+band-900↪ping_idle_ping.py:27] 04:45:28.388441 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 04:45:28.415833 run osmo-hlr_10.42.42.2(pid=26495): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:nanobts+band-900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26495)] 04:45:28.463724 run osmo-hlr_10.42.42.2(pid=26495): stdout: | (launched: 2022-12-09_04:45:25.338759) 04:45:28.513419 run osmo-hlr_10.42.42.2(pid=26495): stderr: | 20221209044525513 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209044525513 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209044525513 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209044525513 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209044525513 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209044525513 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209044525526 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:nanobts+band-900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209044525535 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209044525535 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209044525535 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:45:28.563608 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26494): Terminating (SIGTERM) 04:45:28.603806 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26497): Terminating (SIGTERM) 04:45:28.643645 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26500): Terminating (SIGTERM) 04:45:28.683969 --- ParallelTerminationStrategy: PID 26494 died... 04:45:28.702968 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26494): Terminated: ok {rc=0} 04:45:28.747737 --- ParallelTerminationStrategy: PID 26497 died... 04:45:28.766724 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26497): Terminated: ok {rc=0} 04:45:28.811468 --- ParallelTerminationStrategy: PID 26500 died... 04:45:28.830561 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26500): Terminated: ok {rc=0} 04:45:28.917169 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2354 gprs:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 gprs:nanobts+band-900+mod-bts0-egprs --------------------------------------------------------------------- 04:45:30.222201 tst gprs:nanobts+band-900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:45:30.228713 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 04:45:30.262020 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 04:45:30.301149 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 04:45:30.390653 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 04:45:30.423743 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 04:45:30.463026 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 04:45:31.065548 tst gprs:nanobts+band-900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2354 gprs:nanobts+band-900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 04:45:31.133503 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:45:31.148528 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:45:31.199833 tst cs_paging_gprs_active.py: using LAC 19162 04:45:31.329216 tst cs_paging_gprs_active.py: using RAC 37 04:45:31.455923 tst cs_paging_gprs_active.py: using CellId 19162 04:45:31.610432 tst cs_paging_gprs_active.py: using BVCI 19163 04:45:31.723389 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:45:31.735429 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:45:31.747378 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:45:31.759537 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:45:31.774191 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:45:31.786797 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:45:31.798484 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:45:31.811774 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:45:31.825420 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:45:31.963313 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:45:32.112485 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 04:45:32.367061 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:45:32.690699 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26506): Launched 04:45:32.970295 run iperf3-srv_10.42.42.10(pid=26507): Launched 04:45:33.091105 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 04:45:33.307329 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:45:33.630033 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26508): Launched 04:45:33.909649 run iperf3-srv_10.42.42.10(pid=26509): Launched 04:45:34.029826 tst cs_paging_gprs_active.py:38: start network... 04:45:34.245558 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:45:34.744556 run create_hlr_db(pid=26510): Launched 04:45:34.868282 bus /gobi_6: Setting Powered False 04:45:35.932736 run create_hlr_db(pid=26510): Terminated: ok {rc=0} 04:45:36.361030 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26512): Launched 04:45:36.660752 run osmo-hlr_10.42.42.2(pid=26513): Launched 04:45:36.776889 run osmo-stp_10.42.42.5: Starting osmo-stp 04:45:37.293237 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26515): Launched 04:45:37.592404 run osmo-stp_10.42.42.5(pid=26516): Launched 04:45:37.706313 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:45:38.224257 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26518): Launched 04:45:38.339092 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:45:38.592202 run patchelf(pid=26519): Launched 04:45:38.759279 run osmo-stp_10.42.42.5(pid=26516): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26516)] 04:45:38.886083 run osmo-stp_10.42.42.5(pid=26516): stdout: | (launched: 2022-12-09_04:45:37.537327) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:45:39.014089 run osmo-stp_10.42.42.5(pid=26516): stderr: | 20221209044537708 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044537708 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044537708 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044537709 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044537711 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044537711 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044537711 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:45:39.143275 run osmo-stp_10.42.42.5(pid=26516): stdout: | (launched: 2022-12-09_04:45:37.537327) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:45:39.266172 run osmo-stp_10.42.42.5(pid=26516): stderr: | 20221209044537708 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044537708 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044537708 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044537709 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044537711 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044537711 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044537711 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:45:39.412012 run patchelf(pid=26519): Terminating (SIGINT) 04:45:39.580728 run patchelf(pid=26519): Terminated: ok {rc=0} 04:45:39.702473 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=26516): Process ended prematurely: osmo-stp_10.42.42.5(pid=26516) [trial-2354↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26516)] [trial-2354↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 04:45:39.711827 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 04:45:39.739130 run osmo-hlr_10.42.42.2(pid=26513): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26513)] 04:45:39.786746 run osmo-hlr_10.42.42.2(pid=26513): stdout: | (launched: 2022-12-09_04:45:36.605740) 04:45:39.836228 run osmo-hlr_10.42.42.2(pid=26513): stderr: | 20221209044536781 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209044536781 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209044536781 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209044536781 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209044536781 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209044536781 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209044536793 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:nanobts+band-900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209044536802 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209044536802 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209044536802 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:45:39.886226 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26506): Terminating (SIGTERM) 04:45:39.926070 run iperf3-srv_10.42.42.10(pid=26507): Terminating (SIGTERM) 04:45:39.966585 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26508): Terminating (SIGTERM) 04:45:40.006629 run iperf3-srv_10.42.42.10(pid=26509): Terminating (SIGTERM) 04:45:40.046412 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26512): Terminating (SIGTERM) 04:45:40.086248 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26515): Terminating (SIGTERM) 04:45:40.126157 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26518): Terminating (SIGTERM) 04:45:40.166201 --- ParallelTerminationStrategy: PID 26506 died... 04:45:40.185450 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26506): Terminated: ok {rc=0} 04:45:40.229746 --- ParallelTerminationStrategy: PID 26507 died... 04:45:40.248660 run iperf3-srv_10.42.42.10(pid=26507): Terminated {rc=256} 04:45:40.292729 --- ParallelTerminationStrategy: PID 26508 died... 04:45:40.311779 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26508): Terminated: ok {rc=0} 04:45:40.355911 --- ParallelTerminationStrategy: PID 26509 died... 04:45:40.374761 run iperf3-srv_10.42.42.10(pid=26509): Terminated {rc=256} 04:45:40.418737 --- ParallelTerminationStrategy: PID 26512 died... 04:45:40.437568 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26512): Terminated: ok {rc=0} 04:45:40.481558 --- ParallelTerminationStrategy: PID 26515 died... 04:45:40.500306 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26515): Terminated: ok {rc=0} 04:45:40.544069 --- ParallelTerminationStrategy: PID 26518 died... 04:45:40.562952 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26518): Terminated: ok {rc=0} 04:45:40.648711 bus /gobi_0: Setting Powered False 04:45:41.748434 bus /gobi_0: Setting Powered False 04:45:42.864626 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:nanobts+band-900+mod-bts0-egprs iperf3.py ---------------------------------------------- 04:45:44.013271 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:45:44.025007 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:45:44.078001 tst iperf3.py: using LAC 19163 04:45:44.204730 tst iperf3.py: using RAC 38 04:45:44.331741 tst iperf3.py: using CellId 19163 04:45:44.452357 tst iperf3.py: using BVCI 19164 04:45:44.569984 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:45:44.581394 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:45:44.592393 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:45:44.603740 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:45:44.615159 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:45:44.626368 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:45:44.637823 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:45:44.648877 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:45:44.660357 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:45:44.778962 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 04:45:44.996579 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:45:45.320812 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26520): Launched 04:45:45.602195 run iperf3-srv_10.42.42.10(pid=26521): Launched 04:45:45.723186 tst iperf3.py:8: start network... 04:45:45.950828 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:45:46.469574 run create_hlr_db(pid=26522): Launched 04:45:46.624504 bus /gobi_6: Setting Powered False 04:45:47.689319 run create_hlr_db(pid=26522): Terminated: ok {rc=0} 04:45:48.117509 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26524): Launched 04:45:48.417490 run osmo-hlr_10.42.42.2(pid=26525): Launched 04:45:48.531800 run osmo-stp_10.42.42.5: Starting osmo-stp 04:45:49.063648 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26527): Launched 04:45:49.362863 run osmo-stp_10.42.42.5(pid=26528): Launched 04:45:49.476823 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:45:49.990631 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26530): Launched 04:45:50.104620 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:45:50.356567 run patchelf(pid=26531): Launched 04:45:50.522686 run osmo-stp_10.42.42.5(pid=26528): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26528)] 04:45:50.648934 run osmo-stp_10.42.42.5(pid=26528): stdout: | (launched: 2022-12-09_04:45:49.307996) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:45:50.776794 run osmo-stp_10.42.42.5(pid=26528): stderr: | 20221209044549479 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044549479 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044549480 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044549480 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044549481 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044549481 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044549481 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:45:50.904909 run osmo-stp_10.42.42.5(pid=26528): stdout: | (launched: 2022-12-09_04:45:49.307996) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:45:51.027235 run osmo-stp_10.42.42.5(pid=26528): stderr: | 20221209044549479 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044549479 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044549480 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044549480 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044549481 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044549481 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044549481 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:45:51.172310 run patchelf(pid=26531): Terminating (SIGINT) 04:45:51.341829 run patchelf(pid=26531): Terminated: ok {rc=0} 04:45:51.463010 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26528): Process ended prematurely: osmo-stp_10.42.42.5(pid=26528) [trial-2354↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26528)] [trial-2354↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8] 04:45:51.472385 tst iperf3.py:8: Test FAILED (7.5 sec) 04:45:51.499745 run osmo-hlr_10.42.42.2(pid=26525): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26525)] 04:45:51.547331 run osmo-hlr_10.42.42.2(pid=26525): stdout: | (launched: 2022-12-09_04:45:48.361869) 04:45:51.596695 run osmo-hlr_10.42.42.2(pid=26525): stderr: | 20221209044548538 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209044548538 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209044548538 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209044548538 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209044548538 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209044548538 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209044548550 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:nanobts+band-900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209044548561 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209044548561 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209044548561 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:45:51.646577 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26520): Terminating (SIGTERM) 04:45:51.686189 run iperf3-srv_10.42.42.10(pid=26521): Terminating (SIGTERM) 04:45:51.725615 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26524): Terminating (SIGTERM) 04:45:51.765099 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26527): Terminating (SIGTERM) 04:45:51.804484 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26530): Terminating (SIGTERM) 04:45:51.844631 --- ParallelTerminationStrategy: PID 26520 died... 04:45:51.863794 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26520): Terminated: ok {rc=0} 04:45:51.908259 --- ParallelTerminationStrategy: PID 26521 died... 04:45:51.927175 run iperf3-srv_10.42.42.10(pid=26521): Terminated {rc=256} 04:45:51.971090 --- ParallelTerminationStrategy: PID 26524 died... 04:45:51.990099 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26524): Terminated: ok {rc=0} 04:45:52.034076 --- ParallelTerminationStrategy: PID 26527 died... 04:45:52.052662 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26527): Terminated: ok {rc=0} 04:45:52.096907 --- ParallelTerminationStrategy: PID 26530 died... 04:45:52.116155 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26530): Terminated: ok {rc=0} 04:45:52.202644 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:nanobts+band-900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 04:45:53.351430 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:45:53.363008 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:45:53.413309 tst iperf3m4.py: using LAC 19164 04:45:53.540705 tst iperf3m4.py: using RAC 39 04:45:53.666043 tst iperf3m4.py: using CellId 19164 04:45:53.791608 tst iperf3m4.py: using BVCI 19165 04:45:53.900108 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:45:53.911154 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:45:53.922132 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:45:53.932896 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:45:53.943498 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:45:53.954058 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:45:53.964777 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:45:53.975506 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:45:53.986268 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:45:54.099559 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:45:54.219686 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:45:54.336464 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:45:54.455249 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 04:45:54.655813 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:45:54.955565 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26532): Launched 04:45:55.217474 run iperf3-srv_10.42.42.10(pid=26533): Launched 04:45:55.330248 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 04:45:55.529730 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:45:55.828923 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26534): Launched 04:45:56.089437 run iperf3-srv_10.42.42.10(pid=26535): Launched 04:45:56.201991 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 04:45:56.401010 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:45:56.700747 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26536): Launched 04:45:56.961697 run iperf3-srv_10.42.42.10(pid=26537): Launched 04:45:57.074300 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 04:45:57.274263 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:45:57.574299 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26538): Launched 04:45:57.835965 run iperf3-srv_10.42.42.10(pid=26539): Launched 04:45:57.948425 tst iperf3m4.py:8: start network... 04:45:58.148522 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:45:58.611691 run create_hlr_db(pid=26540): Launched 04:45:58.734566 bus /gobi_6: Setting Powered False 04:45:59.794212 run create_hlr_db(pid=26540): Terminated: ok {rc=0} 04:46:00.231548 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26542): Launched 04:46:00.553265 run osmo-hlr_10.42.42.2(pid=26543): Launched 04:46:00.676867 run osmo-stp_10.42.42.5: Starting osmo-stp 04:46:01.272829 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26545): Launched 04:46:01.613664 run osmo-stp_10.42.42.5(pid=26546): Launched 04:46:01.821321 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:46:02.498905 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26548): Launched 04:46:02.617270 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:46:02.870619 run patchelf(pid=26549): Launched 04:46:03.036774 run osmo-stp_10.42.42.5(pid=26546): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26546)] 04:46:03.163449 run osmo-stp_10.42.42.5(pid=26546): stdout: | (launched: 2022-12-09_04:46:01.542944) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:46:03.291854 run osmo-stp_10.42.42.5(pid=26546): stderr: | 20221209044601852 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044601852 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044601853 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044601853 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044601853 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044601854 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044601854 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:46:03.420542 run osmo-stp_10.42.42.5(pid=26546): stdout: | (launched: 2022-12-09_04:46:01.542944) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:46:03.543267 run osmo-stp_10.42.42.5(pid=26546): stderr: | 20221209044601852 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044601852 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044601853 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044601853 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044601853 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044601854 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044601854 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:46:03.688391 run patchelf(pid=26549): Terminating (SIGINT) 04:46:03.856866 run patchelf(pid=26549): Terminated: ok {rc=0} 04:46:03.978288 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26546): Process ended prematurely: osmo-stp_10.42.42.5(pid=26546) [trial-2354↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26546)] [trial-2354↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8] 04:46:03.987628 tst iperf3m4.py:8: Test FAILED (10.7 sec) 04:46:04.017633 run osmo-hlr_10.42.42.2(pid=26543): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26543)] 04:46:04.065972 run osmo-hlr_10.42.42.2(pid=26543): stdout: | (launched: 2022-12-09_04:46:00.494707) 04:46:04.115661 run osmo-hlr_10.42.42.2(pid=26543): stderr: | 20221209044600694 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209044600695 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209044600695 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209044600695 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209044600695 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209044600695 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209044600707 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:nanobts+band-900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209044600715 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209044600715 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209044600715 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:46:04.165734 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26532): Terminating (SIGTERM) 04:46:04.205737 run iperf3-srv_10.42.42.10(pid=26533): Terminating (SIGTERM) 04:46:04.245544 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26534): Terminating (SIGTERM) 04:46:04.285750 run iperf3-srv_10.42.42.10(pid=26535): Terminating (SIGTERM) 04:46:04.325517 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26536): Terminating (SIGTERM) 04:46:04.365448 run iperf3-srv_10.42.42.10(pid=26537): Terminating (SIGTERM) 04:46:04.405220 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26538): Terminating (SIGTERM) 04:46:04.445183 run iperf3-srv_10.42.42.10(pid=26539): Terminating (SIGTERM) 04:46:04.484980 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26542): Terminating (SIGTERM) 04:46:04.524833 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26545): Terminating (SIGTERM) 04:46:04.564829 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26548): Terminating (SIGTERM) 04:46:04.605324 --- ParallelTerminationStrategy: PID 26532 died... 04:46:04.624170 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26532): Terminated: ok {rc=0} 04:46:04.669202 --- ParallelTerminationStrategy: PID 26533 died... 04:46:04.687986 run iperf3-srv_10.42.42.10(pid=26533): Terminated {rc=256} 04:46:04.732190 --- ParallelTerminationStrategy: PID 26534 died... 04:46:04.751115 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26534): Terminated: ok {rc=0} 04:46:04.795374 --- ParallelTerminationStrategy: PID 26535 died... 04:46:04.814756 run iperf3-srv_10.42.42.10(pid=26535): Terminated {rc=256} 04:46:04.858882 --- ParallelTerminationStrategy: PID 26536 died... 04:46:04.877773 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26536): Terminated: ok {rc=0} 04:46:04.921809 --- ParallelTerminationStrategy: PID 26537 died... 04:46:04.940539 run iperf3-srv_10.42.42.10(pid=26537): Terminated {rc=256} 04:46:04.984466 --- ParallelTerminationStrategy: PID 26538 died... 04:46:05.003113 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26538): Terminated: ok {rc=0} 04:46:05.047153 --- ParallelTerminationStrategy: PID 26539 died... 04:46:05.065814 run iperf3-srv_10.42.42.10(pid=26539): Terminated {rc=256} 04:46:05.109764 --- ParallelTerminationStrategy: PID 26542 died... 04:46:05.128570 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26542): Terminated: ok {rc=0} 04:46:05.172632 --- ParallelTerminationStrategy: PID 26545 died... 04:46:05.191509 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26545): Terminated: ok {rc=0} 04:46:05.235543 --- ParallelTerminationStrategy: PID 26548 died... 04:46:05.254535 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26548): Terminated: ok {rc=0} 04:46:05.341319 bus /gobi_4: Setting Powered False 04:46:06.442300 bus /gobi_4: Setting Powered False 04:46:07.559539 bus /gobi_1: Setting Powered False 04:46:08.659406 bus /gobi_1: Setting Powered False 04:46:09.776058 bus /gobi_0: Setting Powered False 04:46:10.874799 bus /gobi_0: Setting Powered False 04:46:11.991864 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:nanobts+band-900+mod-bts0-egprs ping.py ---------------------------------------------- 04:46:13.096047 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:46:13.107659 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:46:13.155636 tst ping.py: using LAC 19165 04:46:13.271539 tst ping.py: using RAC 40 04:46:13.385369 tst ping.py: using CellId 19165 04:46:13.500054 tst ping.py: using BVCI 19166 04:46:13.606335 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:46:13.617239 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:46:13.627880 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:46:13.638559 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:46:13.649096 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:46:13.659609 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:46:13.670508 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:46:13.681212 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:46:13.793887 tst ping.py:19: start network... 04:46:13.988940 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:46:14.443084 run create_hlr_db(pid=26550): Launched 04:46:14.563529 bus /gobi_6: Setting Powered False 04:46:15.622765 run create_hlr_db(pid=26550): Terminated: ok {rc=0} 04:46:16.075959 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26552): Launched 04:46:16.427638 run osmo-hlr_10.42.42.2(pid=26553): Launched 04:46:16.652006 run osmo-stp_10.42.42.5: Starting osmo-stp 04:46:17.363477 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26555): Launched 04:46:17.686561 run osmo-stp_10.42.42.5(pid=26556): Launched 04:46:17.808033 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:46:18.354308 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26558): Launched 04:46:18.476351 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:46:18.743521 run patchelf(pid=26559): Launched 04:46:18.919388 run osmo-stp_10.42.42.5(pid=26556): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26556)] 04:46:19.053606 run osmo-stp_10.42.42.5(pid=26556): stdout: | (launched: 2022-12-09_04:46:17.629008) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:46:19.189444 run osmo-stp_10.42.42.5(pid=26556): stderr: | 20221209044617820 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044617820 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044617820 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044617821 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044617823 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044617823 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044617823 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:46:19.325742 run osmo-stp_10.42.42.5(pid=26556): stdout: | (launched: 2022-12-09_04:46:17.629008) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:46:19.456216 run osmo-stp_10.42.42.5(pid=26556): stderr: | 20221209044617820 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044617820 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044617820 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044617821 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044617823 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044617823 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044617823 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:46:19.610774 run patchelf(pid=26559): Terminating (SIGINT) 04:46:19.788328 run patchelf(pid=26559): Terminated: ok {rc=0} 04:46:19.916160 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=26556): Process ended prematurely: osmo-stp_10.42.42.5(pid=26556) [trial-2354↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26556)] [trial-2354↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22] 04:46:19.925791 tst ping.py:22: Test FAILED (6.8 sec) 04:46:19.954842 run osmo-hlr_10.42.42.2(pid=26553): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26553)] 04:46:20.005350 run osmo-hlr_10.42.42.2(pid=26553): stdout: | (launched: 2022-12-09_04:46:16.354625) 04:46:20.057729 run osmo-hlr_10.42.42.2(pid=26553): stderr: | 20221209044616574 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209044616574 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209044616574 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209044616574 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209044616574 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209044616574 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209044616589 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:nanobts+band-900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209044616613 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209044616613 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209044616613 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:46:20.110503 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26552): Terminating (SIGTERM) 04:46:20.153058 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26555): Terminating (SIGTERM) 04:46:20.195571 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26558): Terminating (SIGTERM) 04:46:20.238605 --- ParallelTerminationStrategy: PID 26552 died... 04:46:20.258733 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26552): Terminated: ok {rc=0} 04:46:20.306409 --- ParallelTerminationStrategy: PID 26555 died... 04:46:20.326364 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26555): Terminated: ok {rc=0} 04:46:20.373530 --- ParallelTerminationStrategy: PID 26558 died... 04:46:20.393410 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26558): Terminated: ok {rc=0} 04:46:20.482805 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:nanobts+band-900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 04:46:21.567649 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:46:21.579334 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:46:21.628658 tst ping_idle_ping.py: using LAC 19166 04:46:21.746736 tst ping_idle_ping.py: using RAC 41 04:46:21.862399 tst ping_idle_ping.py: using CellId 19166 04:46:21.976220 tst ping_idle_ping.py: using BVCI 19167 04:46:22.082709 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:46:22.093720 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:46:22.104332 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:46:22.114912 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:46:22.125483 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:46:22.135982 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:46:22.146867 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:46:22.157535 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:46:22.273131 tst ping_idle_ping.py:24: start network... 04:46:22.469670 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:46:22.928112 run create_hlr_db(pid=26560): Launched 04:46:23.048822 bus /gobi_6: Setting Powered False 04:46:24.108908 run create_hlr_db(pid=26560): Terminated: ok {rc=0} 04:46:24.542083 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26562): Launched 04:46:24.857762 run osmo-hlr_10.42.42.2(pid=26563): Launched 04:46:24.978494 run osmo-stp_10.42.42.5: Starting osmo-stp 04:46:25.529276 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26565): Launched 04:46:25.845918 run osmo-stp_10.42.42.5(pid=26566): Launched 04:46:25.967617 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:46:26.514693 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26568): Launched 04:46:26.636146 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:46:26.903009 run patchelf(pid=26569): Launched 04:46:27.079913 run osmo-stp_10.42.42.5(pid=26566): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26566)] 04:46:27.214344 run osmo-stp_10.42.42.5(pid=26566): stdout: | (launched: 2022-12-09_04:46:25.788069) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:46:27.350205 run osmo-stp_10.42.42.5(pid=26566): stderr: | 20221209044625977 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044625977 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044625978 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044625978 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044625978 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044625978 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044625978 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:46:27.487074 run osmo-stp_10.42.42.5(pid=26566): stdout: | (launched: 2022-12-09_04:46:25.788069) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:46:27.617364 run osmo-stp_10.42.42.5(pid=26566): stderr: | 20221209044625977 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044625977 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044625978 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044625978 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044625978 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044625978 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044625978 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:46:27.771200 run patchelf(pid=26569): Terminating (SIGINT) 04:46:27.949777 run patchelf(pid=26569): Terminated: ok {rc=0} 04:46:28.078412 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=26566): Process ended prematurely: osmo-stp_10.42.42.5(pid=26566) [trial-2354↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26566)] [trial-2354↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27] 04:46:28.087984 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 04:46:28.117318 run osmo-hlr_10.42.42.2(pid=26563): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26563)] 04:46:28.168047 run osmo-hlr_10.42.42.2(pid=26563): stdout: | (launched: 2022-12-09_04:46:24.800138) 04:46:28.220885 run osmo-hlr_10.42.42.2(pid=26563): stderr: | 20221209044624996 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209044624996 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209044624996 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209044624996 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209044624997 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209044624997 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209044625008 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:nanobts+band-900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209044625018 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209044625018 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209044625018 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:46:28.273815 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26562): Terminating (SIGTERM) 04:46:28.315990 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26565): Terminating (SIGTERM) 04:46:28.358476 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26568): Terminating (SIGTERM) 04:46:28.401207 --- ParallelTerminationStrategy: PID 26562 died... 04:46:28.421741 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26562): Terminated: ok {rc=0} 04:46:28.468920 --- ParallelTerminationStrategy: PID 26565 died... 04:46:28.488866 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26565): Terminated: ok {rc=0} 04:46:28.535980 --- ParallelTerminationStrategy: PID 26568 died... 04:46:28.555786 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26568): Terminated: ok {rc=0} 04:46:28.644422 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2354 gprs:nanobts+band-900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 gprs:nanobts+band-900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 04:46:29.952615 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:46:29.959981 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 04:46:29.993513 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 04:46:30.032587 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 04:46:30.121165 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 04:46:30.153954 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 04:46:30.193190 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 04:46:30.785488 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2354 gprs:nanobts+band-900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 04:46:30.838998 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:46:30.853906 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:46:30.931478 tst cs_paging_gprs_active.py: using LAC 19167 04:46:31.061604 tst cs_paging_gprs_active.py: using RAC 42 04:46:31.191294 tst cs_paging_gprs_active.py: using CellId 19167 04:46:31.340533 tst cs_paging_gprs_active.py: using BVCI 19168 04:46:31.462445 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:46:31.474975 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:46:31.487939 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:46:31.500089 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:46:31.513099 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:46:31.527580 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:46:31.540876 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:46:31.552880 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:46:31.566317 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:46:31.691956 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:46:31.836614 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 04:46:32.061327 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:46:32.367981 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26573): Launched 04:46:32.629453 run iperf3-srv_10.42.42.10(pid=26574): Launched 04:46:32.742731 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 04:46:32.943134 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:46:33.244302 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26575): Launched 04:46:33.505702 run iperf3-srv_10.42.42.10(pid=26576): Launched 04:46:33.620776 tst cs_paging_gprs_active.py:38: start network... 04:46:33.820795 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:46:34.284559 run create_hlr_db(pid=26577): Launched 04:46:34.408759 bus /gobi_6: Setting Powered False 04:46:35.472835 run create_hlr_db(pid=26577): Terminated: ok {rc=0} 04:46:35.920254 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26579): Launched 04:46:36.241155 run osmo-hlr_10.42.42.2(pid=26580): Launched 04:46:36.364537 run osmo-stp_10.42.42.5: Starting osmo-stp 04:46:36.920651 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26582): Launched 04:46:37.241700 run osmo-stp_10.42.42.5(pid=26583): Launched 04:46:37.365130 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:46:37.922184 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26585): Launched 04:46:38.046683 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:46:38.319733 run patchelf(pid=26586): Launched 04:46:38.500335 run osmo-stp_10.42.42.5(pid=26583): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26583)] 04:46:38.637743 run osmo-stp_10.42.42.5(pid=26583): stdout: | (launched: 2022-12-09_04:46:37.183298) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:46:38.776286 run osmo-stp_10.42.42.5(pid=26583): stderr: | 20221209044637374 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044637374 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044637374 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044637374 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044637377 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044637377 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044637377 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:46:38.915114 run osmo-stp_10.42.42.5(pid=26583): stdout: | (launched: 2022-12-09_04:46:37.183298) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:46:39.047965 run osmo-stp_10.42.42.5(pid=26583): stderr: | 20221209044637374 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044637374 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044637374 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044637374 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044637377 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044637377 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044637377 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:46:39.205648 run patchelf(pid=26586): Terminating (SIGINT) 04:46:39.387910 run patchelf(pid=26586): Terminated: ok {rc=0} 04:46:39.519932 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=26583): Process ended prematurely: osmo-stp_10.42.42.5(pid=26583) [trial-2354↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26583)] [trial-2354↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 04:46:39.530279 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 04:46:39.559709 run osmo-hlr_10.42.42.2(pid=26580): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26580)] 04:46:39.611102 run osmo-hlr_10.42.42.2(pid=26580): stdout: | (launched: 2022-12-09_04:46:36.182646) 04:46:39.664200 run osmo-hlr_10.42.42.2(pid=26580): stderr: | 20221209044636382 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209044636382 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209044636382 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209044636382 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209044636382 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209044636382 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209044636394 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:nanobts+band-900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209044636402 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209044636402 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209044636402 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:46:39.717863 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26573): Terminating (SIGTERM) 04:46:39.760805 run iperf3-srv_10.42.42.10(pid=26574): Terminating (SIGTERM) 04:46:39.803647 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26575): Terminating (SIGTERM) 04:46:39.846775 run iperf3-srv_10.42.42.10(pid=26576): Terminating (SIGTERM) 04:46:39.890510 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26579): Terminating (SIGTERM) 04:46:39.933670 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26582): Terminating (SIGTERM) 04:46:39.974090 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26585): Terminating (SIGTERM) 04:46:40.014720 --- ParallelTerminationStrategy: PID 26573 died... 04:46:40.034211 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26573): Terminated: ok {rc=0} 04:46:40.078754 --- ParallelTerminationStrategy: PID 26574 died... 04:46:40.097786 run iperf3-srv_10.42.42.10(pid=26574): Terminated {rc=256} 04:46:40.142002 --- ParallelTerminationStrategy: PID 26575 died... 04:46:40.160861 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26575): Terminated: ok {rc=0} 04:46:40.205293 --- ParallelTerminationStrategy: PID 26576 died... 04:46:40.224202 run iperf3-srv_10.42.42.10(pid=26576): Terminated {rc=256} 04:46:40.268485 --- ParallelTerminationStrategy: PID 26579 died... 04:46:40.287298 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26579): Terminated: ok {rc=0} 04:46:40.331922 --- ParallelTerminationStrategy: PID 26582 died... 04:46:40.350999 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26582): Terminated: ok {rc=0} 04:46:40.395219 --- ParallelTerminationStrategy: PID 26585 died... 04:46:40.414222 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26585): Terminated: ok {rc=0} 04:46:40.500358 bus /gobi_0: Setting Powered False 04:46:41.602044 bus /gobi_0: Setting Powered False 04:46:42.719606 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 04:46:43.865956 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:46:43.877514 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:46:43.945603 tst iperf3.py: using LAC 19168 04:46:44.064772 tst iperf3.py: using RAC 43 04:46:44.182269 tst iperf3.py: using CellId 19168 04:46:44.299521 tst iperf3.py: using BVCI 19169 04:46:44.409431 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:46:44.420151 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:46:44.430857 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:46:44.441578 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:46:44.452162 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:46:44.462893 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:46:44.473600 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:46:44.484106 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:46:44.494819 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:46:44.609360 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 04:46:44.810096 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:46:45.111234 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26587): Launched 04:46:45.373690 run iperf3-srv_10.42.42.10(pid=26588): Launched 04:46:45.487130 tst iperf3.py:8: start network... 04:46:45.688234 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:46:46.163452 run create_hlr_db(pid=26589): Launched 04:46:46.316152 bus /gobi_6: Setting Powered False 04:46:47.381507 run create_hlr_db(pid=26589): Terminated: ok {rc=0} 04:46:47.833440 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26591): Launched 04:46:48.156638 run osmo-hlr_10.42.42.2(pid=26592): Launched 04:46:48.279846 run osmo-stp_10.42.42.5: Starting osmo-stp 04:46:48.836595 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26594): Launched 04:46:49.158095 run osmo-stp_10.42.42.5(pid=26595): Launched 04:46:49.281234 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:46:49.837030 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26597): Launched 04:46:49.960568 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:46:50.233089 run patchelf(pid=26598): Launched 04:46:50.413255 run osmo-stp_10.42.42.5(pid=26595): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26595)] 04:46:50.550134 run osmo-stp_10.42.42.5(pid=26595): stdout: | (launched: 2022-12-09_04:46:49.099667) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:46:50.688015 run osmo-stp_10.42.42.5(pid=26595): stderr: | 20221209044649291 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044649291 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044649291 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044649292 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044649292 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044649292 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044649292 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:46:50.826355 run osmo-stp_10.42.42.5(pid=26595): stdout: | (launched: 2022-12-09_04:46:49.099667) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:46:50.958941 run osmo-stp_10.42.42.5(pid=26595): stderr: | 20221209044649291 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044649291 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044649291 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044649292 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044649292 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044649292 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044649292 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:46:51.115656 run patchelf(pid=26598): Terminating (SIGINT) 04:46:51.296808 run patchelf(pid=26598): Terminated: ok {rc=0} 04:46:51.428445 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26595): Process ended prematurely: osmo-stp_10.42.42.5(pid=26595) [trial-2354↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26595)] [trial-2354↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8] 04:46:51.438925 tst iperf3.py:8: Test FAILED (7.6 sec) 04:46:51.469542 run osmo-hlr_10.42.42.2(pid=26592): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26592)] 04:46:51.521328 run osmo-hlr_10.42.42.2(pid=26592): stdout: | (launched: 2022-12-09_04:46:48.097863) 04:46:51.574537 run osmo-hlr_10.42.42.2(pid=26592): stderr: | 20221209044648295 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209044648295 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209044648295 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209044648295 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209044648295 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209044648295 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209044648309 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209044648318 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209044648318 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209044648318 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:46:51.628351 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26587): Terminating (SIGTERM) 04:46:51.671490 run iperf3-srv_10.42.42.10(pid=26588): Terminating (SIGTERM) 04:46:51.714542 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26591): Terminating (SIGTERM) 04:46:51.757690 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26594): Terminating (SIGTERM) 04:46:51.800680 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26597): Terminating (SIGTERM) 04:46:51.844084 --- ParallelTerminationStrategy: PID 26587 died... 04:46:51.864431 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26587): Terminated: ok {rc=0} 04:46:51.912649 --- ParallelTerminationStrategy: PID 26588 died... 04:46:51.932346 run iperf3-srv_10.42.42.10(pid=26588): Terminated {rc=256} 04:46:51.979801 --- ParallelTerminationStrategy: PID 26591 died... 04:46:51.999464 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26591): Terminated: ok {rc=0} 04:46:52.047361 --- ParallelTerminationStrategy: PID 26594 died... 04:46:52.067249 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26594): Terminated: ok {rc=0} 04:46:52.115308 --- ParallelTerminationStrategy: PID 26597 died... 04:46:52.135104 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26597): Terminated: ok {rc=0} 04:46:52.224584 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 04:46:53.372710 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:46:53.384475 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:46:53.451062 tst iperf3m4.py: using LAC 19169 04:46:53.576341 tst iperf3m4.py: using RAC 44 04:46:53.693369 tst iperf3m4.py: using CellId 19169 04:46:53.809890 tst iperf3m4.py: using BVCI 19170 04:46:53.918786 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:46:53.929891 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:46:53.940792 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:46:53.952058 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:46:53.963088 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:46:53.974162 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:46:53.985309 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:46:53.996573 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:46:54.007848 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:46:54.126297 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:46:54.243670 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:46:54.360419 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:46:54.475259 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 04:46:54.675864 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:46:54.976913 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26599): Launched 04:46:55.239215 run iperf3-srv_10.42.42.10(pid=26600): Launched 04:46:55.352807 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 04:46:55.553334 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:46:55.854616 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26601): Launched 04:46:56.115331 run iperf3-srv_10.42.42.10(pid=26602): Launched 04:46:56.227632 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 04:46:56.427236 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:46:56.727792 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26603): Launched 04:46:56.989210 run iperf3-srv_10.42.42.10(pid=26604): Launched 04:46:57.102453 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 04:46:57.302148 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:46:57.603384 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26605): Launched 04:46:57.866599 run iperf3-srv_10.42.42.10(pid=26606): Launched 04:46:57.979430 tst iperf3m4.py:8: start network... 04:46:58.179039 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:46:58.642201 run create_hlr_db(pid=26607): Launched 04:46:58.765177 bus /gobi_6: Setting Powered False 04:46:59.826075 run create_hlr_db(pid=26607): Terminated: ok {rc=0} 04:47:00.243563 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26610): Launched 04:47:00.543217 run osmo-hlr_10.42.42.2(pid=26611): Launched 04:47:00.657865 run osmo-stp_10.42.42.5: Starting osmo-stp 04:47:01.284340 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26613): Launched 04:47:01.603779 run osmo-stp_10.42.42.5(pid=26614): Launched 04:47:01.723011 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:47:02.433790 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26616): Launched 04:47:02.557387 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:47:02.810320 run patchelf(pid=26617): Launched 04:47:02.976806 run osmo-stp_10.42.42.5(pid=26614): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26614)] 04:47:03.103148 run osmo-stp_10.42.42.5(pid=26614): stdout: | (launched: 2022-12-09_04:47:01.540664) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:47:03.231335 run osmo-stp_10.42.42.5(pid=26614): stderr: | 20221209044701910 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044701910 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044701910 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044701911 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044701911 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044701911 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044701911 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:47:03.359255 run osmo-stp_10.42.42.5(pid=26614): stdout: | (launched: 2022-12-09_04:47:01.540664) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:47:03.481587 run osmo-stp_10.42.42.5(pid=26614): stderr: | 20221209044701910 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044701910 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044701910 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044701911 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044701911 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044701911 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044701911 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:47:03.626648 run patchelf(pid=26617): Terminating (SIGINT) 04:47:03.796544 run patchelf(pid=26617): Terminated: ok {rc=0} 04:47:03.918719 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26614): Process ended prematurely: osmo-stp_10.42.42.5(pid=26614) [trial-2354↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26614)] [trial-2354↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 04:47:03.928033 tst iperf3m4.py:8: Test FAILED (10.6 sec) 04:47:03.955608 run osmo-hlr_10.42.42.2(pid=26611): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26611)] 04:47:04.003878 run osmo-hlr_10.42.42.2(pid=26611): stdout: | (launched: 2022-12-09_04:47:00.488089) 04:47:04.053520 run osmo-hlr_10.42.42.2(pid=26611): stderr: | 20221209044700665 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209044700665 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209044700665 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209044700665 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209044700665 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209044700665 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209044700678 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209044700689 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209044700689 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209044700689 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:47:04.103588 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26599): Terminating (SIGTERM) 04:47:04.143172 run iperf3-srv_10.42.42.10(pid=26600): Terminating (SIGTERM) 04:47:04.182755 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26601): Terminating (SIGTERM) 04:47:04.222376 run iperf3-srv_10.42.42.10(pid=26602): Terminating (SIGTERM) 04:47:04.262244 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26603): Terminating (SIGTERM) 04:47:04.301874 run iperf3-srv_10.42.42.10(pid=26604): Terminating (SIGTERM) 04:47:04.341548 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26605): Terminating (SIGTERM) 04:47:04.381379 run iperf3-srv_10.42.42.10(pid=26606): Terminating (SIGTERM) 04:47:04.420779 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26610): Terminating (SIGTERM) 04:47:04.461143 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26613): Terminating (SIGTERM) 04:47:04.500780 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26616): Terminating (SIGTERM) 04:47:04.540794 --- ParallelTerminationStrategy: PID 26599 died... 04:47:04.559702 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26599): Terminated: ok {rc=0} 04:47:04.604229 --- ParallelTerminationStrategy: PID 26600 died... 04:47:04.622985 run iperf3-srv_10.42.42.10(pid=26600): Terminated {rc=256} 04:47:04.666772 --- ParallelTerminationStrategy: PID 26601 died... 04:47:04.685448 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26601): Terminated: ok {rc=0} 04:47:04.729470 --- ParallelTerminationStrategy: PID 26602 died... 04:47:04.748200 run iperf3-srv_10.42.42.10(pid=26602): Terminated {rc=256} 04:47:04.791882 --- ParallelTerminationStrategy: PID 26603 died... 04:47:04.810647 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26603): Terminated: ok {rc=0} 04:47:04.854517 --- ParallelTerminationStrategy: PID 26604 died... 04:47:04.873338 run iperf3-srv_10.42.42.10(pid=26604): Terminated {rc=256} 04:47:04.917091 --- ParallelTerminationStrategy: PID 26605 died... 04:47:04.935917 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26605): Terminated: ok {rc=0} 04:47:04.979995 --- ParallelTerminationStrategy: PID 26606 died... 04:47:04.998701 run iperf3-srv_10.42.42.10(pid=26606): Terminated {rc=256} 04:47:05.042397 --- ParallelTerminationStrategy: PID 26610 died... 04:47:05.061189 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26610): Terminated: ok {rc=0} 04:47:05.104932 --- ParallelTerminationStrategy: PID 26613 died... 04:47:05.123722 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26613): Terminated: ok {rc=0} 04:47:05.167526 --- ParallelTerminationStrategy: PID 26616 died... 04:47:05.186375 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26616): Terminated: ok {rc=0} 04:47:05.272358 bus /gobi_4: Setting Powered False 04:47:06.373224 bus /gobi_4: Setting Powered False 04:47:07.487900 bus /gobi_1: Setting Powered False 04:47:08.586176 bus /gobi_1: Setting Powered False 04:47:09.708384 bus /gobi_0: Setting Powered False 04:47:10.808154 bus /gobi_0: Setting Powered False 04:47:11.924343 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 04:47:13.029309 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:47:13.041412 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:47:13.110257 tst ping.py: using LAC 19170 04:47:13.235436 tst ping.py: using RAC 45 04:47:13.360938 tst ping.py: using CellId 19170 04:47:13.478147 tst ping.py: using BVCI 19171 04:47:13.585553 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:47:13.596579 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:47:13.607513 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:47:13.618848 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:47:13.630034 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:47:13.641404 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:47:13.652825 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:47:13.664046 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:47:13.777789 tst ping.py:19: start network... 04:47:13.975455 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:47:14.432348 run create_hlr_db(pid=26618): Launched 04:47:14.553973 bus /gobi_6: Setting Powered False 04:47:15.614267 run create_hlr_db(pid=26618): Terminated: ok {rc=0} 04:47:16.095246 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26620): Launched 04:47:16.435473 run osmo-hlr_10.42.42.2(pid=26621): Launched 04:47:16.682295 run osmo-stp_10.42.42.5: Starting osmo-stp 04:47:17.335506 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26623): Launched 04:47:17.651982 run osmo-stp_10.42.42.5(pid=26624): Launched 04:47:17.773431 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:47:18.319082 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26626): Launched 04:47:18.441433 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:47:18.708857 run patchelf(pid=26627): Launched 04:47:18.885586 run osmo-stp_10.42.42.5(pid=26624): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26624)] 04:47:19.019457 run osmo-stp_10.42.42.5(pid=26624): stdout: | (launched: 2022-12-09_04:47:17.594147) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:47:19.155604 run osmo-stp_10.42.42.5(pid=26624): stderr: | 20221209044717782 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044717782 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044717783 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044717783 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044717785 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044717786 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044717786 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:47:19.291669 run osmo-stp_10.42.42.5(pid=26624): stdout: | (launched: 2022-12-09_04:47:17.594147) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:47:19.422377 run osmo-stp_10.42.42.5(pid=26624): stderr: | 20221209044717782 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044717782 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044717783 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044717783 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044717785 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044717786 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044717786 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:47:19.576822 run patchelf(pid=26627): Terminating (SIGINT) 04:47:19.755526 run patchelf(pid=26627): Terminated: ok {rc=0} 04:47:19.883956 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=26624): Process ended prematurely: osmo-stp_10.42.42.5(pid=26624) [trial-2354↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26624)] [trial-2354↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22] 04:47:19.893419 tst ping.py:22: Test FAILED (6.9 sec) 04:47:19.922577 run osmo-hlr_10.42.42.2(pid=26621): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26621)] 04:47:19.973461 run osmo-hlr_10.42.42.2(pid=26621): stdout: | (launched: 2022-12-09_04:47:16.369962) 04:47:20.026198 run osmo-hlr_10.42.42.2(pid=26621): stderr: | 20221209044716673 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209044716673 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209044716673 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209044716673 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209044716673 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209044716673 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209044716688 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209044716705 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209044716705 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209044716705 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:47:20.079263 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26620): Terminating (SIGTERM) 04:47:20.121788 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26623): Terminating (SIGTERM) 04:47:20.164334 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26626): Terminating (SIGTERM) 04:47:20.207051 --- ParallelTerminationStrategy: PID 26620 died... 04:47:20.227276 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26620): Terminated: ok {rc=0} 04:47:20.274944 --- ParallelTerminationStrategy: PID 26623 died... 04:47:20.295022 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26623): Terminated: ok {rc=0} 04:47:20.342227 --- ParallelTerminationStrategy: PID 26626 died... 04:47:20.362044 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26626): Terminated: ok {rc=0} 04:47:20.450310 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 04:47:21.538962 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:47:21.551417 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:47:21.621276 tst ping_idle_ping.py: using LAC 19171 04:47:21.746194 tst ping_idle_ping.py: using RAC 46 04:47:21.879494 tst ping_idle_ping.py: using CellId 19171 04:47:22.011561 tst ping_idle_ping.py: using BVCI 19172 04:47:22.127532 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:47:22.138934 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:47:22.150429 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:47:22.162217 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:47:22.174040 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:47:22.185842 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:47:22.197681 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:47:22.209332 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:47:22.326401 tst ping_idle_ping.py:24: start network... 04:47:22.525439 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:47:22.987291 run create_hlr_db(pid=26628): Launched 04:47:23.109503 bus /gobi_6: Setting Powered False 04:47:24.170369 run create_hlr_db(pid=26628): Terminated: ok {rc=0} 04:47:24.583048 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26630): Launched 04:47:24.878021 run osmo-hlr_10.42.42.2(pid=26631): Launched 04:47:24.990358 run osmo-stp_10.42.42.5: Starting osmo-stp 04:47:25.496402 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26633): Launched 04:47:25.791182 run osmo-stp_10.42.42.5(pid=26634): Launched 04:47:25.903710 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:47:26.413560 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26636): Launched 04:47:26.527013 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:47:26.776314 run patchelf(pid=26637): Launched 04:47:26.941245 run osmo-stp_10.42.42.5(pid=26634): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26634)] 04:47:27.066247 run osmo-stp_10.42.42.5(pid=26634): stdout: | (launched: 2022-12-09_04:47:25.736708) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:47:27.192929 run osmo-stp_10.42.42.5(pid=26634): stderr: | 20221209044725908 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044725908 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044725908 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044725908 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044725909 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044725909 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044725909 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:47:27.319491 run osmo-stp_10.42.42.5(pid=26634): stdout: | (launched: 2022-12-09_04:47:25.736708) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:47:27.440586 run osmo-stp_10.42.42.5(pid=26634): stderr: | 20221209044725908 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044725908 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044725908 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044725908 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044725909 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044725909 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044725909 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:47:27.584082 run patchelf(pid=26637): Terminating (SIGINT) 04:47:27.750573 run patchelf(pid=26637): Terminated: ok {rc=0} 04:47:27.870499 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=26634): Process ended prematurely: osmo-stp_10.42.42.5(pid=26634) [trial-2354↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26634)] [trial-2354↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 04:47:27.879225 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 04:47:27.906188 run osmo-hlr_10.42.42.2(pid=26631): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26631)] 04:47:27.954242 run osmo-hlr_10.42.42.2(pid=26631): stdout: | (launched: 2022-12-09_04:47:24.823772) 04:47:28.003977 run osmo-hlr_10.42.42.2(pid=26631): stderr: | 20221209044724996 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209044724996 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209044724996 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209044724996 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209044724996 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209044724997 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209044725009 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209044725019 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209044725019 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209044725019 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:47:28.053950 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26630): Terminating (SIGTERM) 04:47:28.093883 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26633): Terminating (SIGTERM) 04:47:28.133791 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26636): Terminating (SIGTERM) 04:47:28.174018 --- ParallelTerminationStrategy: PID 26630 died... 04:47:28.193249 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26630): Terminated: ok {rc=0} 04:47:28.237533 --- ParallelTerminationStrategy: PID 26633 died... 04:47:28.256417 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26633): Terminated: ok {rc=0} 04:47:28.300904 --- ParallelTerminationStrategy: PID 26636 died... 04:47:28.320186 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26636): Terminated: ok {rc=0} 04:47:28.404265 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2354 gprs:nanobts+band-900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 04:47:29.713926 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:47:29.720756 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 04:47:29.752137 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 04:47:29.789610 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 04:47:29.873475 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 04:47:29.904468 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 04:47:29.941643 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 04:47:30.549213 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2354 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 04:47:30.602208 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:47:30.613854 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 04:47:30.663897 tst cs_paging_gprs_active.py: using LAC 19172 04:47:30.792311 tst cs_paging_gprs_active.py: using RAC 47 04:47:30.931140 tst cs_paging_gprs_active.py: using CellId 19172 04:47:31.065209 tst cs_paging_gprs_active.py: using BVCI 19173 04:47:31.222286 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:47:31.238277 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:47:31.254791 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:47:31.271561 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:47:31.287623 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:47:31.303830 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:47:31.321339 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:47:31.338445 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:47:31.354623 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 04:47:31.495901 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 04:47:31.627662 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 04:47:31.851306 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:47:32.185477 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26641): Launched 04:47:32.491879 run iperf3-srv_10.42.42.10(pid=26642): Launched 04:47:32.603343 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 04:47:32.800583 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:47:33.096148 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26643): Launched 04:47:33.354255 run iperf3-srv_10.42.42.10(pid=26644): Launched 04:47:33.465420 tst cs_paging_gprs_active.py:38: start network... 04:47:33.662616 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:47:34.122510 run create_hlr_db(pid=26645): Launched 04:47:34.243866 bus /gobi_6: Setting Powered False 04:47:35.303664 run create_hlr_db(pid=26645): Terminated: ok {rc=0} 04:47:35.737853 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26647): Launched 04:47:36.042691 run osmo-hlr_10.42.42.2(pid=26650): Launched 04:47:36.154642 run osmo-stp_10.42.42.5: Starting osmo-stp 04:47:36.677563 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26652): Launched 04:47:36.973464 run osmo-stp_10.42.42.5(pid=26653): Launched 04:47:37.086361 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:47:37.595676 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26655): Launched 04:47:37.708841 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:47:37.958890 run patchelf(pid=26656): Launched 04:47:38.124687 run osmo-stp_10.42.42.5(pid=26653): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26653)] 04:47:38.249785 run osmo-stp_10.42.42.5(pid=26653): stdout: | (launched: 2022-12-09_04:47:36.919519) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:47:38.376552 run osmo-stp_10.42.42.5(pid=26653): stderr: | 20221209044737091 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044737091 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044737091 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044737091 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044737092 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044737092 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044737092 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:47:38.503343 run osmo-stp_10.42.42.5(pid=26653): stdout: | (launched: 2022-12-09_04:47:36.919519) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:47:38.624593 run osmo-stp_10.42.42.5(pid=26653): stderr: | 20221209044737091 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044737091 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044737091 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044737091 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044737092 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044737092 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044737092 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:47:38.768702 run patchelf(pid=26656): Terminating (SIGINT) 04:47:38.935796 run patchelf(pid=26656): Terminated: ok {rc=0} 04:47:39.056521 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=26653): Process ended prematurely: osmo-stp_10.42.42.5(pid=26653) [trial-2354↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26653)] [trial-2354↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 04:47:39.066085 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 04:47:39.093059 run osmo-hlr_10.42.42.2(pid=26650): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26650)] 04:47:39.140940 run osmo-hlr_10.42.42.2(pid=26650): stdout: | (launched: 2022-12-09_04:47:35.988004) 04:47:39.190634 run osmo-hlr_10.42.42.2(pid=26650): stderr: | 20221209044736162 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209044736162 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209044736162 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209044736162 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209044736162 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209044736162 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209044736174 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209044736183 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209044736184 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209044736184 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:47:39.240464 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26641): Terminating (SIGTERM) 04:47:39.280267 run iperf3-srv_10.42.42.10(pid=26642): Terminating (SIGTERM) 04:47:39.320034 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26643): Terminating (SIGTERM) 04:47:39.359845 run iperf3-srv_10.42.42.10(pid=26644): Terminating (SIGTERM) 04:47:39.399465 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26647): Terminating (SIGTERM) 04:47:39.439358 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26652): Terminating (SIGTERM) 04:47:39.479049 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26655): Terminating (SIGTERM) 04:47:39.518879 --- ParallelTerminationStrategy: PID 26641 died... 04:47:39.537939 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26641): Terminated: ok {rc=0} 04:47:39.581927 --- ParallelTerminationStrategy: PID 26642 died... 04:47:39.600447 run iperf3-srv_10.42.42.10(pid=26642): Terminated {rc=256} 04:47:39.644677 --- ParallelTerminationStrategy: PID 26643 died... 04:47:39.663389 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26643): Terminated: ok {rc=0} 04:47:39.707301 --- ParallelTerminationStrategy: PID 26644 died... 04:47:39.725899 run iperf3-srv_10.42.42.10(pid=26644): Terminated {rc=256} 04:47:39.769853 --- ParallelTerminationStrategy: PID 26647 died... 04:47:39.788409 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26647): Terminated: ok {rc=0} 04:47:39.832724 --- ParallelTerminationStrategy: PID 26652 died... 04:47:39.851293 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26652): Terminated: ok {rc=0} 04:47:39.895038 --- ParallelTerminationStrategy: PID 26655 died... 04:47:39.913817 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26655): Terminated: ok {rc=0} 04:47:40.000227 bus /gobi_0: Setting Powered False 04:47:41.101067 bus /gobi_0: Setting Powered False 04:47:42.216785 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 04:47:43.362291 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:47:43.374194 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 04:47:43.424135 tst iperf3.py: using LAC 19173 04:47:43.541494 tst iperf3.py: using RAC 48 04:47:43.658958 tst iperf3.py: using CellId 19173 04:47:43.775005 tst iperf3.py: using BVCI 19174 04:47:43.883875 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:47:43.895059 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:47:43.906111 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:47:43.917212 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:47:43.928105 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:47:43.939125 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:47:43.950267 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:47:43.961267 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:47:43.972304 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 04:47:44.087292 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 04:47:44.284027 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:47:44.579745 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26657): Launched 04:47:44.836281 run iperf3-srv_10.42.42.10(pid=26658): Launched 04:47:44.946659 tst iperf3.py:8: start network... 04:47:45.142216 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:47:45.598832 run create_hlr_db(pid=26659): Launched 04:47:45.719982 bus /gobi_6: Setting Powered False 04:47:46.777361 run create_hlr_db(pid=26659): Terminated: ok {rc=0} 04:47:47.201254 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26661): Launched 04:47:47.509329 run osmo-hlr_10.42.42.2(pid=26662): Launched 04:47:47.622438 run osmo-stp_10.42.42.5: Starting osmo-stp 04:47:48.130508 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26664): Launched 04:47:48.426861 run osmo-stp_10.42.42.5(pid=26665): Launched 04:47:48.539436 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:47:49.047782 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26667): Launched 04:47:49.160704 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:47:49.410348 run patchelf(pid=26668): Launched 04:47:49.574555 run osmo-stp_10.42.42.5(pid=26665): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26665)] 04:47:49.699904 run osmo-stp_10.42.42.5(pid=26665): stdout: | (launched: 2022-12-09_04:47:48.371825) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:47:49.827038 run osmo-stp_10.42.42.5(pid=26665): stderr: | 20221209044748542 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044748543 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044748543 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044748543 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044748544 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044748544 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044748544 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:47:49.954257 run osmo-stp_10.42.42.5(pid=26665): stdout: | (launched: 2022-12-09_04:47:48.371825) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:47:50.075733 run osmo-stp_10.42.42.5(pid=26665): stderr: | 20221209044748542 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044748543 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044748543 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044748543 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044748544 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044748544 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044748544 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:47:50.220311 run patchelf(pid=26668): Terminating (SIGINT) 04:47:50.387576 run patchelf(pid=26668): Terminated: ok {rc=0} 04:47:50.507953 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26665): Process ended prematurely: osmo-stp_10.42.42.5(pid=26665) [trial-2354↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26665)] [trial-2354↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 04:47:50.517399 tst iperf3.py:8: Test FAILED (7.2 sec) 04:47:50.544445 run osmo-hlr_10.42.42.2(pid=26662): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26662)] 04:47:50.592008 run osmo-hlr_10.42.42.2(pid=26662): stdout: | (launched: 2022-12-09_04:47:47.455046) 04:47:50.641586 run osmo-hlr_10.42.42.2(pid=26662): stderr: | 20221209044747628 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209044747628 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209044747628 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209044747629 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209044747629 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209044747629 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209044747644 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209044747654 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209044747654 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209044747654 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:47:50.691691 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26657): Terminating (SIGTERM) 04:47:50.731212 run iperf3-srv_10.42.42.10(pid=26658): Terminating (SIGTERM) 04:47:50.770507 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26661): Terminating (SIGTERM) 04:47:50.809770 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26664): Terminating (SIGTERM) 04:47:50.849085 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26667): Terminating (SIGTERM) 04:47:50.888559 --- ParallelTerminationStrategy: PID 26657 died... 04:47:50.907444 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26657): Terminated: ok {rc=0} 04:47:50.950980 --- ParallelTerminationStrategy: PID 26658 died... 04:47:50.969367 run iperf3-srv_10.42.42.10(pid=26658): Terminated {rc=256} 04:47:51.012787 --- ParallelTerminationStrategy: PID 26661 died... 04:47:51.031327 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26661): Terminated: ok {rc=0} 04:47:51.074932 --- ParallelTerminationStrategy: PID 26664 died... 04:47:51.093495 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26664): Terminated: ok {rc=0} 04:47:51.137289 --- ParallelTerminationStrategy: PID 26667 died... 04:47:51.155632 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26667): Terminated: ok {rc=0} 04:47:51.241735 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 04:47:52.386096 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:47:52.397976 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 04:47:52.450775 tst iperf3m4.py: using LAC 19174 04:47:52.568277 tst iperf3m4.py: using RAC 49 04:47:52.684628 tst iperf3m4.py: using CellId 19174 04:47:52.800605 tst iperf3m4.py: using BVCI 19175 04:47:52.907548 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:47:52.918743 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:47:52.929842 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:47:52.940912 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:47:52.951958 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:47:52.962918 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:47:52.974104 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:47:52.985101 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:47:52.996294 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 04:47:53.111039 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 04:47:53.228732 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 04:47:53.350083 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 04:47:53.468778 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 04:47:53.685975 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:47:54.005671 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26669): Launched 04:47:54.282377 run iperf3-srv_10.42.42.10(pid=26670): Launched 04:47:54.402611 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 04:47:54.617252 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:47:54.935689 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26671): Launched 04:47:55.212665 run iperf3-srv_10.42.42.10(pid=26672): Launched 04:47:55.332541 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 04:47:55.547304 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:47:55.866245 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26673): Launched 04:47:56.142690 run iperf3-srv_10.42.42.10(pid=26674): Launched 04:47:56.262256 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 04:47:56.475809 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:47:56.794248 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26675): Launched 04:47:57.070365 run iperf3-srv_10.42.42.10(pid=26676): Launched 04:47:57.189741 tst iperf3m4.py:8: start network... 04:47:57.403455 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:47:57.895998 run create_hlr_db(pid=26677): Launched 04:47:58.017849 bus /gobi_6: Setting Powered False 04:47:59.080504 run create_hlr_db(pid=26677): Terminated: ok {rc=0} 04:47:59.504521 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26679): Launched 04:47:59.799832 run osmo-hlr_10.42.42.2(pid=26680): Launched 04:47:59.912236 run osmo-stp_10.42.42.5: Starting osmo-stp 04:48:00.437654 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26682): Launched 04:48:00.734440 run osmo-stp_10.42.42.5(pid=26683): Launched 04:48:00.847709 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:48:01.503315 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26685): Launched 04:48:01.653902 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:48:01.992592 run patchelf(pid=26686): Launched 04:48:02.211102 run osmo-stp_10.42.42.5(pid=26683): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26683)] 04:48:02.361580 run osmo-stp_10.42.42.5(pid=26683): stdout: | (launched: 2022-12-09_04:48:00.680137) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:48:02.489579 run osmo-stp_10.42.42.5(pid=26683): stderr: | 20221209044800887 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044800888 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044800888 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044800888 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044800890 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044800890 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044800890 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:48:02.616707 run osmo-stp_10.42.42.5(pid=26683): stdout: | (launched: 2022-12-09_04:48:00.680137) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:48:02.737938 run osmo-stp_10.42.42.5(pid=26683): stderr: | 20221209044800887 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044800888 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044800888 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044800888 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044800890 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044800890 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044800890 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:48:02.881960 run patchelf(pid=26686): Terminating (SIGINT) 04:48:03.049537 run patchelf(pid=26686): Terminated: ok {rc=0} 04:48:03.170599 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26683): Process ended prematurely: osmo-stp_10.42.42.5(pid=26683) [trial-2354↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26683)] [trial-2354↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 04:48:03.180079 tst iperf3m4.py:8: Test FAILED (10.8 sec) 04:48:03.207686 run osmo-hlr_10.42.42.2(pid=26680): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26680)] 04:48:03.255595 run osmo-hlr_10.42.42.2(pid=26680): stdout: | (launched: 2022-12-09_04:47:59.745686) 04:48:03.304859 run osmo-hlr_10.42.42.2(pid=26680): stderr: | 20221209044759924 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209044759924 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209044759924 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209044759924 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209044759924 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209044759924 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209044759936 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209044759946 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209044759946 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209044759946 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:48:03.354755 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26669): Terminating (SIGTERM) 04:48:03.394841 run iperf3-srv_10.42.42.10(pid=26670): Terminating (SIGTERM) 04:48:03.434347 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26671): Terminating (SIGTERM) 04:48:03.473711 run iperf3-srv_10.42.42.10(pid=26672): Terminating (SIGTERM) 04:48:03.512994 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26673): Terminating (SIGTERM) 04:48:03.552416 run iperf3-srv_10.42.42.10(pid=26674): Terminating (SIGTERM) 04:48:03.591673 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26675): Terminating (SIGTERM) 04:48:03.631054 run iperf3-srv_10.42.42.10(pid=26676): Terminating (SIGTERM) 04:48:03.670335 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26679): Terminating (SIGTERM) 04:48:03.709736 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26682): Terminating (SIGTERM) 04:48:03.749058 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26685): Terminating (SIGTERM) 04:48:03.788620 --- ParallelTerminationStrategy: PID 26669 died... 04:48:03.807772 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26669): Terminated: ok {rc=0} 04:48:03.851963 --- ParallelTerminationStrategy: PID 26670 died... 04:48:03.870609 run iperf3-srv_10.42.42.10(pid=26670): Terminated {rc=256} 04:48:03.914268 --- ParallelTerminationStrategy: PID 26671 died... 04:48:03.933050 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26671): Terminated: ok {rc=0} 04:48:03.976844 --- ParallelTerminationStrategy: PID 26672 died... 04:48:03.995888 run iperf3-srv_10.42.42.10(pid=26672): Terminated {rc=256} 04:48:04.039649 --- ParallelTerminationStrategy: PID 26673 died... 04:48:04.058277 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26673): Terminated: ok {rc=0} 04:48:04.102059 --- ParallelTerminationStrategy: PID 26674 died... 04:48:04.120751 run iperf3-srv_10.42.42.10(pid=26674): Terminated {rc=256} 04:48:04.164420 --- ParallelTerminationStrategy: PID 26675 died... 04:48:04.183038 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26675): Terminated: ok {rc=0} 04:48:04.226764 --- ParallelTerminationStrategy: PID 26676 died... 04:48:04.245753 run iperf3-srv_10.42.42.10(pid=26676): Terminated {rc=256} 04:48:04.289588 --- ParallelTerminationStrategy: PID 26679 died... 04:48:04.308234 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26679): Terminated: ok {rc=0} 04:48:04.351768 --- ParallelTerminationStrategy: PID 26682 died... 04:48:04.370490 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26682): Terminated: ok {rc=0} 04:48:04.414170 --- ParallelTerminationStrategy: PID 26685 died... 04:48:04.432688 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26685): Terminated: ok {rc=0} 04:48:04.518686 bus /gobi_4: Setting Powered False 04:48:05.618959 bus /gobi_4: Setting Powered False 04:48:06.734688 bus /gobi_1: Setting Powered False 04:48:07.832345 bus /gobi_1: Setting Powered False 04:48:08.947852 bus /gobi_0: Setting Powered False 04:48:10.046994 bus /gobi_0: Setting Powered False 04:48:11.163987 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 04:48:12.266506 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:48:12.278887 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 04:48:12.333276 tst ping.py: using LAC 19175 04:48:12.455916 tst ping.py: using RAC 50 04:48:12.578990 tst ping.py: using CellId 19175 04:48:12.699435 tst ping.py: using BVCI 19176 04:48:12.806871 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:48:12.818274 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:48:12.829669 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:48:12.841382 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:48:12.852845 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:48:12.864638 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:48:12.876287 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:48:12.887817 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 04:48:13.007499 tst ping.py:19: start network... 04:48:13.217371 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:48:13.700607 run create_hlr_db(pid=26687): Launched 04:48:13.820233 bus /gobi_6: Setting Powered False 04:48:14.883203 run create_hlr_db(pid=26687): Terminated: ok {rc=0} 04:48:15.319773 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26689): Launched 04:48:15.632584 run osmo-hlr_10.42.42.2(pid=26690): Launched 04:48:15.752511 run osmo-stp_10.42.42.5: Starting osmo-stp 04:48:16.330130 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26692): Launched 04:48:16.648126 run osmo-stp_10.42.42.5(pid=26693): Launched 04:48:16.950573 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:48:17.541304 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26695): Launched 04:48:17.661487 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:48:17.925765 run patchelf(pid=26696): Launched 04:48:18.099804 run osmo-stp_10.42.42.5(pid=26693): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26693)] 04:48:18.232719 run osmo-stp_10.42.42.5(pid=26693): stdout: | (launched: 2022-12-09_04:48:16.581836) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:48:18.367312 run osmo-stp_10.42.42.5(pid=26693): stderr: | 20221209044816842 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044816843 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044816843 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044816846 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044816847 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044816847 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044816847 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:48:18.502821 run osmo-stp_10.42.42.5(pid=26693): stdout: | (launched: 2022-12-09_04:48:16.581836) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:48:18.631967 run osmo-stp_10.42.42.5(pid=26693): stderr: | 20221209044816842 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044816843 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044816843 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044816846 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044816847 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044816847 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044816847 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:48:18.784154 run patchelf(pid=26696): Terminating (SIGINT) 04:48:18.960885 run patchelf(pid=26696): Terminated: ok {rc=0} 04:48:19.088560 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=26693): Process ended prematurely: osmo-stp_10.42.42.5(pid=26693) [trial-2354↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26693)] [trial-2354↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 04:48:19.098115 tst ping.py:22: Test FAILED (6.8 sec) 04:48:19.127096 run osmo-hlr_10.42.42.2(pid=26690): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26690)] 04:48:19.178017 run osmo-hlr_10.42.42.2(pid=26690): stdout: | (launched: 2022-12-09_04:48:15.575676) 04:48:19.230891 run osmo-hlr_10.42.42.2(pid=26690): stderr: | 20221209044815770 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209044815770 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209044815770 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209044815770 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209044815770 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209044815770 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209044815783 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209044815791 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209044815791 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209044815791 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:48:19.284080 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26689): Terminating (SIGTERM) 04:48:19.326631 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26692): Terminating (SIGTERM) 04:48:19.369235 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26695): Terminating (SIGTERM) 04:48:19.411826 --- ParallelTerminationStrategy: PID 26689 died... 04:48:19.431868 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26689): Terminated: ok {rc=0} 04:48:19.479441 --- ParallelTerminationStrategy: PID 26692 died... 04:48:19.499099 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26692): Terminated: ok {rc=0} 04:48:19.546032 --- ParallelTerminationStrategy: PID 26695 died... 04:48:19.565817 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26695): Terminated: ok {rc=0} 04:48:19.655514 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2354 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 04:48:20.743735 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:48:20.756548 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 04:48:20.812547 tst ping_idle_ping.py: using LAC 19176 04:48:20.934808 tst ping_idle_ping.py: using RAC 51 04:48:21.056487 tst ping_idle_ping.py: using CellId 19176 04:48:21.177955 tst ping_idle_ping.py: using BVCI 19177 04:48:21.294014 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:48:21.305852 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:48:21.317449 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:48:21.329458 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:48:21.341522 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:48:21.353005 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:48:21.364807 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:48:21.376797 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 04:48:21.493397 tst ping_idle_ping.py:24: start network... 04:48:21.689668 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:48:22.145266 run create_hlr_db(pid=26697): Launched 04:48:22.266305 bus /gobi_6: Setting Powered False 04:48:23.325182 run create_hlr_db(pid=26697): Terminated: ok {rc=0} 04:48:23.753984 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26699): Launched 04:48:24.067966 run osmo-hlr_10.42.42.2(pid=26700): Launched 04:48:24.187907 run osmo-stp_10.42.42.5: Starting osmo-stp 04:48:24.731646 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26702): Launched 04:48:25.045610 run osmo-stp_10.42.42.5(pid=26703): Launched 04:48:25.166217 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:48:25.708163 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26705): Launched 04:48:25.828109 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:48:26.092456 run patchelf(pid=26706): Launched 04:48:26.267413 run osmo-stp_10.42.42.5(pid=26703): ERR: Terminated: ERROR {rc=1} [trial-2354↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26703)] 04:48:26.401305 run osmo-stp_10.42.42.5(pid=26703): stdout: | (launched: 2022-12-09_04:48:24.988129) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:48:26.537547 run osmo-stp_10.42.42.5(pid=26703): stderr: | 20221209044825180 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044825180 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044825180 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044825181 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044825181 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044825181 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044825181 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:48:26.673194 run osmo-stp_10.42.42.5(pid=26703): stdout: | (launched: 2022-12-09_04:48:24.988129) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:48:26.802657 run osmo-stp_10.42.42.5(pid=26703): stderr: | 20221209044825180 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044825180 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044825180 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044825181 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044825181 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044825181 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044825181 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:48:26.956071 run patchelf(pid=26706): Terminating (SIGINT) 04:48:27.133488 run patchelf(pid=26706): Terminated: ok {rc=0} 04:48:27.261455 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=26703): Process ended prematurely: osmo-stp_10.42.42.5(pid=26703) [trial-2354↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26703)] [trial-2354↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 04:48:27.271048 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 04:48:27.300101 run osmo-hlr_10.42.42.2(pid=26700): ERR: Terminated: ERROR {rc=237} [trial-2354↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26700)] 04:48:27.351462 run osmo-hlr_10.42.42.2(pid=26700): stdout: | (launched: 2022-12-09_04:48:24.010938) 04:48:27.404636 run osmo-hlr_10.42.42.2(pid=26700): stderr: | 20221209044824207 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209044824207 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209044824207 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209044824207 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209044824207 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209044824207 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209044824220 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209044824231 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209044824231 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209044824231 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:48:27.458146 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26699): Terminating (SIGTERM) 04:48:27.501158 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26702): Terminating (SIGTERM) 04:48:27.543897 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26705): Terminating (SIGTERM) 04:48:27.586848 --- ParallelTerminationStrategy: PID 26699 died... 04:48:27.607117 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26699): Terminated: ok {rc=0} 04:48:27.654384 --- ParallelTerminationStrategy: PID 26702 died... 04:48:27.674119 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26702): Terminated: ok {rc=0} 04:48:27.721393 --- ParallelTerminationStrategy: PID 26705 died... 04:48:27.741189 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26705): Terminated: ok {rc=0} 04:48:27.831029 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2354 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 04:48:29.153723 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:48:29.162115 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 04:48:29.195747 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 04:48:29.230587 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 04:48:29.286287 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 04:48:29.319272 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 04:48:29.353885 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 04:48:29.909861 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2354 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 04:48:29.915209 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:48:29.926766 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 04:48:29.993471 tst switch_tch_pdch.py: using LAC 19177 04:48:30.108552 tst switch_tch_pdch.py: using RAC 52 04:48:30.223428 tst switch_tch_pdch.py: using CellId 19177 04:48:30.348538 tst switch_tch_pdch.py: using BVCI 19178 04:48:30.462935 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:48:30.474729 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:48:30.486865 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:48:30.498871 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:48:30.510730 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:48:30.522597 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:48:30.534876 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:48:30.547062 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:48:30.661237 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:48:30.778899 tst switch_tch_pdch.py:51: start network... 04:48:31.006961 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:48:31.502776 run create_hlr_db(pid=26710): Launched 04:48:31.655922 bus /gobi_6: Setting Powered False 04:48:32.717414 run create_hlr_db(pid=26710): Terminated: ok {rc=0} 04:48:33.134097 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26712): Launched 04:48:33.422695 run osmo-hlr_10.42.42.2(pid=26713): Launched 04:48:33.533786 run osmo-stp_10.42.42.5: Starting osmo-stp 04:48:34.046277 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26715): Launched 04:48:34.336279 run osmo-stp_10.42.42.5(pid=26716): Launched 04:48:34.447114 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:48:34.949670 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26718): Launched 04:48:35.060839 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:48:35.306522 run patchelf(pid=26719): Launched 04:48:35.469465 run osmo-stp_10.42.42.5(pid=26716): ERR: Terminated: ERROR {rc=1} [trial-2354↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26716)] 04:48:35.592797 run osmo-stp_10.42.42.5(pid=26716): stdout: | (launched: 2022-12-09_04:48:34.283504) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:48:35.717790 run osmo-stp_10.42.42.5(pid=26716): stderr: | 20221209044834454 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044834454 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044834454 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044834455 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044834455 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044834455 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044834455 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:48:35.842575 run osmo-stp_10.42.42.5(pid=26716): stdout: | (launched: 2022-12-09_04:48:34.283504) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:48:35.962372 run osmo-stp_10.42.42.5(pid=26716): stderr: | 20221209044834454 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044834454 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044834454 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044834455 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044834455 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044834455 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044834455 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:48:36.103848 run patchelf(pid=26719): Terminating (SIGINT) 04:48:36.268518 run patchelf(pid=26719): Terminated: ok {rc=0} 04:48:36.386336 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=26716): Process ended prematurely: osmo-stp_10.42.42.5(pid=26716) [trial-2354↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26716)] [trial-2354↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 04:48:36.395184 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 04:48:36.421719 run osmo-hlr_10.42.42.2(pid=26713): ERR: Terminated: ERROR {rc=237} [trial-2354↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26713)] 04:48:36.469104 run osmo-hlr_10.42.42.2(pid=26713): stdout: | (launched: 2022-12-09_04:48:33.370071) 04:48:36.518590 run osmo-hlr_10.42.42.2(pid=26713): stderr: | 20221209044833543 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209044833543 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209044833544 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209044833544 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209044833544 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209044833544 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209044833556 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209044833566 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209044833566 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209044833566 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:48:36.568029 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26712): Terminating (SIGTERM) 04:48:36.607604 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26715): Terminating (SIGTERM) 04:48:36.647001 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26718): Terminating (SIGTERM) 04:48:36.686724 --- ParallelTerminationStrategy: PID 26712 died... 04:48:36.705620 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26712): Terminated: ok {rc=0} 04:48:36.749214 --- ParallelTerminationStrategy: PID 26715 died... 04:48:36.767545 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26715): Terminated: ok {rc=0} 04:48:36.811127 --- ParallelTerminationStrategy: PID 26718 died... 04:48:36.829433 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26718): Terminated: ok {rc=0} 04:48:36.915132 bus /gobi_0: Setting Powered False 04:48:38.015576 bus /gobi_0: Setting Powered False 04:48:39.132076 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2354 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 nitb_smpp --------------------------------------------------------------------- 04:48:40.387025 tst nitb_smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:48:40.389977 tst nitb_smpp: Verifying 1 x bts (candidates: 11) 04:48:40.412125 tst nitb_smpp: Verifying 1 x ip_address (candidates: 9) 04:48:40.418669 tst nitb_smpp: Verifying 1 x modem (candidates: 12) 04:48:40.453274 tst nitb_smpp: Reserving 1 x bts (candidates: 11) 04:48:40.474895 tst nitb_smpp: Reserving 1 x ip_address (candidates: 9) 04:48:40.482401 tst nitb_smpp: Reserving 1 x modem (candidates: 12) 04:48:40.998163 tst nitb_smpp: RESERVED RESOURCES for nitb_smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2354 nitb_smpp esme_connect_policy_acceptall.py ---------------------------------------------- 04:48:41.004542 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 04:48:41.023166 tst esme_connect_policy_acceptall.py: using MSISDN 7030 04:48:41.161845 run osmo-nitb_10.42.42.2: Starting osmo-nitb 04:48:41.758076 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26723): Launched 04:48:42.077110 run osmo-nitb_10.42.42.2(pid=26724): Launched 04:48:42.254916 run osmo-nitb_10.42.42.2(pid=26724): ERR: Terminated: ERROR {rc=2} [trial-2354↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26724)] 04:48:42.398642 run osmo-nitb_10.42.42.2(pid=26724): stdout: | (launched: 2022-12-09_04:48:42.019324) 04:48:42.544221 run osmo-nitb_10.42.42.2(pid=26724): stderr: | (launched: 2022-12-09_04:48:42.066858) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:48:42.689338 run osmo-nitb_10.42.42.2(pid=26724): stdout: | (launched: 2022-12-09_04:48:42.019324) 04:48:42.828205 run osmo-nitb_10.42.42.2(pid=26724): stderr: | (launched: 2022-12-09_04:48:42.066858) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f4d467d3268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=26724): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26724) [trial-2354↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26724)] 04:48:43.198233 tst osmo-nitb_10.42.42.2(pid=26724): stdout: | (launched: 2022-12-09_04:48:42.019324) 04:48:43.328471 tst osmo-nitb_10.42.42.2(pid=26724): stderr: | (launched: 2022-12-09_04:48:42.066858) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:48:43.482032 tst esme_connect_policy_acceptall.py:18: ERR: Error: osmo-nitb_10.42.42.2(pid=26724): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26724) [trial-2354↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26724)] [trial-2354↪nitb_smpp↪esme_connect_policy_acceptall.py:18] 04:48:43.490739 tst esme_connect_policy_acceptall.py:18: Test FAILED (2.5 sec) 04:48:43.497755 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26723): Terminating (SIGTERM) 04:48:43.711122 --- ParallelTerminationStrategy: PID 26723 died... 04:48:43.732795 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26723): Terminated: ok {rc=0} ---------------------------------------------- trial-2354 nitb_smpp esme_connect_policy_closed.py ---------------------------------------------- 04:48:43.785592 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 04:48:43.807489 tst esme_connect_policy_closed.py: using MSISDN 7031 04:48:43.930437 tst esme_connect_policy_closed.py: using MSISDN 7032 04:48:44.038160 run osmo-nitb_10.42.42.2: Starting osmo-nitb 04:48:44.595358 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26725): Launched 04:48:44.894226 run osmo-nitb_10.42.42.2(pid=26726): Launched 04:48:45.055231 run osmo-nitb_10.42.42.2(pid=26726): ERR: Terminated: ERROR {rc=2} [trial-2354↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26726)] 04:48:45.177970 run osmo-nitb_10.42.42.2(pid=26726): stdout: | (launched: 2022-12-09_04:48:44.840088) 04:48:45.302897 run osmo-nitb_10.42.42.2(pid=26726): stderr: | (launched: 2022-12-09_04:48:44.884434) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:48:45.427631 run osmo-nitb_10.42.42.2(pid=26726): stdout: | (launched: 2022-12-09_04:48:44.840088) 04:48:45.546254 run osmo-nitb_10.42.42.2(pid=26726): stderr: | (launched: 2022-12-09_04:48:44.884434) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:48:45.688317 tst esme_connect_policy_closed.py:24: ERR: Error: osmo-nitb_10.42.42.2(pid=26726): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26726) [trial-2354↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26726)] [trial-2354↪nitb_smpp↪esme_connect_policy_closed.py:24] 04:48:45.696433 tst esme_connect_policy_closed.py:24: Test FAILED (1.9 sec) 04:48:45.702841 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26725): Terminating (SIGTERM) 04:48:45.911106 --- ParallelTerminationStrategy: PID 26725 died... 04:48:45.940422 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26725): Terminated: ok {rc=0} ---------------------------------------------- trial-2354 nitb_smpp esme_ms_sms_storeforward.py ---------------------------------------------- 04:48:45.995938 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 04:48:46.008522 tst nitb_smpp: Using 1 x bts (candidates: 1) 04:48:46.050437 tst esme_ms_sms_storeforward.py: using LAC 19178 04:48:46.181217 tst esme_ms_sms_storeforward.py: using RAC 53 04:48:46.350314 tst esme_ms_sms_storeforward.py: using CellId 19178 04:48:46.538244 tst esme_ms_sms_storeforward.py: using BVCI 19179 04:48:46.704368 tst nitb_smpp: Using 1 x modem (candidates: 1) 04:48:46.869416 tst esme_ms_sms_storeforward.py: using MSISDN 7033 04:48:47.017446 tst esme_ms_sms_storeforward.py:20: start nitb and bts... 04:48:47.249722 run osmo-nitb_10.42.42.2: Starting osmo-nitb 04:48:47.909021 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26727): Launched 04:48:48.231621 run osmo-nitb_10.42.42.2(pid=26728): Launched 04:48:48.406835 run osmo-nitb_10.42.42.2(pid=26728): ERR: Terminated: ERROR {rc=2} [trial-2354↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26728)] 04:48:48.541100 run osmo-nitb_10.42.42.2(pid=26728): stdout: | (launched: 2022-12-09_04:48:48.173625) 04:48:48.676519 run osmo-nitb_10.42.42.2(pid=26728): stderr: | (launched: 2022-12-09_04:48:48.221569) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:48:48.811948 run osmo-nitb_10.42.42.2(pid=26728): stdout: | (launched: 2022-12-09_04:48:48.173625) 04:48:48.940560 run osmo-nitb_10.42.42.2(pid=26728): stderr: | (launched: 2022-12-09_04:48:48.221569) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:48:49.094919 tst esme_ms_sms_storeforward.py:23: ERR: Error: osmo-nitb_10.42.42.2(pid=26728): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26728) [trial-2354↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26728)] [trial-2354↪nitb_smpp↪esme_ms_sms_storeforward.py:23] 04:48:49.103748 tst esme_ms_sms_storeforward.py:23: Test FAILED (3.1 sec) 04:48:49.110774 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26727): Terminating (SIGTERM) 04:48:49.324041 --- ParallelTerminationStrategy: PID 26727 died... 04:48:49.345621 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26727): Terminated: ok {rc=0} 04:48:49.433991 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2354 nitb_smpp esme_ms_sms_transaction.py ---------------------------------------------- 04:48:50.520860 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 04:48:50.532239 tst nitb_smpp: Using 1 x bts (candidates: 1) 04:48:50.574284 tst esme_ms_sms_transaction.py: using LAC 19179 04:48:50.694497 tst esme_ms_sms_transaction.py: using RAC 54 04:48:50.811473 tst esme_ms_sms_transaction.py: using CellId 19179 04:48:50.932102 tst esme_ms_sms_transaction.py: using BVCI 19180 04:48:51.041571 tst nitb_smpp: Using 1 x modem (candidates: 1) 04:48:51.169363 tst esme_ms_sms_transaction.py: using MSISDN 7034 04:48:51.285906 tst esme_ms_sms_transaction.py:18: start nitb and bts... 04:48:51.503316 run osmo-nitb_10.42.42.2: Starting osmo-nitb 04:48:52.154661 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26729): Launched 04:48:52.475188 run osmo-nitb_10.42.42.2(pid=26730): Launched 04:48:52.654085 run osmo-nitb_10.42.42.2(pid=26730): ERR: Terminated: ERROR {rc=2} [trial-2354↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26730)] 04:48:52.798407 run osmo-nitb_10.42.42.2(pid=26730): stdout: | (launched: 2022-12-09_04:48:52.416807) 04:48:52.943450 run osmo-nitb_10.42.42.2(pid=26730): stderr: | (launched: 2022-12-09_04:48:52.464656) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:48:53.088569 run osmo-nitb_10.42.42.2(pid=26730): stdout: | (launched: 2022-12-09_04:48:52.416807) 04:48:53.227977 run osmo-nitb_10.42.42.2(pid=26730): stderr: | (launched: 2022-12-09_04:48:52.464656) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f4d467d3268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=26730): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26730) [trial-2354↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26730)] 04:48:53.597610 tst osmo-nitb_10.42.42.2(pid=26730): stdout: | (launched: 2022-12-09_04:48:52.416807) 04:48:53.726858 tst osmo-nitb_10.42.42.2(pid=26730): stderr: | (launched: 2022-12-09_04:48:52.464656) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:48:53.879106 tst esme_ms_sms_transaction.py:21: ERR: Error: osmo-nitb_10.42.42.2(pid=26730): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26730) [trial-2354↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26730)] [trial-2354↪nitb_smpp↪esme_ms_sms_transaction.py:21] 04:48:53.887913 tst esme_ms_sms_transaction.py:21: Test FAILED (3.4 sec) 04:48:53.894951 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26729): Terminating (SIGTERM) 04:48:54.106606 --- ParallelTerminationStrategy: PID 26729 died... 04:48:54.128444 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26729): Terminated: ok {rc=0} 04:48:54.218431 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 nitb_smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 smpp --------------------------------------------------------------------- 04:48:55.382926 tst smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:48:55.385809 tst smpp: Verifying 1 x bts (candidates: 11) 04:48:55.406757 tst smpp: Verifying 6 x ip_address (candidates: 9) 04:48:55.434566 tst smpp: Verifying 1 x modem (candidates: 12) 04:48:55.470609 tst smpp: Reserving 1 x bts (candidates: 11) 04:48:55.491836 tst smpp: Reserving 6 x ip_address (candidates: 9) 04:48:55.519652 tst smpp: Reserving 1 x modem (candidates: 12) 04:48:56.045852 tst smpp: RESERVED RESOURCES for smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2354 smpp esme_connect_policy_acceptall.py ---------------------------------------------- 04:48:56.051164 tst smpp: Using 1 x ip_address (candidates: 6) 04:48:56.062105 tst smpp: Using 1 x ip_address (candidates: 6) 04:48:56.073158 tst smpp: Using 1 x ip_address (candidates: 6) 04:48:56.084461 tst smpp: Using 1 x ip_address (candidates: 6) 04:48:56.103610 tst esme_connect_policy_acceptall.py: using MSISDN 7035 04:48:56.222592 run osmo-stp_10.42.42.4: Starting osmo-stp 04:48:56.770354 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=26734): Launched 04:48:57.091175 run osmo-stp_10.42.42.4(pid=26735): Launched 04:48:57.214590 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:48:57.712436 run create_hlr_db(pid=26736): Launched 04:48:57.834494 bus /sierra_2: Setting Powered False 04:48:58.897540 run create_hlr_db(pid=26736): Terminated: ok {rc=0} 04:48:59.324424 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26738): Launched 04:48:59.624222 run osmo-hlr_10.42.42.2(pid=26739): Launched 04:48:59.738549 run osmo-msc_10.42.42.5: Starting osmo-msc 04:49:00.279830 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26741): Launched 04:49:00.577570 run osmo-msc_10.42.42.5(pid=26742): Launched 04:49:00.745335 run osmo-hlr_10.42.42.2(pid=26739): ERR: Terminated: ERROR {rc=237} [trial-2354↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26739)] 04:49:00.954799 run osmo-hlr_10.42.42.2(pid=26739): stdout: | (launched: 2022-12-09_04:48:59.569543) 04:49:01.123057 run osmo-hlr_10.42.42.2(pid=26739): stderr: | 20221209044859745 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209044859745 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209044859745 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209044859746 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209044859746 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209044859746 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209044859760 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209044859770 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209044859771 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209044859771 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:49:01.275795 run osmo-hlr_10.42.42.2(pid=26739): stdout: | (launched: 2022-12-09_04:48:59.569543) 04:49:01.408405 run osmo-hlr_10.42.42.2(pid=26739): stderr: | 20221209044859745 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209044859745 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209044859745 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209044859746 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209044859746 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209044859746 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209044859760 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209044859770 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209044859771 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209044859771 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:49:01.568706 tst esme_connect_policy_acceptall.py:23: ERR: Error: osmo-hlr_10.42.42.2(pid=26739): Process ended prematurely: osmo-hlr_10.42.42.2(pid=26739) [trial-2354↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26739)] [trial-2354↪smpp↪esme_connect_policy_acceptall.py:23] 04:49:01.578762 tst esme_connect_policy_acceptall.py:23: Test FAILED (5.5 sec) 04:49:01.610729 run osmo-msc_10.42.42.5(pid=26742): ERR: Terminated: ERROR {rc=9} [trial-2354↪smpp↪esme_connect_policy_acceptall.py↪esme_connect_policy_acceptall.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=26742)] 04:49:01.666207 run osmo-msc_10.42.42.5(pid=26742): stdout: | (launched: 2022-12-09_04:49:00.523090) 04:49:01.721892 run osmo-msc_10.42.42.5(pid=26742): stderr: | 20221209044900836 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | 20221209044900836 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | 20221209044900836 DLSS7 DEBUG XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209044900836 DLSCCP NOTICE OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | 20221209044900836 DLSS7 NOTICE 0: Creating SCCP instance (osmo_ss7.c:458) | 20221209044900837 DLSCCP INFO Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | 20221209044900837 DLSS7 DEBUG registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | 20221209044900837 DLGLOBAL NOTICE unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221209044900837 DSGS ERROR SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 04:49:01.777877 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=26734): Terminating (SIGTERM) 04:49:01.823453 run osmo-stp_10.42.42.4(pid=26735): Terminating (SIGTERM) 04:49:01.875649 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26738): Terminating (SIGTERM) 04:49:01.969259 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26741): Terminating (SIGTERM) 04:49:02.049772 --- ParallelTerminationStrategy: PID 26734 died... 04:49:02.070840 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=26734): Terminated: ok {rc=0} 04:49:02.123407 --- ParallelTerminationStrategy: PID 26735 died... 04:49:02.143918 run osmo-stp_10.42.42.4(pid=26735): Terminated: ok {rc=0} 04:49:02.194187 --- ParallelTerminationStrategy: PID 26738 died... 04:49:02.215560 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26738): Terminated: ok {rc=0} 04:49:02.264133 --- ParallelTerminationStrategy: PID 26741 died... 04:49:02.283856 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26741): Terminated: ok {rc=0} ---------------------------------------------- trial-2354 smpp esme_connect_policy_closed.py ---------------------------------------------- 04:49:02.336936 tst smpp: Using 1 x ip_address (candidates: 6) 04:49:02.348719 tst smpp: Using 1 x bts (candidates: 1) 04:49:02.387419 tst esme_connect_policy_closed.py: using LAC 19180 04:49:02.516077 tst esme_connect_policy_closed.py: using RAC 55 04:49:02.642509 tst esme_connect_policy_closed.py: using CellId 19180 04:49:02.761170 tst esme_connect_policy_closed.py: using BVCI 19181 04:49:02.872422 tst smpp: Using 1 x ip_address (candidates: 6) 04:49:02.882906 tst smpp: Using 1 x ip_address (candidates: 6) 04:49:02.893398 tst smpp: Using 1 x ip_address (candidates: 6) 04:49:02.912912 tst esme_connect_policy_closed.py: using MSISDN 7036 04:49:03.031946 tst esme_connect_policy_closed.py: using MSISDN 7037 04:49:03.142199 run osmo-stp_10.42.42.4: Starting osmo-stp 04:49:03.652728 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=26745): Launched 04:49:03.952247 run osmo-stp_10.42.42.4(pid=26746): Launched 04:49:04.066774 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:49:04.532772 run create_hlr_db(pid=26747): Launched 04:49:05.709620 run create_hlr_db(pid=26747): Terminated: ok {rc=0} 04:49:06.025710 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26749): Launched 04:49:06.325602 run osmo-hlr_10.42.42.2(pid=26750): Launched 04:49:06.440310 run osmo-msc_10.42.42.5: Starting osmo-msc 04:49:06.985682 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26752): Launched 04:49:07.285690 run osmo-msc_10.42.42.5(pid=26753): Launched 04:49:07.453622 run osmo-hlr_10.42.42.2(pid=26750): ERR: Terminated: ERROR {rc=237} [trial-2354↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26750)] 04:49:07.583565 run osmo-hlr_10.42.42.2(pid=26750): stdout: | (launched: 2022-12-09_04:49:06.270722) 04:49:07.711862 run osmo-hlr_10.42.42.2(pid=26750): stderr: | 20221209044906443 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209044906443 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209044906443 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209044906443 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209044906443 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209044906443 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209044906455 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209044906464 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209044906464 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209044906464 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:49:07.838712 run osmo-hlr_10.42.42.2(pid=26750): stdout: | (launched: 2022-12-09_04:49:06.270722) 04:49:07.958329 run osmo-hlr_10.42.42.2(pid=26750): stderr: | 20221209044906443 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209044906443 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209044906443 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209044906443 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209044906443 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209044906443 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209044906455 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209044906464 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209044906464 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209044906464 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:49:08.101526 tst esme_connect_policy_closed.py:31: ERR: Error: osmo-hlr_10.42.42.2(pid=26750): Process ended prematurely: osmo-hlr_10.42.42.2(pid=26750) [trial-2354↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26750)] [trial-2354↪smpp↪esme_connect_policy_closed.py:31] 04:49:08.109929 tst esme_connect_policy_closed.py:31: Test FAILED (5.8 sec) 04:49:08.136156 run osmo-msc_10.42.42.5(pid=26753): ERR: Terminated: ERROR {rc=9} [trial-2354↪smpp↪esme_connect_policy_closed.py↪esme_connect_policy_closed.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=26753)] 04:49:08.184210 run osmo-msc_10.42.42.5(pid=26753): stdout: | (launched: 2022-12-09_04:49:07.230987) 04:49:08.234063 run osmo-msc_10.42.42.5(pid=26753): stderr: | 20221209044907544 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | 20221209044907544 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | 20221209044907545 DLSS7 DEBUG XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209044907545 DLSCCP NOTICE OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | 20221209044907545 DLSS7 NOTICE 0: Creating SCCP instance (osmo_ss7.c:458) | 20221209044907545 DLSCCP INFO Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | 20221209044907545 DLSS7 DEBUG registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | 20221209044907545 DLGLOBAL NOTICE unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221209044907545 DSGS ERROR SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 04:49:08.284302 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=26745): Terminating (SIGTERM) 04:49:08.324564 run osmo-stp_10.42.42.4(pid=26746): Terminating (SIGTERM) 04:49:08.364823 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26749): Terminating (SIGTERM) 04:49:08.406589 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26752): Terminating (SIGTERM) 04:49:08.448016 --- ParallelTerminationStrategy: PID 26745 died... 04:49:08.467345 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=26745): Terminated: ok {rc=0} 04:49:08.512267 --- ParallelTerminationStrategy: PID 26746 died... 04:49:08.531272 run osmo-stp_10.42.42.4(pid=26746): Terminated: ok {rc=0} 04:49:08.576083 --- ParallelTerminationStrategy: PID 26749 died... 04:49:08.594908 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26749): Terminated: ok {rc=0} 04:49:08.639136 --- ParallelTerminationStrategy: PID 26752 died... 04:49:08.658051 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26752): Terminated: ok {rc=0} ---------------------------------------------- trial-2354 smpp esme_ms_sms_storeforward.py ---------------------------------------------- 04:49:08.706695 tst smpp: Using 1 x ip_address (candidates: 6) 04:49:08.717554 tst smpp: Using 1 x bts (candidates: 1) 04:49:08.751570 tst esme_ms_sms_storeforward.py: using LAC 19181 04:49:08.876269 tst esme_ms_sms_storeforward.py: using RAC 56 04:49:08.994535 tst esme_ms_sms_storeforward.py: using CellId 19181 04:49:09.113342 tst esme_ms_sms_storeforward.py: using BVCI 19182 04:49:09.222544 tst smpp: Using 1 x ip_address (candidates: 6) 04:49:09.232857 tst smpp: Using 1 x ip_address (candidates: 6) 04:49:09.243139 tst smpp: Using 1 x ip_address (candidates: 6) 04:49:09.253808 tst smpp: Using 1 x ip_address (candidates: 6) 04:49:09.264366 tst smpp: Using 1 x ip_address (candidates: 6) 04:49:09.274947 tst smpp: Using 1 x modem (candidates: 1) 04:49:09.405765 tst esme_ms_sms_storeforward.py: using MSISDN 7038 04:49:09.526230 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:49:10.025333 run create_hlr_db(pid=26756): Launched 04:49:11.206069 run create_hlr_db(pid=26756): Terminated: ok {rc=0} 04:49:11.545850 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26758): Launched 04:49:11.867496 run osmo-hlr_10.42.42.2(pid=26759): Launched 04:49:12.011060 run osmo-stp_10.42.42.5: Starting osmo-stp 04:49:12.573064 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26761): Launched 04:49:12.897072 run osmo-stp_10.42.42.5(pid=26762): Launched 04:49:13.021510 run osmo-msc_10.42.42.6: Starting osmo-msc 04:49:13.604586 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26764): Launched 04:49:13.925306 run osmo-msc_10.42.42.6(pid=26765): Launched 04:49:14.105766 run osmo-stp_10.42.42.5(pid=26762): ERR: Terminated: ERROR {rc=1} [trial-2354↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26762)] 04:49:14.242239 run osmo-stp_10.42.42.5(pid=26762): stdout: | (launched: 2022-12-09_04:49:12.838366) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:49:14.379824 run osmo-stp_10.42.42.5(pid=26762): stderr: | 20221209044913033 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044913033 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044913033 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044913034 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044913034 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044913034 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044913034 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:49:14.517351 run osmo-stp_10.42.42.5(pid=26762): stdout: | (launched: 2022-12-09_04:49:12.838366) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:49:14.645556 run osmo-stp_10.42.42.5(pid=26762): stderr: | 20221209044913033 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044913033 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044913033 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044913034 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044913034 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044913034 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044913034 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:49:14.798625 tst esme_ms_sms_storeforward.py:30: ERR: Error: osmo-stp_10.42.42.5(pid=26762): Process ended prematurely: osmo-stp_10.42.42.5(pid=26762) [trial-2354↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26762)] [trial-2354↪smpp↪esme_ms_sms_storeforward.py:30] 04:49:14.807717 tst esme_ms_sms_storeforward.py:30: Test FAILED (6.1 sec) 04:49:14.836098 run osmo-hlr_10.42.42.2(pid=26759): ERR: Terminated: ERROR {rc=237} [trial-2354↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26759)] 04:49:14.887020 run osmo-hlr_10.42.42.2(pid=26759): stdout: | (launched: 2022-12-09_04:49:11.809514) 04:49:14.939641 run osmo-hlr_10.42.42.2(pid=26759): stderr: | 20221209044912058 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209044912058 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209044912058 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209044912058 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209044912059 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209044912059 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209044912071 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/smpp/esme_ms_sms_storeforward.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209044912079 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209044912079 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209044912079 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:49:15.013419 run osmo-msc_10.42.42.6(pid=26765): ERR: Terminated: ERROR {rc=2} [trial-2354↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26765)] 04:49:15.064209 run osmo-msc_10.42.42.6(pid=26765): stdout: | (launched: 2022-12-09_04:49:13.867263) 04:49:15.116710 run osmo-msc_10.42.42.6(pid=26765): stderr: | 20221209044914186 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209044914186 DLGLOBAL DEBUG validating counter group 0x7f79e87cec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209044914186 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209044914186 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209044914186 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209044914187 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209044914188 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209044914189 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209044914189 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209044914189 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:49:15.169608 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26758): Terminating (SIGTERM) 04:49:15.212213 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26761): Terminating (SIGTERM) 04:49:15.254825 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26764): Terminating (SIGTERM) 04:49:15.297610 --- ParallelTerminationStrategy: PID 26758 died... 04:49:15.317707 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26758): Terminated: ok {rc=0} 04:49:15.364706 --- ParallelTerminationStrategy: PID 26761 died... 04:49:15.384472 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26761): Terminated: ok {rc=0} 04:49:15.431631 --- ParallelTerminationStrategy: PID 26764 died... 04:49:15.451472 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26764): Terminated: ok {rc=0} 04:49:15.540770 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2354 smpp esme_ms_sms_transaction.py ---------------------------------------------- 04:49:16.626401 tst smpp: Using 1 x ip_address (candidates: 6) 04:49:16.638821 tst smpp: Using 1 x bts (candidates: 1) 04:49:16.687753 tst esme_ms_sms_transaction.py: using LAC 19182 04:49:16.849332 tst esme_ms_sms_transaction.py: using RAC 57 04:49:16.969314 tst esme_ms_sms_transaction.py: using CellId 19182 04:49:17.098229 tst esme_ms_sms_transaction.py: using BVCI 19183 04:49:17.219083 tst smpp: Using 1 x ip_address (candidates: 6) 04:49:17.231399 tst smpp: Using 1 x ip_address (candidates: 6) 04:49:17.242690 tst smpp: Using 1 x ip_address (candidates: 6) 04:49:17.254632 tst smpp: Using 1 x ip_address (candidates: 6) 04:49:17.266337 tst smpp: Using 1 x ip_address (candidates: 6) 04:49:17.277451 tst smpp: Using 1 x modem (candidates: 1) 04:49:17.403416 tst esme_ms_sms_transaction.py: using MSISDN 7039 04:49:17.521706 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:49:18.018012 run create_hlr_db(pid=26767): Launched 04:49:18.139798 bus /sierra_2: Setting Powered False 04:49:19.202851 run create_hlr_db(pid=26767): Terminated: ok {rc=0} 04:49:19.632285 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26769): Launched 04:49:19.932530 run osmo-hlr_10.42.42.2(pid=26770): Launched 04:49:20.047464 run osmo-stp_10.42.42.5: Starting osmo-stp 04:49:20.577263 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26772): Launched 04:49:20.876527 run osmo-stp_10.42.42.5(pid=26773): Launched 04:49:20.991619 run osmo-msc_10.42.42.6: Starting osmo-msc 04:49:21.531530 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26775): Launched 04:49:21.830635 run osmo-msc_10.42.42.6(pid=26776): Launched 04:49:21.999045 run osmo-stp_10.42.42.5(pid=26773): ERR: Terminated: ERROR {rc=1} [trial-2354↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26773)] 04:49:22.125977 run osmo-stp_10.42.42.5(pid=26773): stdout: | (launched: 2022-12-09_04:49:20.821095) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:49:22.252675 run osmo-stp_10.42.42.5(pid=26773): stderr: | 20221209044920992 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044920992 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044920993 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044920993 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044920994 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044920994 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044920994 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:49:22.377805 run osmo-stp_10.42.42.5(pid=26773): stdout: | (launched: 2022-12-09_04:49:20.821095) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:49:22.496749 run osmo-stp_10.42.42.5(pid=26773): stderr: | 20221209044920992 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044920992 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044920993 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044920993 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044920994 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044920994 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044920994 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:49:22.639332 tst esme_ms_sms_transaction.py:28: ERR: Error: osmo-stp_10.42.42.5(pid=26773): Process ended prematurely: osmo-stp_10.42.42.5(pid=26773) [trial-2354↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26773)] [trial-2354↪smpp↪esme_ms_sms_transaction.py:28] 04:49:22.647506 tst esme_ms_sms_transaction.py:28: Test FAILED (6.0 sec) 04:49:22.673447 run osmo-hlr_10.42.42.2(pid=26770): ERR: Terminated: ERROR {rc=237} [trial-2354↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26770)] 04:49:22.721085 run osmo-hlr_10.42.42.2(pid=26770): stdout: | (launched: 2022-12-09_04:49:19.877969) 04:49:22.770447 run osmo-hlr_10.42.42.2(pid=26770): stderr: | 20221209044920054 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209044920054 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209044920054 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209044920054 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209044920054 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209044920054 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209044920066 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/smpp/esme_ms_sms_transaction.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209044920077 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209044920077 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209044920077 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:49:22.839618 run osmo-msc_10.42.42.6(pid=26776): ERR: Terminated: ERROR {rc=2} [trial-2354↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26776)] 04:49:22.888428 run osmo-msc_10.42.42.6(pid=26776): stdout: | (launched: 2022-12-09_04:49:21.775795) 04:49:22.938050 run osmo-msc_10.42.42.6(pid=26776): stderr: | 20221209044922050 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209044922050 DLGLOBAL DEBUG validating counter group 0x7fa136581c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209044922050 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209044922050 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209044922050 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209044922051 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209044922053 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209044922053 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209044922053 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209044922053 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:49:22.987754 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26769): Terminating (SIGTERM) 04:49:23.027325 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26772): Terminating (SIGTERM) 04:49:23.067126 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26775): Terminating (SIGTERM) 04:49:23.107243 --- ParallelTerminationStrategy: PID 26769 died... 04:49:23.126323 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26769): Terminated: ok {rc=0} 04:49:23.170230 --- ParallelTerminationStrategy: PID 26772 died... 04:49:23.188665 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26772): Terminated: ok {rc=0} 04:49:23.233206 --- ParallelTerminationStrategy: PID 26775 died... 04:49:23.251644 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26775): Terminated: ok {rc=0} 04:49:23.338241 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 encryption --------------------------------------------------------------------- 04:49:24.536154 tst encryption: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:49:24.539862 tst encryption: Verifying 1 x bts (candidates: 11) 04:49:24.560629 tst encryption: Verifying 6 x ip_address (candidates: 9) 04:49:24.587126 tst encryption: Verifying 1 x modem (candidates: 12) 04:49:24.621557 tst encryption: Reserving 1 x bts (candidates: 11) 04:49:24.642172 tst encryption: Reserving 6 x ip_address (candidates: 9) 04:49:24.667939 tst encryption: Reserving 1 x modem (candidates: 12) 04:49:25.196144 tst encryption: RESERVED RESOURCES for encryption: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2354 encryption register_a5_0_authopt.py ---------------------------------------------- 04:49:25.247858 tst encryption: Using 1 x ip_address (candidates: 6) 04:49:25.258492 tst encryption: Using 1 x bts (candidates: 1) 04:49:25.294735 tst register_a5_0_authopt.py: using LAC 19183 04:49:25.415699 tst register_a5_0_authopt.py: using RAC 58 04:49:25.536625 tst register_a5_0_authopt.py: using CellId 19183 04:49:25.656026 tst register_a5_0_authopt.py: using BVCI 19184 04:49:25.767342 tst encryption: Using 1 x ip_address (candidates: 6) 04:49:25.777844 tst encryption: Using 1 x ip_address (candidates: 6) 04:49:25.788260 tst encryption: Using 1 x ip_address (candidates: 6) 04:49:25.798564 tst encryption: Using 1 x ip_address (candidates: 6) 04:49:25.808815 tst encryption: Using 1 x ip_address (candidates: 6) 04:49:25.819130 tst encryption: Using 1 x modem (candidates: 1) 04:49:25.936427 tst register_a5_0_authopt.py:8: start network... 04:49:26.157004 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:49:26.661646 run create_hlr_db(pid=26782): Launched 04:49:26.787427 bus /sierra_2: Setting Powered False 04:49:27.847952 run create_hlr_db(pid=26782): Terminated: ok {rc=0} 04:49:28.301457 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26784): Launched 04:49:28.627246 run osmo-hlr_10.42.42.2(pid=26785): Launched 04:49:28.752342 run osmo-stp_10.42.42.5: Starting osmo-stp 04:49:29.310347 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26787): Launched 04:49:29.634354 run osmo-stp_10.42.42.5(pid=26788): Launched 04:49:29.758878 run osmo-msc_10.42.42.6: Starting osmo-msc 04:49:30.342371 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26790): Launched 04:49:30.667775 run osmo-msc_10.42.42.6(pid=26791): Launched 04:49:30.850163 run osmo-stp_10.42.42.5(pid=26788): ERR: Terminated: ERROR {rc=1} [trial-2354↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26788)] 04:49:31.112127 run osmo-stp_10.42.42.5(pid=26788): stdout: | (launched: 2022-12-09_04:49:29.575839) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:49:31.476349 run osmo-stp_10.42.42.5(pid=26788): stderr: | 20221209044929768 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044929768 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044929768 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044929768 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044929769 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044929769 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044929769 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:49:31.681811 run osmo-stp_10.42.42.5(pid=26788): stdout: | (launched: 2022-12-09_04:49:29.575839) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:49:31.822776 run osmo-stp_10.42.42.5(pid=26788): stderr: | 20221209044929768 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044929768 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044929768 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044929768 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044929769 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044929769 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044929769 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:49:31.981432 tst register_a5_0_authopt.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26788): Process ended prematurely: osmo-stp_10.42.42.5(pid=26788) [trial-2354↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26788)] [trial-2354↪encryption↪register_a5_0_authopt.py:8] 04:49:31.991778 tst register_a5_0_authopt.py:8: Test FAILED (6.8 sec) 04:49:32.023012 run osmo-hlr_10.42.42.2(pid=26785): ERR: Terminated: ERROR {rc=237} [trial-2354↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26785)] 04:49:32.076008 run osmo-hlr_10.42.42.2(pid=26785): stdout: | (launched: 2022-12-09_04:49:28.568209) 04:49:32.130920 run osmo-hlr_10.42.42.2(pid=26785): stderr: | 20221209044928768 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209044928768 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209044928768 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209044928768 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209044928768 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209044928768 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209044928780 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/encryption/register_a5_0_authopt.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209044928788 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209044928789 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209044928789 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:49:32.206734 run osmo-msc_10.42.42.6(pid=26791): ERR: Terminated: ERROR {rc=2} [trial-2354↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26791)] 04:49:32.259511 run osmo-msc_10.42.42.6(pid=26791): stdout: | (launched: 2022-12-09_04:49:30.608552) 04:49:32.314643 run osmo-msc_10.42.42.6(pid=26791): stderr: | 20221209044931044 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209044931044 DLGLOBAL DEBUG validating counter group 0x7f5ba8cfcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209044931045 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209044931045 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209044931045 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209044931045 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209044931047 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209044931047 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209044931048 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209044931048 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:49:32.367908 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26784): Terminating (SIGTERM) 04:49:32.410753 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26787): Terminating (SIGTERM) 04:49:32.453738 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26790): Terminating (SIGTERM) 04:49:32.496780 --- ParallelTerminationStrategy: PID 26784 died... 04:49:32.517445 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26784): Terminated: ok {rc=0} 04:49:32.565078 --- ParallelTerminationStrategy: PID 26787 died... 04:49:32.585005 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26787): Terminated: ok {rc=0} 04:49:32.632327 --- ParallelTerminationStrategy: PID 26790 died... 04:49:32.652219 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26790): Terminated: ok {rc=0} 04:49:32.741387 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2354 encryption register_a5_0_authreq.py ---------------------------------------------- 04:49:33.893675 tst encryption: Using 1 x ip_address (candidates: 6) 04:49:33.905202 tst encryption: Using 1 x bts (candidates: 1) 04:49:33.942038 tst register_a5_0_authreq.py: using LAC 19184 04:49:34.075292 tst register_a5_0_authreq.py: using RAC 59 04:49:34.201835 tst register_a5_0_authreq.py: using CellId 19184 04:49:34.329948 tst register_a5_0_authreq.py: using BVCI 19185 04:49:34.447437 tst encryption: Using 1 x ip_address (candidates: 6) 04:49:34.458374 tst encryption: Using 1 x ip_address (candidates: 6) 04:49:34.469240 tst encryption: Using 1 x ip_address (candidates: 6) 04:49:34.480192 tst encryption: Using 1 x ip_address (candidates: 6) 04:49:34.491095 tst encryption: Using 1 x ip_address (candidates: 6) 04:49:34.502134 tst encryption: Using 1 x modem (candidates: 1) 04:49:34.619425 tst register_a5_0_authreq.py:8: start network... 04:49:34.824187 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:49:35.293184 run create_hlr_db(pid=26793): Launched 04:49:35.418437 bus /sierra_2: Setting Powered False 04:49:36.478675 run create_hlr_db(pid=26793): Terminated: ok {rc=0} 04:49:36.921924 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26795): Launched 04:49:37.249692 run osmo-hlr_10.42.42.2(pid=26796): Launched 04:49:37.374110 run osmo-stp_10.42.42.5: Starting osmo-stp 04:49:37.932406 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26798): Launched 04:49:38.257304 run osmo-stp_10.42.42.5(pid=26799): Launched 04:49:38.382047 run osmo-msc_10.42.42.6: Starting osmo-msc 04:49:38.968621 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26801): Launched 04:49:39.294009 run osmo-msc_10.42.42.6(pid=26802): Launched 04:49:39.475191 run osmo-stp_10.42.42.5(pid=26799): ERR: Terminated: ERROR {rc=1} [trial-2354↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26799)] 04:49:39.613031 run osmo-stp_10.42.42.5(pid=26799): stdout: | (launched: 2022-12-09_04:49:38.198335) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:49:39.750181 run osmo-stp_10.42.42.5(pid=26799): stderr: | 20221209044938389 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044938389 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044938389 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044938390 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044938392 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044938392 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044938392 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:49:39.886842 run osmo-stp_10.42.42.5(pid=26799): stdout: | (launched: 2022-12-09_04:49:38.198335) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:49:40.017458 run osmo-stp_10.42.42.5(pid=26799): stderr: | 20221209044938389 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044938389 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044938389 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044938390 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044938392 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044938392 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044938392 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:49:40.172636 tst register_a5_0_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26799): Process ended prematurely: osmo-stp_10.42.42.5(pid=26799) [trial-2354↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26799)] [trial-2354↪encryption↪register_a5_0_authreq.py:8] 04:49:40.182282 tst register_a5_0_authreq.py:8: Test FAILED (6.3 sec) 04:49:40.210765 run osmo-hlr_10.42.42.2(pid=26796): ERR: Terminated: ERROR {rc=237} [trial-2354↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26796)] 04:49:40.261458 run osmo-hlr_10.42.42.2(pid=26796): stdout: | (launched: 2022-12-09_04:49:37.189472) 04:49:40.313784 run osmo-hlr_10.42.42.2(pid=26796): stderr: | 20221209044937388 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209044937388 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209044937388 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209044937388 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209044937388 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209044937388 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209044937401 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/encryption/register_a5_0_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209044937409 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209044937409 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209044937409 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:49:40.386841 run osmo-msc_10.42.42.6(pid=26802): ERR: Terminated: ERROR {rc=2} [trial-2354↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26802)] 04:49:40.437404 run osmo-msc_10.42.42.6(pid=26802): stdout: | (launched: 2022-12-09_04:49:39.235164) 04:49:40.489979 run osmo-msc_10.42.42.6(pid=26802): stderr: | 20221209044939557 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209044939557 DLGLOBAL DEBUG validating counter group 0x7f9b4369cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209044939558 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209044939558 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209044939558 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209044939558 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209044939561 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209044939562 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209044939562 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209044939562 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:49:40.543184 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26795): Terminating (SIGTERM) 04:49:40.585827 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26798): Terminating (SIGTERM) 04:49:40.628482 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26801): Terminating (SIGTERM) 04:49:40.671412 --- ParallelTerminationStrategy: PID 26795 died... 04:49:40.691468 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26795): Terminated: ok {rc=0} 04:49:40.738917 --- ParallelTerminationStrategy: PID 26798 died... 04:49:40.758872 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26798): Terminated: ok {rc=0} 04:49:40.805701 --- ParallelTerminationStrategy: PID 26801 died... 04:49:40.825543 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26801): Terminated: ok {rc=0} 04:49:40.914627 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2354 encryption register_a5_1_authreq.py ---------------------------------------------- 04:49:42.067145 tst encryption: Using 1 x ip_address (candidates: 6) 04:49:42.079151 tst encryption: Using 1 x bts (candidates: 1) 04:49:42.121454 tst register_a5_1_authreq.py: using LAC 19185 04:49:42.247924 tst register_a5_1_authreq.py: using RAC 60 04:49:42.373653 tst register_a5_1_authreq.py: using CellId 19185 04:49:42.502712 tst register_a5_1_authreq.py: using BVCI 19186 04:49:42.622292 tst encryption: Using 1 x ip_address (candidates: 6) 04:49:42.633322 tst encryption: Using 1 x ip_address (candidates: 6) 04:49:42.644242 tst encryption: Using 1 x ip_address (candidates: 6) 04:49:42.655392 tst encryption: Using 1 x ip_address (candidates: 6) 04:49:42.666571 tst encryption: Using 1 x ip_address (candidates: 6) 04:49:42.677731 tst encryption: Using 1 x modem (candidates: 1) 04:49:42.792460 tst register_a5_1_authreq.py:8: start network... 04:49:42.998939 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:49:43.469201 run create_hlr_db(pid=26804): Launched 04:49:43.595064 bus /sierra_2: Setting Powered False 04:49:44.655499 run create_hlr_db(pid=26804): Terminated: ok {rc=0} 04:49:45.099801 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26806): Launched 04:49:45.426011 run osmo-hlr_10.42.42.2(pid=26807): Launched 04:49:45.551599 run osmo-stp_10.42.42.5: Starting osmo-stp 04:49:46.133821 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26809): Launched 04:49:46.526445 run osmo-stp_10.42.42.5(pid=26810): Launched 04:49:46.820051 run osmo-msc_10.42.42.6: Starting osmo-msc 04:49:47.435879 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26812): Launched 04:49:47.739609 run osmo-msc_10.42.42.6(pid=26813): Launched 04:49:47.909304 run osmo-stp_10.42.42.5(pid=26810): ERR: Terminated: ERROR {rc=1} [trial-2354↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26810)] 04:49:48.037924 run osmo-stp_10.42.42.5(pid=26810): stdout: | (launched: 2022-12-09_04:49:46.444768) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:49:48.167593 run osmo-stp_10.42.42.5(pid=26810): stderr: | 20221209044946699 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044946700 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044946702 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044946705 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044946707 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044946708 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044946708 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:49:48.293827 run osmo-stp_10.42.42.5(pid=26810): stdout: | (launched: 2022-12-09_04:49:46.444768) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:49:48.414727 run osmo-stp_10.42.42.5(pid=26810): stderr: | 20221209044946699 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044946700 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044946702 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044946705 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044946707 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044946708 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044946708 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:49:48.559367 tst register_a5_1_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26810): Process ended prematurely: osmo-stp_10.42.42.5(pid=26810) [trial-2354↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26810)] [trial-2354↪encryption↪register_a5_1_authreq.py:8] 04:49:48.568293 tst register_a5_1_authreq.py:8: Test FAILED (6.5 sec) 04:49:48.594706 run osmo-hlr_10.42.42.2(pid=26807): ERR: Terminated: ERROR {rc=237} [trial-2354↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26807)] 04:49:48.642470 run osmo-hlr_10.42.42.2(pid=26807): stdout: | (launched: 2022-12-09_04:49:45.367014) 04:49:48.692025 run osmo-hlr_10.42.42.2(pid=26807): stderr: | 20221209044945563 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209044945563 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209044945564 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209044945564 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209044945564 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209044945564 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209044945576 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/encryption/register_a5_1_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209044945585 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209044945585 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209044945585 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:49:48.761353 run osmo-msc_10.42.42.6(pid=26813): ERR: Terminated: ERROR {rc=2} [trial-2354↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26813)] 04:49:48.809227 run osmo-msc_10.42.42.6(pid=26813): stdout: | (launched: 2022-12-09_04:49:47.684131) 04:49:48.858578 run osmo-msc_10.42.42.6(pid=26813): stderr: | 20221209044947955 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209044947955 DLGLOBAL DEBUG validating counter group 0x7f6589dcbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209044947956 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209044947956 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209044947956 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209044947956 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209044947958 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209044947958 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209044947958 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209044947958 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:49:48.908241 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26806): Terminating (SIGTERM) 04:49:48.948217 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26809): Terminating (SIGTERM) 04:49:48.988132 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26812): Terminating (SIGTERM) 04:49:49.028212 --- ParallelTerminationStrategy: PID 26806 died... 04:49:49.047476 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26806): Terminated: ok {rc=0} 04:49:49.092297 --- ParallelTerminationStrategy: PID 26809 died... 04:49:49.111238 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26809): Terminated: ok {rc=0} 04:49:49.155630 --- ParallelTerminationStrategy: PID 26812 died... 04:49:49.174512 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26812): Terminated: ok {rc=0} 04:49:49.260215 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2354 encryption register_a5_3_authreq.py ---------------------------------------------- 04:49:50.409822 tst encryption: Using 1 x ip_address (candidates: 6) 04:49:50.420848 tst encryption: Using 1 x bts (candidates: 1) 04:49:50.457154 tst register_a5_3_authreq.py: using LAC 19186 04:49:50.577699 tst register_a5_3_authreq.py: using RAC 61 04:49:50.697258 tst register_a5_3_authreq.py: using CellId 19186 04:49:50.817107 tst register_a5_3_authreq.py: using BVCI 19187 04:49:50.926672 tst encryption: Using 1 x ip_address (candidates: 6) 04:49:50.937112 tst encryption: Using 1 x ip_address (candidates: 6) 04:49:50.947380 tst encryption: Using 1 x ip_address (candidates: 6) 04:49:50.957716 tst encryption: Using 1 x ip_address (candidates: 6) 04:49:50.967867 tst encryption: Using 1 x ip_address (candidates: 6) 04:49:50.977995 tst encryption: Using 1 x modem (candidates: 1) 04:49:51.100352 tst register_a5_3_authreq.py:8: start network... 04:49:51.304438 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:49:51.773109 run create_hlr_db(pid=26815): Launched 04:49:51.898299 bus /sierra_2: Setting Powered False 04:49:52.958502 run create_hlr_db(pid=26815): Terminated: ok {rc=0} 04:49:53.403978 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26817): Launched 04:49:53.729538 run osmo-hlr_10.42.42.2(pid=26818): Launched 04:49:53.854157 run osmo-stp_10.42.42.5: Starting osmo-stp 04:49:54.413819 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26820): Launched 04:49:54.737971 run osmo-stp_10.42.42.5(pid=26821): Launched 04:49:54.862860 run osmo-msc_10.42.42.6: Starting osmo-msc 04:49:55.449219 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26823): Launched 04:49:55.774525 run osmo-msc_10.42.42.6(pid=26824): Launched 04:49:55.956094 run osmo-stp_10.42.42.5(pid=26821): ERR: Terminated: ERROR {rc=1} [trial-2354↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26821)] 04:49:56.094251 run osmo-stp_10.42.42.5(pid=26821): stdout: | (launched: 2022-12-09_04:49:54.679295) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:49:56.232338 run osmo-stp_10.42.42.5(pid=26821): stderr: | 20221209044954872 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044954872 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044954872 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044954873 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044954873 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044954873 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044954873 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:49:56.369532 run osmo-stp_10.42.42.5(pid=26821): stdout: | (launched: 2022-12-09_04:49:54.679295) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:49:56.499539 run osmo-stp_10.42.42.5(pid=26821): stderr: | 20221209044954872 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209044954872 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209044954872 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209044954873 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209044954873 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209044954873 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209044954873 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:49:56.655709 tst register_a5_3_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26821): Process ended prematurely: osmo-stp_10.42.42.5(pid=26821) [trial-2354↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26821)] [trial-2354↪encryption↪register_a5_3_authreq.py:8] 04:49:56.665263 tst register_a5_3_authreq.py:8: Test FAILED (6.3 sec) 04:49:56.693435 run osmo-hlr_10.42.42.2(pid=26818): ERR: Terminated: ERROR {rc=237} [trial-2354↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26818)] 04:49:56.744009 run osmo-hlr_10.42.42.2(pid=26818): stdout: | (launched: 2022-12-09_04:49:53.671126) 04:49:56.796066 run osmo-hlr_10.42.42.2(pid=26818): stderr: | 20221209044953870 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209044953870 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209044953870 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209044953871 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209044953871 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209044953871 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209044953883 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/encryption/register_a5_3_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209044953891 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209044953891 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209044953891 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:49:56.868691 run osmo-msc_10.42.42.6(pid=26824): ERR: Terminated: ERROR {rc=2} [trial-2354↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26824)] 04:49:56.919014 run osmo-msc_10.42.42.6(pid=26824): stdout: | (launched: 2022-12-09_04:49:55.715758) 04:49:56.971184 run osmo-msc_10.42.42.6(pid=26824): stderr: | 20221209044956038 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209044956038 DLGLOBAL DEBUG validating counter group 0x7f5ade2c8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209044956038 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209044956038 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209044956038 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209044956039 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209044956040 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209044956041 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209044956042 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209044956042 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:49:57.023699 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26817): Terminating (SIGTERM) 04:49:57.065607 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26820): Terminating (SIGTERM) 04:49:57.107826 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26823): Terminating (SIGTERM) 04:49:57.150028 --- ParallelTerminationStrategy: PID 26817 died... 04:49:57.170037 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26817): Terminated: ok {rc=0} 04:49:57.216614 --- ParallelTerminationStrategy: PID 26820 died... 04:49:57.236062 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26820): Terminated: ok {rc=0} 04:49:57.282648 --- ParallelTerminationStrategy: PID 26823 died... 04:49:57.302145 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26823): Terminated: ok {rc=0} 04:49:57.391017 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 encryption FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 4g:srsenb-rftype@zmq+srsue-rftype@zmq --------------------------------------------------------------------- 04:49:58.600728 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:49:58.606334 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x enb (candidates: 2) 04:49:58.625386 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x modem (candidates: 12) 04:49:58.652742 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x run_node (candidates: 1) 04:49:58.681005 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x enb (candidates: 2) 04:49:58.700144 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x modem (candidates: 12) 04:49:58.727296 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x run_node (candidates: 1) 04:49:59.237302 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: RESERVED RESOURCES for 4g: enb srsENB-zmq modem srsUE-zmq_1 run_node e55cbce541824969b492cc4fa86bdef69cf65e7d ---------------------------------------------- trial-2354 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover.py ---------------------------------------------- 04:49:59.242250 tst handover.py:11: TEST_CONFIG: {} 04:49:59.460319 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 04:49:59.476707 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 04:49:59.501195 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 04:49:59.552722 tst handover.py: using MSISDN 7040 04:49:59.671984 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7040', subscriber_id=0} 04:49:59.785537 run srsepc_10.42.42.118: Starting srsepc 04:50:01.838086 run rm-remote-dir(pid=26832): Launched 04:50:02.017708 bus /sierra_2: Setting Powered False 04:50:03.081936 run rm-remote-dir(pid=26832): Terminated: ok {rc=0} 04:50:03.603890 run mk-remote-dir(pid=26833): Launched 04:50:04.793584 run mk-remote-dir(pid=26833): Terminated: ok {rc=0} 04:50:05.095989 run scp-inst-to-remote(pid=26834): Launched 04:50:07.284185 run scp-inst-to-remote(pid=26834): Terminated: ok {rc=0} 04:50:07.638187 run rm-remote-dir(pid=26836): Launched 04:50:08.827038 run rm-remote-dir(pid=26836): Terminated: ok {rc=0} 04:50:09.181697 run mk-remote-dir(pid=26837): Launched 04:50:10.366548 run mk-remote-dir(pid=26837): Terminated: ok {rc=0} 04:50:10.649732 run scp-cfg-to-remote(pid=26838): Launched 04:50:11.829088 run scp-cfg-to-remote(pid=26838): Terminated: ok {rc=0} 04:50:12.130447 run scp-db-to-remote(pid=26840): Launched 04:50:13.317306 run scp-db-to-remote(pid=26840): Terminated: ok {rc=0} 04:50:13.456696 run srsepc_10.42.42.118: Setting RPATH for srsepc 04:50:13.783458 run patchelf(pid=26842): Launched 04:50:14.969813 run patchelf(pid=26842): Terminated: ok {rc=0} 04:50:15.108717 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 04:50:15.435399 run setcap-netadm(pid=26843): Launched 04:50:16.621421 run setcap-netadm(pid=26843): Terminated: ok {rc=0} 04:50:16.979576 run srsepc(pid=26844): Launched 04:50:17.189091 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 04:50:18.375945 run rm-remote-dir(pid=26845): Launched 04:50:18.561710 run srsepc(pid=26844): ERR: Terminated: ERROR {rc=127} [trial-2354↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=26844)] 04:50:18.704048 run srsepc(pid=26844): stdout: | (launched: 2022-12-09_04:50:16.912106) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 04:50:18.847159 run srsepc(pid=26844): stderr: | (launched: 2022-12-09_04:50:16.961467) | Connection to 10.42.42.116 closed. 04:50:18.989833 run srsepc(pid=26844): stdout: | (launched: 2022-12-09_04:50:16.912106) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 04:50:19.126900 run srsepc(pid=26844): stderr: | (launched: 2022-12-09_04:50:16.961467) | Connection to 10.42.42.116 closed. 04:50:19.289034 run rm-remote-dir(pid=26845): Terminating (SIGINT) 04:50:19.477848 run rm-remote-dir(pid=26845): Terminated: ok {rc=0} 04:50:19.614493 tst handover.py:37: ERR: Error: srsepc(pid=26844): Process ended prematurely: srsepc(pid=26844) [trial-2354↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=26844)] [trial-2354↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37] 04:50:19.625197 tst handover.py:37: Test FAILED (20.4 sec) 04:50:19.706362 run scp-back-log(pid=26846): Launched 04:50:20.787603 run scp-back-log(pid=26846): ERR: Terminated: ERROR {rc=1} [trial-2354↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=26846)] 04:50:20.852637 run scp-back-log(pid=26846): stdout: | (launched: 2022-12-09_04:50:19.674829) 04:50:20.919233 run scp-back-log(pid=26846): stderr: | (launched: 2022-12-09_04:50:19.695687) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 04:50:20.993742 tst srsepc_10.42.42.118: Error('scp-back-log(pid=26846): launch_sync(): local process exited with status 1 [trial-2354↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=26846)]') ---------------------------------------------- trial-2354 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_bidir.py ---------------------------------------------- 04:50:21.041838 tst iperf3_bidir.py:13: Number of physical ue: 1 04:50:21.259784 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 04:50:21.303500 tst iperf3_bidir.py:20: ue index0: srsue_10.42.42.116 04:50:21.521516 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 04:50:21.538104 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 04:50:21.570743 tst iperf3_bidir.py: using MSISDN 7041 04:50:21.682065 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7041', subscriber_id=0} 04:50:21.787365 run srsepc_10.42.42.118: Starting srsepc 04:50:22.405091 run rm-remote-dir(pid=26848): Launched 04:50:23.582671 run rm-remote-dir(pid=26848): Terminated: ok {rc=0} 04:50:23.911305 run mk-remote-dir(pid=26849): Launched 04:50:25.091344 run mk-remote-dir(pid=26849): Terminated: ok {rc=0} 04:50:25.373070 run scp-inst-to-remote(pid=26850): Launched 04:50:27.549477 run scp-inst-to-remote(pid=26850): Terminated: ok {rc=0} 04:50:27.876726 run rm-remote-dir(pid=26852): Launched 04:50:29.054608 run rm-remote-dir(pid=26852): Terminated: ok {rc=0} 04:50:29.383522 run mk-remote-dir(pid=26853): Launched 04:50:30.561177 run mk-remote-dir(pid=26853): Terminated: ok {rc=0} 04:50:30.856052 run scp-cfg-to-remote(pid=26854): Launched 04:50:32.134381 run scp-cfg-to-remote(pid=26854): Terminated: ok {rc=0} 04:50:32.437714 run scp-db-to-remote(pid=26856): Launched 04:50:33.627802 run scp-db-to-remote(pid=26856): Terminated: ok {rc=0} 04:50:33.766912 run srsepc_10.42.42.118: Setting RPATH for srsepc 04:50:34.091784 run patchelf(pid=26858): Launched 04:50:35.292096 run patchelf(pid=26858): Terminated: ok {rc=0} 04:50:35.431149 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 04:50:35.756834 run setcap-netadm(pid=26859): Launched 04:50:36.941871 run setcap-netadm(pid=26859): Terminated: ok {rc=0} 04:50:37.285723 run srsepc(pid=26860): Launched 04:50:37.409464 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 04:50:38.511769 run rm-remote-dir(pid=26861): Launched 04:50:38.688260 run srsepc(pid=26860): ERR: Terminated: ERROR {rc=127} [trial-2354↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=26860)] 04:50:38.822164 run srsepc(pid=26860): stdout: | (launched: 2022-12-09_04:50:37.223467) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 04:50:38.955425 run srsepc(pid=26860): stderr: | (launched: 2022-12-09_04:50:37.271462) | Connection to 10.42.42.116 closed. 04:50:39.088626 run srsepc(pid=26860): stdout: | (launched: 2022-12-09_04:50:37.223467) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 04:50:39.216255 run srsepc(pid=26860): stderr: | (launched: 2022-12-09_04:50:37.271462) | Connection to 10.42.42.116 closed. 04:50:39.367845 run rm-remote-dir(pid=26861): Terminating (SIGINT) 04:50:39.544924 run rm-remote-dir(pid=26861): Terminated: ok {rc=0} 04:50:39.672346 tst iperf3_bidir.py:42: ERR: Error: srsepc(pid=26860): Process ended prematurely: srsepc(pid=26860) [trial-2354↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=26860)] [trial-2354↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42] 04:50:39.682544 tst iperf3_bidir.py:42: Test FAILED (18.6 sec) 04:50:39.759256 run scp-back-log(pid=26862): Launched 04:50:40.837282 run scp-back-log(pid=26862): ERR: Terminated: ERROR {rc=1} [trial-2354↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=26862)] 04:50:40.898246 run scp-back-log(pid=26862): stdout: | (launched: 2022-12-09_04:50:39.729092) 04:50:40.960751 run scp-back-log(pid=26862): stderr: | (launched: 2022-12-09_04:50:39.749055) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 04:50:41.031360 tst srsepc_10.42.42.118: Error('scp-back-log(pid=26862): launch_sync(): local process exited with status 1 [trial-2354↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=26862)]') ---------------------------------------------- trial-2354 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_dl.py ---------------------------------------------- 04:50:41.076928 tst iperf3_dl.py:13: Number of physical ue: 1 04:50:41.278795 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 04:50:41.321736 tst iperf3_dl.py:20: ue index0: srsue_10.42.42.116 04:50:41.541333 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 04:50:41.557916 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 04:50:41.591386 tst iperf3_dl.py: using MSISDN 7042 04:50:41.708789 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7042', subscriber_id=0} 04:50:41.821995 run srsepc_10.42.42.118: Starting srsepc 04:50:42.483247 run rm-remote-dir(pid=26864): Launched 04:50:43.671203 run rm-remote-dir(pid=26864): Terminated: ok {rc=0} 04:50:44.024009 run mk-remote-dir(pid=26865): Launched 04:50:45.212727 run mk-remote-dir(pid=26865): Terminated: ok {rc=0} 04:50:45.513954 run scp-inst-to-remote(pid=26866): Launched 04:50:47.701768 run scp-inst-to-remote(pid=26866): Terminated: ok {rc=0} 04:50:48.054442 run rm-remote-dir(pid=26868): Launched 04:50:49.240113 run rm-remote-dir(pid=26868): Terminated: ok {rc=0} 04:50:49.570292 run mk-remote-dir(pid=26869): Launched 04:50:50.747950 run mk-remote-dir(pid=26869): Terminated: ok {rc=0} 04:50:51.028102 run scp-cfg-to-remote(pid=26870): Launched 04:50:52.203041 run scp-cfg-to-remote(pid=26870): Terminated: ok {rc=0} 04:50:52.482235 run scp-db-to-remote(pid=26872): Launched 04:50:53.657201 run scp-db-to-remote(pid=26872): Terminated: ok {rc=0} 04:50:53.786436 run srsepc_10.42.42.118: Setting RPATH for srsepc 04:50:54.089302 run patchelf(pid=26874): Launched 04:50:55.264085 run patchelf(pid=26874): Terminated: ok {rc=0} 04:50:55.393505 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 04:50:55.696907 run setcap-netadm(pid=26875): Launched 04:50:56.872085 run setcap-netadm(pid=26875): Terminated: ok {rc=0} 04:50:57.190073 run srsepc(pid=26876): Launched 04:50:57.303773 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 04:50:58.392792 run rm-remote-dir(pid=26877): Launched 04:50:58.568722 run srsepc(pid=26876): ERR: Terminated: ERROR {rc=127} [trial-2354↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=26876)] 04:50:58.702877 run srsepc(pid=26876): stdout: | (launched: 2022-12-09_04:50:57.134641) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 04:50:58.836509 run srsepc(pid=26876): stderr: | (launched: 2022-12-09_04:50:57.179467) | Connection to 10.42.42.116 closed. 04:50:58.969897 run srsepc(pid=26876): stdout: | (launched: 2022-12-09_04:50:57.134641) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 04:50:59.097464 run srsepc(pid=26876): stderr: | (launched: 2022-12-09_04:50:57.179467) | Connection to 10.42.42.116 closed. 04:50:59.248821 run rm-remote-dir(pid=26877): Terminating (SIGINT) 04:50:59.424532 run rm-remote-dir(pid=26877): Terminated: ok {rc=0} 04:50:59.551633 tst iperf3_dl.py:42: ERR: Error: srsepc(pid=26876): Process ended prematurely: srsepc(pid=26876) [trial-2354↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=26876)] [trial-2354↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42] 04:50:59.561887 tst iperf3_dl.py:42: Test FAILED (18.5 sec) 04:50:59.638638 run scp-back-log(pid=26878): Launched 04:51:00.715811 run scp-back-log(pid=26878): ERR: Terminated: ERROR {rc=1} [trial-2354↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=26878)] 04:51:00.776412 run scp-back-log(pid=26878): stdout: | (launched: 2022-12-09_04:50:59.608234) 04:51:00.843134 run scp-back-log(pid=26878): stderr: | (launched: 2022-12-09_04:50:59.628196) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 04:51:00.936507 tst srsepc_10.42.42.118: Error('scp-back-log(pid=26878): launch_sync(): local process exited with status 1 [trial-2354↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=26878)]') ---------------------------------------------- trial-2354 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_ul.py ---------------------------------------------- 04:51:00.983229 tst iperf3_ul.py:13: Number of physical ue: 1 04:51:01.198037 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 04:51:01.239670 tst iperf3_ul.py:20: ue index0: srsue_10.42.42.116 04:51:01.452656 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 04:51:01.469110 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 04:51:01.501570 tst iperf3_ul.py: using MSISDN 7043 04:51:01.623810 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7043', subscriber_id=0} 04:51:01.741642 run srsepc_10.42.42.118: Starting srsepc 04:51:02.418276 run rm-remote-dir(pid=26880): Launched 04:51:03.607822 run rm-remote-dir(pid=26880): Terminated: ok {rc=0} 04:51:03.962811 run mk-remote-dir(pid=26881): Launched 04:51:05.147655 run mk-remote-dir(pid=26881): Terminated: ok {rc=0} 04:51:05.429873 run scp-inst-to-remote(pid=26882): Launched 04:51:07.612009 run scp-inst-to-remote(pid=26882): Terminated: ok {rc=0} 04:51:07.965151 run rm-remote-dir(pid=26884): Launched 04:51:09.154493 run rm-remote-dir(pid=26884): Terminated: ok {rc=0} 04:51:09.509280 run mk-remote-dir(pid=26885): Launched 04:51:10.699172 run mk-remote-dir(pid=26885): Terminated: ok {rc=0} 04:51:11.001237 run scp-cfg-to-remote(pid=26886): Launched 04:51:12.186835 run scp-cfg-to-remote(pid=26886): Terminated: ok {rc=0} 04:51:12.488186 run scp-db-to-remote(pid=26888): Launched 04:51:13.678045 run scp-db-to-remote(pid=26888): Terminated: ok {rc=0} 04:51:13.818471 run srsepc_10.42.42.118: Setting RPATH for srsepc 04:51:14.144097 run patchelf(pid=26890): Launched 04:51:15.329869 run patchelf(pid=26890): Terminated: ok {rc=0} 04:51:15.469741 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 04:51:15.796576 run setcap-netadm(pid=26891): Launched 04:51:17.021380 run setcap-netadm(pid=26891): Terminated: ok {rc=0} 04:51:17.407581 run srsepc(pid=26892): Launched 04:51:17.521301 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 04:51:18.684350 run rm-remote-dir(pid=26893): Launched 04:51:18.871196 run srsepc(pid=26892): ERR: Terminated: ERROR {rc=127} [trial-2354↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=26892)] 04:51:19.013168 run srsepc(pid=26892): stdout: | (launched: 2022-12-09_04:51:17.352073) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 04:51:19.156485 run srsepc(pid=26892): stderr: | (launched: 2022-12-09_04:51:17.397344) | Connection to 10.42.42.116 closed. 04:51:19.300397 run srsepc(pid=26892): stdout: | (launched: 2022-12-09_04:51:17.352073) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 04:51:19.437789 run srsepc(pid=26892): stderr: | (launched: 2022-12-09_04:51:17.397344) | Connection to 10.42.42.116 closed. 04:51:19.601082 run rm-remote-dir(pid=26893): Terminating (SIGINT) 04:51:19.790626 run rm-remote-dir(pid=26893): Terminated: ok {rc=0} 04:51:19.927821 tst iperf3_ul.py:42: ERR: Error: srsepc(pid=26892): Process ended prematurely: srsepc(pid=26892) [trial-2354↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=26892)] [trial-2354↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42] 04:51:19.938786 tst iperf3_ul.py:42: Test FAILED (18.9 sec) 04:51:20.019912 run scp-back-log(pid=26894): Launched 04:51:21.101263 run scp-back-log(pid=26894): ERR: Terminated: ERROR {rc=1} [trial-2354↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=26894)] 04:51:21.166190 run scp-back-log(pid=26894): stdout: | (launched: 2022-12-09_04:51:19.988472) 04:51:21.233193 run scp-back-log(pid=26894): stderr: | (launched: 2022-12-09_04:51:20.009436) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 04:51:21.308288 tst srsepc_10.42.42.118: Error('scp-back-log(pid=26894): launch_sync(): local process exited with status 1 [trial-2354↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=26894)]') ---------------------------------------------- trial-2354 4g:srsenb-rftype@zmq+srsue-rftype@zmq ping.py ---------------------------------------------- 04:51:21.357446 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 04:51:21.374612 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 04:51:21.398642 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 04:51:21.453443 tst ping.py: using MSISDN 7044 04:51:21.575350 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7044', subscriber_id=0} 04:51:21.690041 run srsepc_10.42.42.118: Starting srsepc 04:51:22.357687 run rm-remote-dir(pid=26896): Launched 04:51:23.543063 run rm-remote-dir(pid=26896): Terminated: ok {rc=0} 04:51:23.874054 run mk-remote-dir(pid=26897): Launched 04:51:25.051177 run mk-remote-dir(pid=26897): Terminated: ok {rc=0} 04:51:25.332116 run scp-inst-to-remote(pid=26898): Launched 04:51:27.512194 run scp-inst-to-remote(pid=26898): Terminated: ok {rc=0} 04:51:27.840544 run rm-remote-dir(pid=26900): Launched 04:51:29.019074 run rm-remote-dir(pid=26900): Terminated: ok {rc=0} 04:51:29.348445 run mk-remote-dir(pid=26901): Launched 04:51:30.526529 run mk-remote-dir(pid=26901): Terminated: ok {rc=0} 04:51:30.806908 run scp-cfg-to-remote(pid=26902): Launched 04:51:32.033558 run scp-cfg-to-remote(pid=26902): Terminated: ok {rc=0} 04:51:32.331995 run scp-db-to-remote(pid=26904): Launched 04:51:33.509456 run scp-db-to-remote(pid=26904): Terminated: ok {rc=0} 04:51:33.638694 run srsepc_10.42.42.118: Setting RPATH for srsepc 04:51:33.942317 run patchelf(pid=26906): Launched 04:51:35.118022 run patchelf(pid=26906): Terminated: ok {rc=0} 04:51:35.247591 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 04:51:35.550695 run setcap-netadm(pid=26907): Launched 04:51:36.725571 run setcap-netadm(pid=26907): Terminated: ok {rc=0} 04:51:37.043685 run srsepc(pid=26908): Launched 04:51:37.157496 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 04:51:38.320631 run rm-remote-dir(pid=26909): Launched 04:51:38.507302 run srsepc(pid=26908): ERR: Terminated: ERROR {rc=127} [trial-2354↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=26908)] 04:51:38.649894 run srsepc(pid=26908): stdout: | (launched: 2022-12-09_04:51:36.988232) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 04:51:38.793277 run srsepc(pid=26908): stderr: | (launched: 2022-12-09_04:51:37.033284) | Connection to 10.42.42.116 closed. 04:51:38.936324 run srsepc(pid=26908): stdout: | (launched: 2022-12-09_04:51:36.988232) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 04:51:39.073608 run srsepc(pid=26908): stderr: | (launched: 2022-12-09_04:51:37.033284) | Connection to 10.42.42.116 closed. 04:51:39.236021 run rm-remote-dir(pid=26909): Terminating (SIGINT) 04:51:39.424775 run rm-remote-dir(pid=26909): Terminated: ok {rc=0} 04:51:39.561539 tst ping.py:16: ERR: Error: srsepc(pid=26908): Process ended prematurely: srsepc(pid=26908) [trial-2354↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=26908)] [trial-2354↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16] 04:51:39.572741 tst ping.py:16: Test FAILED (18.2 sec) 04:51:39.655105 run scp-back-log(pid=26910): Launched 04:51:40.736579 run scp-back-log(pid=26910): ERR: Terminated: ERROR {rc=1} [trial-2354↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=26910)] 04:51:40.801584 run scp-back-log(pid=26910): stdout: | (launched: 2022-12-09_04:51:39.622624) 04:51:40.868262 run scp-back-log(pid=26910): stderr: | (launched: 2022-12-09_04:51:39.643687) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 04:51:40.942858 tst srsepc_10.42.42.118: Error('scp-back-log(pid=26910): launch_sync(): local process exited with status 1 [trial-2354↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=26910)]') ---------------------------------------------- trial-2354 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mo_ping.py ---------------------------------------------- 04:51:40.991733 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 04:51:41.008830 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 04:51:41.032553 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 04:51:41.083513 tst rrc_idle_mo_ping.py: using MSISDN 7045 04:51:41.204067 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7045', subscriber_id=0} 04:51:41.316869 run srsepc_10.42.42.118: Starting srsepc 04:51:41.978408 run rm-remote-dir(pid=26912): Launched 04:51:43.167481 run rm-remote-dir(pid=26912): Terminated: ok {rc=0} 04:51:43.521168 run mk-remote-dir(pid=26913): Launched 04:51:44.710025 run mk-remote-dir(pid=26913): Terminated: ok {rc=0} 04:51:45.011029 run scp-inst-to-remote(pid=26914): Launched 04:51:47.206072 run scp-inst-to-remote(pid=26914): Terminated: ok {rc=0} 04:51:47.567078 run rm-remote-dir(pid=26916): Launched 04:51:48.757319 run rm-remote-dir(pid=26916): Terminated: ok {rc=0} 04:51:49.110147 run mk-remote-dir(pid=26917): Launched 04:51:50.298566 run mk-remote-dir(pid=26917): Terminated: ok {rc=0} 04:51:50.600098 run scp-cfg-to-remote(pid=26918): Launched 04:51:51.785267 run scp-cfg-to-remote(pid=26918): Terminated: ok {rc=0} 04:51:52.084596 run scp-db-to-remote(pid=26920): Launched 04:51:53.273881 run scp-db-to-remote(pid=26920): Terminated: ok {rc=0} 04:51:53.412484 run srsepc_10.42.42.118: Setting RPATH for srsepc 04:51:53.737485 run patchelf(pid=26922): Launched 04:51:54.923516 run patchelf(pid=26922): Terminated: ok {rc=0} 04:51:55.062617 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 04:51:55.387053 run setcap-netadm(pid=26923): Launched 04:51:56.572335 run setcap-netadm(pid=26923): Terminated: ok {rc=0} 04:51:56.912596 run srsepc(pid=26924): Launched 04:51:57.032713 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 04:51:58.133990 run rm-remote-dir(pid=26925): Launched 04:51:58.310572 run srsepc(pid=26924): ERR: Terminated: ERROR {rc=127} [trial-2354↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=26924)] 04:51:58.444226 run srsepc(pid=26924): stdout: | (launched: 2022-12-09_04:51:56.854015) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 04:51:58.577925 run srsepc(pid=26924): stderr: | (launched: 2022-12-09_04:51:56.902032) | Connection to 10.42.42.116 closed. 04:51:58.711207 run srsepc(pid=26924): stdout: | (launched: 2022-12-09_04:51:56.854015) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 04:51:58.838931 run srsepc(pid=26924): stderr: | (launched: 2022-12-09_04:51:56.902032) | Connection to 10.42.42.116 closed. 04:51:58.990512 run rm-remote-dir(pid=26925): Terminating (SIGINT) 04:51:59.167294 run rm-remote-dir(pid=26925): Terminated: ok {rc=0} 04:51:59.294943 tst rrc_idle_mo_ping.py:16: ERR: Error: srsepc(pid=26924): Process ended prematurely: srsepc(pid=26924) [trial-2354↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=26924)] [trial-2354↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16] 04:51:59.304774 tst rrc_idle_mo_ping.py:16: Test FAILED (18.3 sec) 04:51:59.382912 run scp-back-log(pid=26926): Launched 04:52:00.461404 run scp-back-log(pid=26926): ERR: Terminated: ERROR {rc=1} [trial-2354↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=26926)] 04:52:00.522195 run scp-back-log(pid=26926): stdout: | (launched: 2022-12-09_04:51:59.352477) 04:52:00.585366 run scp-back-log(pid=26926): stderr: | (launched: 2022-12-09_04:51:59.372538) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 04:52:00.655998 tst srsepc_10.42.42.118: Error('scp-back-log(pid=26926): launch_sync(): local process exited with status 1 [trial-2354↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=26926)]') ---------------------------------------------- trial-2354 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mt_ping.py ---------------------------------------------- 04:52:00.701594 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 04:52:00.718000 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 04:52:00.740388 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 04:52:00.786782 tst rrc_idle_mt_ping.py: using MSISDN 7046 04:52:00.930547 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7046', subscriber_id=0} 04:52:01.046559 run srsepc_10.42.42.118: Starting srsepc 04:52:01.777802 run rm-remote-dir(pid=26928): Launched 04:52:03.029240 run rm-remote-dir(pid=26928): Terminated: ok {rc=0} 04:52:03.359468 run mk-remote-dir(pid=26929): Launched 04:52:04.537358 run mk-remote-dir(pid=26929): Terminated: ok {rc=0} 04:52:04.819060 run scp-inst-to-remote(pid=26930): Launched 04:52:06.996569 run scp-inst-to-remote(pid=26930): Terminated: ok {rc=0} 04:52:07.324639 run rm-remote-dir(pid=26932): Launched 04:52:08.502964 run rm-remote-dir(pid=26932): Terminated: ok {rc=0} 04:52:08.832898 run mk-remote-dir(pid=26933): Launched 04:52:10.010580 run mk-remote-dir(pid=26933): Terminated: ok {rc=0} 04:52:10.292596 run scp-cfg-to-remote(pid=26935): Launched 04:52:11.467382 run scp-cfg-to-remote(pid=26935): Terminated: ok {rc=0} 04:52:11.746253 run scp-db-to-remote(pid=26937): Launched 04:52:12.921216 run scp-db-to-remote(pid=26937): Terminated: ok {rc=0} 04:52:13.050196 run srsepc_10.42.42.118: Setting RPATH for srsepc 04:52:13.352852 run patchelf(pid=26939): Launched 04:52:14.528084 run patchelf(pid=26939): Terminated: ok {rc=0} 04:52:14.657582 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 04:52:14.960028 run setcap-netadm(pid=26940): Launched 04:52:16.135804 run setcap-netadm(pid=26940): Terminated: ok {rc=0} 04:52:16.466996 run srsepc(pid=26941): Launched 04:52:16.700025 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 04:52:17.859212 run rm-remote-dir(pid=26942): Launched 04:52:18.034970 run srsepc(pid=26941): ERR: Terminated: ERROR {rc=127} [trial-2354↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=26941)] 04:52:18.168235 run srsepc(pid=26941): stdout: | (launched: 2022-12-09_04:52:16.406557) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 04:52:18.301366 run srsepc(pid=26941): stderr: | (launched: 2022-12-09_04:52:16.452380) | Connection to 10.42.42.116 closed. 04:52:18.433722 run srsepc(pid=26941): stdout: | (launched: 2022-12-09_04:52:16.406557) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 04:52:18.560738 run srsepc(pid=26941): stderr: | (launched: 2022-12-09_04:52:16.452380) | Connection to 10.42.42.116 closed. 04:52:18.711345 run rm-remote-dir(pid=26942): Terminating (SIGINT) 04:52:18.887178 run rm-remote-dir(pid=26942): Terminated: ok {rc=0} 04:52:19.013814 tst rrc_idle_mt_ping.py:16: ERR: Error: srsepc(pid=26941): Process ended prematurely: srsepc(pid=26941) [trial-2354↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=26941)] [trial-2354↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16] 04:52:19.023720 tst rrc_idle_mt_ping.py:16: Test FAILED (18.3 sec) 04:52:19.100607 run scp-back-log(pid=26943): Launched 04:52:20.178183 run scp-back-log(pid=26943): ERR: Terminated: ERROR {rc=1} [trial-2354↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=26943)] 04:52:20.239208 run scp-back-log(pid=26943): stdout: | (launched: 2022-12-09_04:52:19.070262) 04:52:20.302399 run scp-back-log(pid=26943): stderr: | (launched: 2022-12-09_04:52:19.090193) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 04:52:20.372872 tst srsepc_10.42.42.118: Error('scp-back-log(pid=26943): launch_sync(): local process exited with status 1 [trial-2354↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=26943)]') --------------------------------------------------------------------- trial-2354 4g:srsenb-rftype@zmq+srsue-rftype@zmq FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 handover_2G:nanobts+bts1-oc2g --------------------------------------------------------------------- 04:52:20.499935 tst handover_2G:nanobts+bts1-oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:52:20.504775 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x bts (candidates: 11) 04:52:20.545041 tst handover_2G:nanobts+bts1-oc2g: Verifying 6 x ip_address (candidates: 9) 04:52:20.571107 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x modem (candidates: 12) 04:52:20.621551 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x bts (candidates: 11) 04:52:20.662826 tst handover_2G:nanobts+bts1-oc2g: Reserving 6 x ip_address (candidates: 9) 04:52:20.688855 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x modem (candidates: 12) 04:52:21.241125 tst handover_2G:nanobts+bts1-oc2g: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 handover_2G:nanobts+bts1-oc2g handover.py ---------------------------------------------- 04:52:21.247275 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 04:52:21.259001 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 04:52:21.300207 tst handover.py: using LAC 19187 04:52:21.428574 tst handover.py: using RAC 62 04:52:21.557815 tst handover.py: using CellId 19187 04:52:21.684804 tst handover.py: using BVCI 19188 04:52:21.801570 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 04:52:21.836772 tst handover.py: using LAC 19188 04:52:21.960868 tst handover.py: using RAC 63 04:52:22.085141 tst handover.py: using CellId 19188 04:52:22.209522 tst handover.py: using BVCI 19189 04:52:22.326530 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 04:52:22.337582 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 04:52:22.348547 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 04:52:22.359783 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 04:52:22.371129 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 04:52:22.382483 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 04:52:22.497855 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 04:52:22.611083 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:52:23.069952 run create_hlr_db(pid=26950): Launched 04:52:24.238619 run create_hlr_db(pid=26950): Terminated: ok {rc=0} 04:52:24.552375 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26952): Launched 04:52:24.848720 run osmo-hlr_10.42.42.2(pid=26953): Launched 04:52:24.961957 run osmo-stp_10.42.42.5: Starting osmo-stp 04:52:25.484456 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26955): Launched 04:52:25.781692 run osmo-stp_10.42.42.5(pid=26956): Launched 04:52:25.894734 run osmo-msc_10.42.42.6: Starting osmo-msc 04:52:26.430244 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26958): Launched 04:52:26.725424 run osmo-msc_10.42.42.6(pid=26959): Launched 04:52:26.892523 run osmo-stp_10.42.42.5(pid=26956): ERR: Terminated: ERROR {rc=1} [trial-2354↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26956)] 04:52:27.017879 run osmo-stp_10.42.42.5(pid=26956): stdout: | (launched: 2022-12-09_04:52:25.727644) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:52:27.143770 run osmo-stp_10.42.42.5(pid=26956): stderr: | 20221209045225897 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209045225897 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209045225897 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209045225897 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209045225898 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209045225898 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209045225898 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:52:27.267730 run osmo-stp_10.42.42.5(pid=26956): stdout: | (launched: 2022-12-09_04:52:25.727644) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:52:27.385645 run osmo-stp_10.42.42.5(pid=26956): stderr: | 20221209045225897 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209045225897 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209045225897 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209045225897 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209045225898 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209045225898 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209045225898 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:52:27.526499 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=26956): Process ended prematurely: osmo-stp_10.42.42.5(pid=26956) [trial-2354↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26956)] [trial-2354↪handover_2G:nanobts+bts1-oc2g↪handover.py:18] 04:52:27.534717 tst handover.py:18: Test FAILED (6.3 sec) 04:52:27.560492 run osmo-hlr_10.42.42.2(pid=26953): ERR: Terminated: ERROR {rc=237} [trial-2354↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26953)] 04:52:27.608035 run osmo-hlr_10.42.42.2(pid=26953): stdout: | (launched: 2022-12-09_04:52:24.794674) 04:52:27.657249 run osmo-hlr_10.42.42.2(pid=26953): stderr: | 20221209045224970 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209045224970 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209045224970 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209045224970 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209045224971 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209045224971 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209045224983 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/handover_2G:nanobts+bts1-oc2g/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209045224993 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209045224993 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209045224994 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:52:27.726083 run osmo-msc_10.42.42.6(pid=26959): ERR: Terminated: ERROR {rc=2} [trial-2354↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26959)] 04:52:27.773367 run osmo-msc_10.42.42.6(pid=26959): stdout: | (launched: 2022-12-09_04:52:26.671598) 04:52:27.822474 run osmo-msc_10.42.42.6(pid=26959): stderr: | 20221209045226940 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209045226940 DLGLOBAL DEBUG validating counter group 0x7f60e638fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209045226940 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209045226940 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209045226940 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209045226941 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209045226943 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209045226944 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209045226944 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209045226944 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:52:27.871664 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26952): Terminating (SIGTERM) 04:52:27.910823 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26955): Terminating (SIGTERM) 04:52:27.950047 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26958): Terminating (SIGTERM) 04:52:27.989504 --- ParallelTerminationStrategy: PID 26952 died... 04:52:28.008299 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26952): Terminated: ok {rc=0} 04:52:28.052543 --- ParallelTerminationStrategy: PID 26955 died... 04:52:28.071091 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26955): Terminated: ok {rc=0} 04:52:28.115210 --- ParallelTerminationStrategy: PID 26958 died... 04:52:28.133742 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26958): Terminated: ok {rc=0} 04:52:28.219234 bus /sierra_3: Setting Powered False 04:52:29.319676 bus /sierra_3: Setting Powered False 04:52:30.435173 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 handover_2G:nanobts+bts1-oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 handover_2G:nanobts+bts1-octphy --------------------------------------------------------------------- 04:52:31.719175 tst handover_2G:nanobts+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:52:31.727481 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x bts (candidates: 11) 04:52:31.776258 tst handover_2G:nanobts+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 04:52:31.809938 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x modem (candidates: 12) 04:52:31.867555 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x bts (candidates: 11) 04:52:31.910553 tst handover_2G:nanobts+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 04:52:31.940144 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x modem (candidates: 12) 04:52:32.491291 tst handover_2G:nanobts+bts1-octphy: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 handover_2G:nanobts+bts1-octphy handover.py ---------------------------------------------- 04:52:32.497515 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 04:52:32.508938 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 04:52:32.550416 tst handover.py: using LAC 19189 04:52:32.677634 tst handover.py: using RAC 64 04:52:32.808006 tst handover.py: using CellId 19189 04:52:32.934490 tst handover.py: using BVCI 19190 04:52:33.051037 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 04:52:33.087058 tst handover.py: using LAC 19190 04:52:33.205930 tst handover.py: using RAC 65 04:52:33.322569 tst handover.py: using CellId 19190 04:52:33.437489 tst handover.py: using BVCI 19191 04:52:33.555859 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 04:52:33.566997 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 04:52:33.578034 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 04:52:33.589959 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 04:52:33.602194 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 04:52:33.613957 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 04:52:33.731385 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 04:52:33.849567 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:52:34.317282 run create_hlr_db(pid=26964): Launched 04:52:34.447453 bus /sierra_2: Setting Powered False 04:52:35.510336 run create_hlr_db(pid=26964): Terminated: ok {rc=0} 04:52:35.927678 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26968): Launched 04:52:36.247095 run osmo-hlr_10.42.42.2(pid=26969): Launched 04:52:36.369791 run osmo-stp_10.42.42.5: Starting osmo-stp 04:52:36.897678 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26971): Launched 04:52:37.218153 run osmo-stp_10.42.42.5(pid=26972): Launched 04:52:37.341248 run osmo-msc_10.42.42.6: Starting osmo-msc 04:52:37.893527 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26974): Launched 04:52:38.213533 run osmo-msc_10.42.42.6(pid=26975): Launched 04:52:38.393484 run osmo-stp_10.42.42.5(pid=26972): ERR: Terminated: ERROR {rc=1} [trial-2354↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26972)] 04:52:38.530071 run osmo-stp_10.42.42.5(pid=26972): stdout: | (launched: 2022-12-09_04:52:37.160191) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:52:38.668092 run osmo-stp_10.42.42.5(pid=26972): stderr: | 20221209045237351 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209045237351 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209045237352 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209045237352 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209045237352 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209045237353 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209045237353 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:52:38.804237 run osmo-stp_10.42.42.5(pid=26972): stdout: | (launched: 2022-12-09_04:52:37.160191) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:52:38.931899 run osmo-stp_10.42.42.5(pid=26972): stderr: | 20221209045237351 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209045237351 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209045237352 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209045237352 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209045237352 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209045237353 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209045237353 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:52:39.084747 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=26972): Process ended prematurely: osmo-stp_10.42.42.5(pid=26972) [trial-2354↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26972)] [trial-2354↪handover_2G:nanobts+bts1-octphy↪handover.py:18] 04:52:39.093673 tst handover.py:18: Test FAILED (6.6 sec) 04:52:39.121662 run osmo-hlr_10.42.42.2(pid=26969): ERR: Terminated: ERROR {rc=237} [trial-2354↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26969)] 04:52:39.172000 run osmo-hlr_10.42.42.2(pid=26969): stdout: | (launched: 2022-12-09_04:52:36.189398) 04:52:39.224346 run osmo-hlr_10.42.42.2(pid=26969): stderr: | 20221209045236386 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209045236386 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209045236386 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209045236386 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209045236386 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209045236386 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209045236399 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/handover_2G:nanobts+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209045236407 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209045236407 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209045236407 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:52:39.297458 run osmo-msc_10.42.42.6(pid=26975): ERR: Terminated: ERROR {rc=2} [trial-2354↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26975)] 04:52:39.347967 run osmo-msc_10.42.42.6(pid=26975): stdout: | (launched: 2022-12-09_04:52:38.155374) 04:52:39.400341 run osmo-msc_10.42.42.6(pid=26975): stderr: | 20221209045238476 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209045238476 DLGLOBAL DEBUG validating counter group 0x7fd8f57d5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209045238476 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209045238476 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209045238477 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209045238477 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209045238478 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209045238479 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209045238479 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209045238479 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:52:39.452927 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26968): Terminating (SIGTERM) 04:52:39.495242 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26971): Terminating (SIGTERM) 04:52:39.537581 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26974): Terminating (SIGTERM) 04:52:39.580306 --- ParallelTerminationStrategy: PID 26968 died... 04:52:39.600671 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26968): Terminated: ok {rc=0} 04:52:39.648159 --- ParallelTerminationStrategy: PID 26971 died... 04:52:39.667994 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26971): Terminated: ok {rc=0} 04:52:39.714759 --- ParallelTerminationStrategy: PID 26974 died... 04:52:39.734347 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26974): Terminated: ok {rc=0} 04:52:39.822642 bus /sierra_3: Setting Powered False 04:52:40.922465 bus /sierra_3: Setting Powered False 04:52:42.037260 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 handover_2G:nanobts+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 handover_2G:nanobts+bts1-trx-lms --------------------------------------------------------------------- 04:52:43.285829 tst handover_2G:nanobts+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:52:43.291177 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 04:52:43.345918 tst handover_2G:nanobts+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 04:52:43.372727 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 04:52:43.431436 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 04:52:43.485594 tst handover_2G:nanobts+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 04:52:43.512446 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 04:52:44.058187 tst handover_2G:nanobts+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 handover_2G:nanobts+bts1-trx-lms handover.py ---------------------------------------------- 04:52:44.063541 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 04:52:44.074810 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 04:52:44.113408 tst handover.py: using LAC 19191 04:52:44.237451 tst handover.py: using RAC 66 04:52:44.363465 tst handover.py: using CellId 19191 04:52:44.491302 tst handover.py: using BVCI 19192 04:52:44.608794 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 04:52:44.669379 tst handover.py: using LAC 19192 04:52:44.795162 tst handover.py: using RAC 67 04:52:44.918797 tst handover.py: using CellId 19192 04:52:45.044868 tst handover.py: using BVCI 19193 04:52:45.160843 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 04:52:45.171994 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 04:52:45.182947 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 04:52:45.194273 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 04:52:45.205653 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 04:52:45.216856 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 04:52:45.333852 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 04:52:45.447685 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:52:45.939121 run create_hlr_db(pid=26980): Launched 04:52:46.093615 bus /sierra_2: Setting Powered False 04:52:47.159584 run create_hlr_db(pid=26980): Terminated: ok {rc=0} 04:52:47.566378 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26982): Launched 04:52:47.863234 run osmo-hlr_10.42.42.2(pid=26983): Launched 04:52:47.977408 run osmo-stp_10.42.42.5: Starting osmo-stp 04:52:48.466539 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26985): Launched 04:52:48.762811 run osmo-stp_10.42.42.5(pid=26986): Launched 04:52:48.876768 run osmo-msc_10.42.42.6: Starting osmo-msc 04:52:49.389947 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26988): Launched 04:52:49.687238 run osmo-msc_10.42.42.6(pid=26989): Launched 04:52:49.854075 run osmo-stp_10.42.42.5(pid=26986): ERR: Terminated: ERROR {rc=1} [trial-2354↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26986)] 04:52:49.980797 run osmo-stp_10.42.42.5(pid=26986): stdout: | (launched: 2022-12-09_04:52:48.708533) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:52:50.108055 run osmo-stp_10.42.42.5(pid=26986): stderr: | 20221209045248876 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209045248877 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209045248877 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209045248877 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209045248879 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209045248880 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209045248880 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:52:50.232651 run osmo-stp_10.42.42.5(pid=26986): stdout: | (launched: 2022-12-09_04:52:48.708533) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:52:50.350900 run osmo-stp_10.42.42.5(pid=26986): stderr: | 20221209045248876 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209045248877 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209045248877 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209045248877 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209045248879 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209045248880 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209045248880 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:52:50.492565 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=26986): Process ended prematurely: osmo-stp_10.42.42.5(pid=26986) [trial-2354↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26986)] [trial-2354↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18] 04:52:50.500616 tst handover.py:18: Test FAILED (6.4 sec) 04:52:50.527610 run osmo-hlr_10.42.42.2(pid=26983): ERR: Terminated: ERROR {rc=237} [trial-2354↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26983)] 04:52:50.575545 run osmo-hlr_10.42.42.2(pid=26983): stdout: | (launched: 2022-12-09_04:52:47.808913) 04:52:50.625354 run osmo-hlr_10.42.42.2(pid=26983): stderr: | 20221209045247980 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209045247980 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209045247980 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209045247980 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209045247980 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209045247980 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209045247992 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/handover_2G:nanobts+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209045248001 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209045248001 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209045248001 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:52:50.694487 run osmo-msc_10.42.42.6(pid=26989): ERR: Terminated: ERROR {rc=2} [trial-2354↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26989)] 04:52:50.742048 run osmo-msc_10.42.42.6(pid=26989): stdout: | (launched: 2022-12-09_04:52:49.632701) 04:52:50.791501 run osmo-msc_10.42.42.6(pid=26989): stderr: | 20221209045249901 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209045249902 DLGLOBAL DEBUG validating counter group 0x7f85c417cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209045249902 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209045249902 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209045249902 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209045249902 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209045249904 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209045249905 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209045249905 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209045249905 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:52:50.841447 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26982): Terminating (SIGTERM) 04:52:50.881218 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26985): Terminating (SIGTERM) 04:52:50.921526 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26988): Terminating (SIGTERM) 04:52:50.961564 --- ParallelTerminationStrategy: PID 26982 died... 04:52:50.980547 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26982): Terminated: ok {rc=0} 04:52:51.024743 --- ParallelTerminationStrategy: PID 26985 died... 04:52:51.043278 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26985): Terminated: ok {rc=0} 04:52:51.088045 --- ParallelTerminationStrategy: PID 26988 died... 04:52:51.106546 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26988): Terminated: ok {rc=0} 04:52:51.192377 bus /sierra_3: Setting Powered False 04:52:52.292372 bus /sierra_3: Setting Powered False 04:52:53.408536 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 handover_2G:nanobts+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 handover_2G:nanobts+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 04:52:54.664754 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:52:54.670982 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 04:52:54.721171 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 04:52:54.748050 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 04:52:54.799700 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 04:52:54.849519 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 04:52:54.877253 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 04:52:55.430953 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 handover_2G:nanobts+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 04:52:55.436303 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:52:55.447681 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 04:52:55.486311 tst handover.py: using LAC 19193 04:52:55.612119 tst handover.py: using RAC 68 04:52:55.741661 tst handover.py: using CellId 19193 04:52:55.866515 tst handover.py: using BVCI 19194 04:52:55.982450 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 04:52:56.026730 tst handover.py: using LAC 19194 04:52:56.152924 tst handover.py: using RAC 69 04:52:56.276934 tst handover.py: using CellId 19194 04:52:56.401009 tst handover.py: using BVCI 19195 04:52:56.516759 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:52:56.528295 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:52:56.539529 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:52:56.550832 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:52:56.562148 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:52:56.573517 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 04:52:56.693227 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 04:52:56.808388 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:52:57.243958 run create_hlr_db(pid=26994): Launched 04:52:57.358989 bus /sierra_2: Setting Powered False 04:52:58.422603 run create_hlr_db(pid=26994): Terminated: ok {rc=0} 04:52:58.840777 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26996): Launched 04:52:59.160453 run osmo-hlr_10.42.42.2(pid=26997): Launched 04:52:59.282758 run osmo-stp_10.42.42.5: Starting osmo-stp 04:52:59.804543 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26999): Launched 04:53:00.123063 run osmo-stp_10.42.42.5(pid=27000): Launched 04:53:00.245150 run osmo-msc_10.42.42.6: Starting osmo-msc 04:53:00.799186 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27002): Launched 04:53:01.149913 run osmo-msc_10.42.42.6(pid=27003): Launched 04:53:01.529568 run osmo-stp_10.42.42.5(pid=27000): ERR: Terminated: ERROR {rc=1} [trial-2354↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27000)] 04:53:01.843677 run osmo-stp_10.42.42.5(pid=27000): stdout: | (launched: 2022-12-09_04:53:00.065334) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:53:02.065550 run osmo-stp_10.42.42.5(pid=27000): stderr: | 20221209045300256 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209045300256 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209045300256 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209045300257 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209045300257 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209045300257 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209045300257 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:53:02.202016 run osmo-stp_10.42.42.5(pid=27000): stdout: | (launched: 2022-12-09_04:53:00.065334) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:53:02.354019 run osmo-stp_10.42.42.5(pid=27000): stderr: | 20221209045300256 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209045300256 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209045300256 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209045300257 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209045300257 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209045300257 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209045300257 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:53:02.550845 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27000): Process ended prematurely: osmo-stp_10.42.42.5(pid=27000) [trial-2354↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27000)] [trial-2354↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18] 04:53:02.564456 tst handover.py:18: Test FAILED (7.1 sec) 04:53:02.592994 run osmo-hlr_10.42.42.2(pid=26997): ERR: Terminated: ERROR {rc=237} [trial-2354↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26997)] 04:53:02.646245 run osmo-hlr_10.42.42.2(pid=26997): stdout: | (launched: 2022-12-09_04:52:59.102189) 04:53:02.701756 run osmo-hlr_10.42.42.2(pid=26997): stderr: | 20221209045259300 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209045259300 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209045259300 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209045259300 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209045259300 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209045259300 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209045259312 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/handover_2G:nanobts+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209045259321 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209045259321 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209045259321 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:53:02.778618 run osmo-msc_10.42.42.6(pid=27003): ERR: Terminated: ERROR {rc=2} [trial-2354↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27003)] 04:53:02.835481 run osmo-msc_10.42.42.6(pid=27003): stdout: | (launched: 2022-12-09_04:53:01.090697) 04:53:02.889213 run osmo-msc_10.42.42.6(pid=27003): stderr: | 20221209045301487 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209045301487 DLGLOBAL DEBUG validating counter group 0x7f889df1ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209045301487 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209045301487 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209045301488 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209045301488 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209045301494 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209045301495 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209045301495 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209045301495 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:53:02.944823 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26996): Terminating (SIGTERM) 04:53:02.996760 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26999): Terminating (SIGTERM) 04:53:03.041708 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27002): Terminating (SIGTERM) 04:53:03.092148 --- ParallelTerminationStrategy: PID 26996 died... 04:53:03.112462 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26996): Terminated: ok {rc=0} 04:53:03.164124 --- ParallelTerminationStrategy: PID 26999 died... 04:53:03.188820 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26999): Terminated: ok {rc=0} 04:53:03.238112 --- ParallelTerminationStrategy: PID 27002 died... 04:53:03.258559 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27002): Terminated: ok {rc=0} 04:53:03.376858 bus /sierra_3: Setting Powered False 04:53:04.491006 bus /sierra_3: Setting Powered False 04:53:05.608115 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 handover_2G:nanobts+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 handover_2G:nanobts+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 04:53:06.878463 tst handover_2G:nanobts+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:53:06.884256 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 04:53:06.941905 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 04:53:06.970161 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 04:53:07.019961 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 04:53:07.075645 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 04:53:07.102429 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 04:53:07.658978 tst handover_2G:nanobts+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 handover_2G:nanobts+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 04:53:07.667094 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:53:07.679334 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 04:53:07.720893 tst handover.py: using LAC 19195 04:53:07.840456 tst handover.py: using RAC 70 04:53:07.960769 tst handover.py: using CellId 19195 04:53:08.080171 tst handover.py: using BVCI 19196 04:53:08.192786 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 04:53:08.241704 tst handover.py: using LAC 19196 04:53:08.361402 tst handover.py: using RAC 71 04:53:08.483243 tst handover.py: using CellId 19196 04:53:08.602470 tst handover.py: using BVCI 19197 04:53:08.716208 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:53:08.728100 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:53:08.739846 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:53:08.752593 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:53:08.766526 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:53:08.779459 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 04:53:08.901720 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 04:53:09.020603 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:53:09.487234 run create_hlr_db(pid=27280): Launched 04:53:09.642868 bus /sierra_2: Setting Powered False 04:53:10.706295 run create_hlr_db(pid=27280): Terminated: ok {rc=0} 04:53:11.125711 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27282): Launched 04:53:11.457113 run osmo-hlr_10.42.42.2(pid=27283): Launched 04:53:11.698816 run osmo-stp_10.42.42.5: Starting osmo-stp 04:53:12.393738 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27285): Launched 04:53:12.732168 run osmo-stp_10.42.42.5(pid=27286): Launched 04:53:12.978637 run osmo-msc_10.42.42.6: Starting osmo-msc 04:53:13.673729 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27288): Launched 04:53:14.005745 run osmo-msc_10.42.42.6(pid=27289): Launched 04:53:14.354297 run osmo-stp_10.42.42.5(pid=27286): ERR: Terminated: ERROR {rc=1} [trial-2354↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27286)] 04:53:14.577939 run osmo-stp_10.42.42.5(pid=27286): stdout: | (launched: 2022-12-09_04:53:12.658214) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:53:14.752436 run osmo-stp_10.42.42.5(pid=27286): stderr: | 20221209045312992 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209045312996 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209045312996 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209045312997 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209045312997 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209045312997 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209045312998 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:53:15.024903 run osmo-stp_10.42.42.5(pid=27286): stdout: | (launched: 2022-12-09_04:53:12.658214) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:53:15.149556 run osmo-stp_10.42.42.5(pid=27286): stderr: | 20221209045312992 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209045312996 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209045312996 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209045312997 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209045312997 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209045312997 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209045312998 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:53:15.299561 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27286): Process ended prematurely: osmo-stp_10.42.42.5(pid=27286) [trial-2354↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27286)] [trial-2354↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18] 04:53:15.308804 tst handover.py:18: Test FAILED (7.6 sec) 04:53:15.339270 run osmo-hlr_10.42.42.2(pid=27283): ERR: Terminated: ERROR {rc=237} [trial-2354↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27283)] 04:53:15.390865 run osmo-hlr_10.42.42.2(pid=27283): stdout: | (launched: 2022-12-09_04:53:11.388080) 04:53:15.444738 run osmo-hlr_10.42.42.2(pid=27283): stderr: | 20221209045311734 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209045311734 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209045311734 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209045311734 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209045311734 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209045311734 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209045311751 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/handover_2G:nanobts+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209045311763 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209045311763 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209045311764 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:53:15.520213 run osmo-msc_10.42.42.6(pid=27289): ERR: Terminated: ERROR {rc=2} [trial-2354↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27289)] 04:53:15.572009 run osmo-msc_10.42.42.6(pid=27289): stdout: | (launched: 2022-12-09_04:53:13.934700) 04:53:15.625247 run osmo-msc_10.42.42.6(pid=27289): stderr: | 20221209045314594 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209045314594 DLGLOBAL DEBUG validating counter group 0x7f4c1ee67c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209045314594 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209045314594 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209045314594 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209045314594 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209045314596 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209045314596 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209045314596 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209045314601 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:53:15.679844 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27282): Terminating (SIGTERM) 04:53:15.724270 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27285): Terminating (SIGTERM) 04:53:15.769898 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27288): Terminating (SIGTERM) 04:53:15.815225 --- ParallelTerminationStrategy: PID 27282 died... 04:53:15.847501 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27282): Terminated: ok {rc=0} 04:53:15.912268 --- ParallelTerminationStrategy: PID 27285 died... 04:53:15.934350 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27285): Terminated: ok {rc=0} 04:53:15.992456 --- ParallelTerminationStrategy: PID 27288 died... 04:53:16.012301 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27288): Terminated: ok {rc=0} 04:53:16.130914 bus /sierra_3: Setting Powered False 04:53:17.272611 bus /sierra_3: Setting Powered False 04:53:18.403968 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 handover_2G:nanobts+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 handover_2G:nanobts+bts1-sysmo --------------------------------------------------------------------- 04:53:19.671206 tst handover_2G:nanobts+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:53:19.676897 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x bts (candidates: 11) 04:53:19.722879 tst handover_2G:nanobts+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 04:53:19.751730 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x modem (candidates: 12) 04:53:19.803444 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x bts (candidates: 11) 04:53:19.846997 tst handover_2G:nanobts+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 04:53:19.877355 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x modem (candidates: 12) 04:53:20.425980 tst handover_2G:nanobts+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 handover_2G:nanobts+bts1-sysmo handover.py ---------------------------------------------- 04:53:20.432746 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:53:20.444502 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 04:53:20.485671 tst handover.py: using LAC 19197 04:53:20.605623 tst handover.py: using RAC 72 04:53:20.725236 tst handover.py: using CellId 19197 04:53:20.845190 tst handover.py: using BVCI 19198 04:53:20.956595 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 04:53:20.991865 tst handover.py: using LAC 19198 04:53:21.111865 tst handover.py: using RAC 73 04:53:21.231791 tst handover.py: using CellId 19198 04:53:21.352669 tst handover.py: using BVCI 19199 04:53:21.466694 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:53:21.478335 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:53:21.489903 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:53:21.502493 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:53:21.516287 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:53:21.529165 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 04:53:21.650200 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 04:53:21.770117 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:53:22.232827 run create_hlr_db(pid=27294): Launched 04:53:22.389539 bus /sierra_2: Setting Powered False 04:53:23.450365 run create_hlr_db(pid=27294): Terminated: ok {rc=0} 04:53:23.861278 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27296): Launched 04:53:24.176175 run osmo-hlr_10.42.42.2(pid=27298): Launched 04:53:24.289795 run osmo-stp_10.42.42.5: Starting osmo-stp 04:53:24.792761 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27300): Launched 04:53:25.089636 run osmo-stp_10.42.42.5(pid=27301): Launched 04:53:25.204307 run osmo-msc_10.42.42.6: Starting osmo-msc 04:53:25.716094 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27303): Launched 04:53:26.012770 run osmo-msc_10.42.42.6(pid=27304): Launched 04:53:26.181175 run osmo-stp_10.42.42.5(pid=27301): ERR: Terminated: ERROR {rc=1} [trial-2354↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27301)] 04:53:26.308939 run osmo-stp_10.42.42.5(pid=27301): stdout: | (launched: 2022-12-09_04:53:25.035751) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:53:26.436314 run osmo-stp_10.42.42.5(pid=27301): stderr: | 20221209045325204 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209045325204 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209045325204 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209045325205 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209045325205 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209045325206 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209045325206 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:53:26.560867 run osmo-stp_10.42.42.5(pid=27301): stdout: | (launched: 2022-12-09_04:53:25.035751) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:53:26.679332 run osmo-stp_10.42.42.5(pid=27301): stderr: | 20221209045325204 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209045325204 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209045325204 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209045325205 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209045325205 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209045325206 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209045325206 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:53:26.821440 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27301): Process ended prematurely: osmo-stp_10.42.42.5(pid=27301) [trial-2354↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27301)] [trial-2354↪handover_2G:nanobts+bts1-sysmo↪handover.py:18] 04:53:26.829637 tst handover.py:18: Test FAILED (6.4 sec) 04:53:26.856249 run osmo-hlr_10.42.42.2(pid=27298): ERR: Terminated: ERROR {rc=237} [trial-2354↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27298)] 04:53:26.903956 run osmo-hlr_10.42.42.2(pid=27298): stdout: | (launched: 2022-12-09_04:53:24.121659) 04:53:26.953534 run osmo-hlr_10.42.42.2(pid=27298): stderr: | 20221209045324296 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209045324296 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209045324297 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209045324297 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209045324297 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209045324297 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209045324313 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/handover_2G:nanobts+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209045324322 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209045324322 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209045324322 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:53:27.022600 run osmo-msc_10.42.42.6(pid=27304): ERR: Terminated: ERROR {rc=2} [trial-2354↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27304)] 04:53:27.070318 run osmo-msc_10.42.42.6(pid=27304): stdout: | (launched: 2022-12-09_04:53:25.958587) 04:53:27.119573 run osmo-msc_10.42.42.6(pid=27304): stderr: | 20221209045326228 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209045326229 DLGLOBAL DEBUG validating counter group 0x7f2534730c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209045326229 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209045326229 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209045326229 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209045326229 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209045326231 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209045326232 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209045326232 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209045326232 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:53:27.169476 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27296): Terminating (SIGTERM) 04:53:27.209246 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27300): Terminating (SIGTERM) 04:53:27.249648 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27303): Terminating (SIGTERM) 04:53:27.290003 --- ParallelTerminationStrategy: PID 27296 died... 04:53:27.309100 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27296): Terminated: ok {rc=0} 04:53:27.353388 --- ParallelTerminationStrategy: PID 27300 died... 04:53:27.371805 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27300): Terminated: ok {rc=0} 04:53:27.416095 --- ParallelTerminationStrategy: PID 27303 died... 04:53:27.434684 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27303): Terminated: ok {rc=0} 04:53:27.520627 bus /sierra_3: Setting Powered False 04:53:28.621095 bus /sierra_3: Setting Powered False 04:53:29.739089 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 handover_2G:nanobts+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 handover_2G:nanobts+bts1-trx-b200 --------------------------------------------------------------------- 04:53:30.992895 tst handover_2G:nanobts+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:53:30.999324 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 04:53:31.067016 tst handover_2G:nanobts+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 04:53:31.095898 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 04:53:31.153049 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 04:53:31.214630 tst handover_2G:nanobts+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 04:53:31.243679 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 04:53:31.800861 tst handover_2G:nanobts+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 handover_2G:nanobts+bts1-trx-b200 handover.py ---------------------------------------------- 04:53:31.807946 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:53:31.819961 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 04:53:31.858848 tst handover.py: using LAC 19199 04:53:31.993183 tst handover.py: using RAC 74 04:53:32.121768 tst handover.py: using CellId 19199 04:53:32.249263 tst handover.py: using BVCI 19200 04:53:32.386041 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 04:53:32.435396 tst handover.py: using LAC 19200 04:53:32.564757 tst handover.py: using RAC 75 04:53:32.690798 tst handover.py: using CellId 19200 04:53:32.815878 tst handover.py: using BVCI 19201 04:53:32.932671 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:53:32.943914 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:53:32.955104 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:53:32.966757 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:53:32.978308 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:53:32.989824 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 04:53:33.107807 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 04:53:33.223219 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:53:33.659827 run create_hlr_db(pid=27309): Launched 04:53:33.773629 bus /sierra_2: Setting Powered False 04:53:34.832612 run create_hlr_db(pid=27309): Terminated: ok {rc=0} 04:53:35.241029 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27311): Launched 04:53:35.560783 run osmo-hlr_10.42.42.2(pid=27312): Launched 04:53:35.684302 run osmo-stp_10.42.42.5: Starting osmo-stp 04:53:36.209069 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27314): Launched 04:53:36.527550 run osmo-stp_10.42.42.5(pid=27315): Launched 04:53:36.650527 run osmo-msc_10.42.42.6: Starting osmo-msc 04:53:37.201470 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27317): Launched 04:53:37.521110 run osmo-msc_10.42.42.6(pid=27318): Launched 04:53:37.701574 run osmo-stp_10.42.42.5(pid=27315): ERR: Terminated: ERROR {rc=1} [trial-2354↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27315)] 04:53:37.836474 run osmo-stp_10.42.42.5(pid=27315): stdout: | (launched: 2022-12-09_04:53:36.469514) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:53:37.972383 run osmo-stp_10.42.42.5(pid=27315): stderr: | 20221209045336661 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209045336661 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209045336661 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209045336662 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209045336662 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209045336662 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209045336663 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:53:38.107507 run osmo-stp_10.42.42.5(pid=27315): stdout: | (launched: 2022-12-09_04:53:36.469514) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:53:38.234622 run osmo-stp_10.42.42.5(pid=27315): stderr: | 20221209045336661 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209045336661 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209045336661 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209045336662 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209045336662 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209045336662 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209045336663 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:53:38.386742 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27315): Process ended prematurely: osmo-stp_10.42.42.5(pid=27315) [trial-2354↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27315)] [trial-2354↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18] 04:53:38.395508 tst handover.py:18: Test FAILED (6.6 sec) 04:53:38.422868 run osmo-hlr_10.42.42.2(pid=27312): ERR: Terminated: ERROR {rc=237} [trial-2354↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27312)] 04:53:38.473069 run osmo-hlr_10.42.42.2(pid=27312): stdout: | (launched: 2022-12-09_04:53:35.502932) 04:53:38.525344 run osmo-hlr_10.42.42.2(pid=27312): stderr: | 20221209045335702 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209045335702 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209045335702 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209045335702 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209045335702 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209045335702 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209045335715 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/handover_2G:nanobts+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209045335723 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209045335723 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209045335723 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:53:38.598229 run osmo-msc_10.42.42.6(pid=27318): ERR: Terminated: ERROR {rc=2} [trial-2354↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27318)] 04:53:38.648918 run osmo-msc_10.42.42.6(pid=27318): stdout: | (launched: 2022-12-09_04:53:37.462864) 04:53:38.700885 run osmo-msc_10.42.42.6(pid=27318): stderr: | 20221209045337787 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209045337787 DLGLOBAL DEBUG validating counter group 0x7f82ed33bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209045337787 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209045337787 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209045337787 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209045337787 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209045337789 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209045337790 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209045337790 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209045337790 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:53:38.753220 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27311): Terminating (SIGTERM) 04:53:38.795173 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27314): Terminating (SIGTERM) 04:53:38.837417 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27317): Terminating (SIGTERM) 04:53:38.879734 --- ParallelTerminationStrategy: PID 27311 died... 04:53:38.900081 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27311): Terminated: ok {rc=0} 04:53:38.946885 --- ParallelTerminationStrategy: PID 27314 died... 04:53:38.966510 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27314): Terminated: ok {rc=0} 04:53:39.012847 --- ParallelTerminationStrategy: PID 27317 died... 04:53:39.032903 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27317): Terminated: ok {rc=0} 04:53:39.121320 bus /sierra_3: Setting Powered False 04:53:40.222224 bus /sierra_3: Setting Powered False 04:53:41.339993 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 handover_2G:nanobts+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 handover_2G:nanobts+bts1-trx-umtrx --------------------------------------------------------------------- 04:53:42.595256 tst handover_2G:nanobts+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:53:42.601842 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 04:53:42.655645 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 04:53:42.682859 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 04:53:42.736000 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 04:53:42.790056 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 04:53:42.816803 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 04:53:43.366631 tst handover_2G:nanobts+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 handover_2G:nanobts+bts1-trx-umtrx handover.py ---------------------------------------------- 04:53:43.371881 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:53:43.383065 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 04:53:43.421144 tst handover.py: using LAC 19201 04:53:43.546244 tst handover.py: using RAC 76 04:53:43.674331 tst handover.py: using CellId 19201 04:53:43.792755 tst handover.py: using BVCI 19202 04:53:43.901204 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 04:53:43.948036 tst handover.py: using LAC 19202 04:53:44.066905 tst handover.py: using RAC 77 04:53:44.189512 tst handover.py: using CellId 19202 04:53:44.314843 tst handover.py: using BVCI 19203 04:53:44.431274 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:53:44.442569 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:53:44.453654 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:53:44.464643 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:53:44.475814 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:53:44.486894 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 04:53:44.606572 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 04:53:44.721872 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:53:45.158534 run create_hlr_db(pid=27323): Launched 04:53:45.272479 bus /sierra_2: Setting Powered False 04:53:46.336505 run create_hlr_db(pid=27323): Terminated: ok {rc=0} 04:53:46.755580 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27325): Launched 04:53:47.074745 run osmo-hlr_10.42.42.2(pid=27326): Launched 04:53:47.257615 run osmo-stp_10.42.42.5: Starting osmo-stp 04:53:47.781773 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27328): Launched 04:53:48.100096 run osmo-stp_10.42.42.5(pid=27329): Launched 04:53:48.221950 run osmo-msc_10.42.42.6: Starting osmo-msc 04:53:48.778134 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27331): Launched 04:53:49.098806 run osmo-msc_10.42.42.6(pid=27332): Launched 04:53:49.278386 run osmo-stp_10.42.42.5(pid=27329): ERR: Terminated: ERROR {rc=1} [trial-2354↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27329)] 04:53:49.414456 run osmo-stp_10.42.42.5(pid=27329): stdout: | (launched: 2022-12-09_04:53:48.042201) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:53:49.550944 run osmo-stp_10.42.42.5(pid=27329): stderr: | 20221209045348236 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209045348237 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209045348237 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209045348237 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209045348238 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209045348238 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209045348238 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:53:49.687332 run osmo-stp_10.42.42.5(pid=27329): stdout: | (launched: 2022-12-09_04:53:48.042201) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:53:49.814853 run osmo-stp_10.42.42.5(pid=27329): stderr: | 20221209045348236 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209045348237 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209045348237 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209045348237 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209045348238 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209045348238 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209045348238 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:53:49.967421 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27329): Process ended prematurely: osmo-stp_10.42.42.5(pid=27329) [trial-2354↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27329)] [trial-2354↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18] 04:53:49.976118 tst handover.py:18: Test FAILED (6.6 sec) 04:53:50.003467 run osmo-hlr_10.42.42.2(pid=27326): ERR: Terminated: ERROR {rc=237} [trial-2354↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27326)] 04:53:50.053781 run osmo-hlr_10.42.42.2(pid=27326): stdout: | (launched: 2022-12-09_04:53:47.007207) 04:53:50.106030 run osmo-hlr_10.42.42.2(pid=27326): stderr: | 20221209045347263 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209045347263 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209045347263 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209045347263 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209045347263 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209045347263 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209045347275 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/handover_2G:nanobts+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209045347284 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209045347284 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209045347285 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:53:50.178796 run osmo-msc_10.42.42.6(pid=27332): ERR: Terminated: ERROR {rc=2} [trial-2354↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27332)] 04:53:50.229203 run osmo-msc_10.42.42.6(pid=27332): stdout: | (launched: 2022-12-09_04:53:49.040461) 04:53:50.281220 run osmo-msc_10.42.42.6(pid=27332): stderr: | 20221209045349363 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209045349363 DLGLOBAL DEBUG validating counter group 0x7f4dbb524c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209045349364 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209045349364 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209045349364 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209045349364 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209045349366 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209045349366 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209045349366 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209045349366 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:53:50.333535 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27325): Terminating (SIGTERM) 04:53:50.375343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27328): Terminating (SIGTERM) 04:53:50.417172 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27331): Terminating (SIGTERM) 04:53:50.459363 --- ParallelTerminationStrategy: PID 27325 died... 04:53:50.479556 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27325): Terminated: ok {rc=0} 04:53:50.526143 --- ParallelTerminationStrategy: PID 27328 died... 04:53:50.545842 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27328): Terminated: ok {rc=0} 04:53:50.592040 --- ParallelTerminationStrategy: PID 27331 died... 04:53:50.611649 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27331): Terminated: ok {rc=0} 04:53:50.700687 bus /sierra_3: Setting Powered False 04:53:51.801787 bus /sierra_3: Setting Powered False 04:53:52.919091 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 handover_2G:nanobts+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 handover_2G:oc2g+bts1-octphy --------------------------------------------------------------------- 04:53:54.175479 tst handover_2G:oc2g+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:53:54.180425 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x bts (candidates: 11) 04:53:54.216631 tst handover_2G:oc2g+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 04:53:54.243596 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x modem (candidates: 12) 04:53:54.294780 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x bts (candidates: 11) 04:53:54.330489 tst handover_2G:oc2g+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 04:53:54.356586 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x modem (candidates: 12) 04:53:54.909144 tst handover_2G:oc2g+bts1-octphy: RESERVED RESOURCES for handover_2G: bts OC-2G OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 handover_2G:oc2g+bts1-octphy handover.py ---------------------------------------------- 04:53:54.914616 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 04:53:54.925832 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 04:53:54.960671 tst handover.py: using LAC 19203 04:53:55.086486 tst handover.py: using RAC 78 04:53:55.211760 tst handover.py: using CellId 19203 04:53:55.336738 tst handover.py: using BVCI 19204 04:53:55.452939 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 04:53:55.487665 tst handover.py: using LAC 19204 04:53:55.614603 tst handover.py: using RAC 79 04:53:55.741183 tst handover.py: using CellId 19204 04:53:55.869043 tst handover.py: using BVCI 19205 04:53:55.985603 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 04:53:55.997092 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 04:53:56.008036 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 04:53:56.018981 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 04:53:56.029935 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 04:53:56.040998 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 04:53:56.155208 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 04:53:56.271283 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:53:56.709554 run create_hlr_db(pid=27337): Launched 04:53:56.825668 bus /sierra_2: Setting Powered False 04:53:57.885177 run create_hlr_db(pid=27337): Terminated: ok {rc=0} 04:53:58.294480 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27339): Launched 04:53:58.614663 run osmo-hlr_10.42.42.2(pid=27340): Launched 04:53:58.737416 run osmo-stp_10.42.42.5: Starting osmo-stp 04:53:59.263134 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27342): Launched 04:53:59.582312 run osmo-stp_10.42.42.5(pid=27343): Launched 04:53:59.704781 run osmo-msc_10.42.42.6: Starting osmo-msc 04:54:00.255499 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27345): Launched 04:54:00.575259 run osmo-msc_10.42.42.6(pid=27346): Launched 04:54:00.754809 run osmo-stp_10.42.42.5(pid=27343): ERR: Terminated: ERROR {rc=1} [trial-2354↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27343)] 04:54:00.924210 run osmo-stp_10.42.42.5(pid=27343): stdout: | (launched: 2022-12-09_04:53:59.524138) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:54:01.111167 run osmo-stp_10.42.42.5(pid=27343): stderr: | 20221209045359718 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209045359718 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209045359718 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209045359719 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209045359719 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209045359719 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209045359719 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:54:01.273223 run osmo-stp_10.42.42.5(pid=27343): stdout: | (launched: 2022-12-09_04:53:59.524138) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:54:01.402424 run osmo-stp_10.42.42.5(pid=27343): stderr: | 20221209045359718 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209045359718 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209045359718 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209045359719 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209045359719 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209045359719 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209045359719 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:54:01.557106 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27343): Process ended prematurely: osmo-stp_10.42.42.5(pid=27343) [trial-2354↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27343)] [trial-2354↪handover_2G:oc2g+bts1-octphy↪handover.py:18] 04:54:01.566979 tst handover.py:18: Test FAILED (6.6 sec) 04:54:01.595955 run osmo-hlr_10.42.42.2(pid=27340): ERR: Terminated: ERROR {rc=237} [trial-2354↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27340)] 04:54:01.647301 run osmo-hlr_10.42.42.2(pid=27340): stdout: | (launched: 2022-12-09_04:53:58.556262) 04:54:01.699878 run osmo-hlr_10.42.42.2(pid=27340): stderr: | 20221209045358757 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209045358757 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209045358757 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209045358757 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209045358757 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209045358757 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209045358770 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/handover_2G:oc2g+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209045358779 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209045358780 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209045358780 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:54:01.774149 run osmo-msc_10.42.42.6(pid=27346): ERR: Terminated: ERROR {rc=2} [trial-2354↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27346)] 04:54:01.826194 run osmo-msc_10.42.42.6(pid=27346): stdout: | (launched: 2022-12-09_04:54:00.517266) 04:54:01.879176 run osmo-msc_10.42.42.6(pid=27346): stderr: | 20221209045400840 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209045400851 DLGLOBAL DEBUG validating counter group 0x7f7d3ed56c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209045400851 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209045400851 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209045400851 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209045400851 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209045400853 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209045400853 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209045400854 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209045400854 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:54:01.932839 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27339): Terminating (SIGTERM) 04:54:01.975619 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27342): Terminating (SIGTERM) 04:54:02.018583 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27345): Terminating (SIGTERM) 04:54:02.063043 --- ParallelTerminationStrategy: PID 27339 died... 04:54:02.083391 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27339): Terminated: ok {rc=0} 04:54:02.130793 --- ParallelTerminationStrategy: PID 27342 died... 04:54:02.151171 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27342): Terminated: ok {rc=0} 04:54:02.198224 --- ParallelTerminationStrategy: PID 27345 died... 04:54:02.218396 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27345): Terminated: ok {rc=0} 04:54:02.308056 bus /sierra_3: Setting Powered False 04:54:03.406666 bus /sierra_3: Setting Powered False 04:54:04.523388 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 handover_2G:oc2g+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 handover_2G:oc2g+bts1-trx-lms --------------------------------------------------------------------- 04:54:05.768094 tst handover_2G:oc2g+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:54:05.773960 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 04:54:05.824530 tst handover_2G:oc2g+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 04:54:05.851645 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 04:54:05.903464 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 04:54:05.954087 tst handover_2G:oc2g+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 04:54:05.980741 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 04:54:06.533384 tst handover_2G:oc2g+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OC-2G LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 handover_2G:oc2g+bts1-trx-lms handover.py ---------------------------------------------- 04:54:06.538640 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 04:54:06.549850 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 04:54:06.584641 tst handover.py: using LAC 19205 04:54:06.710702 tst handover.py: using RAC 80 04:54:06.838155 tst handover.py: using CellId 19205 04:54:06.964937 tst handover.py: using BVCI 19206 04:54:07.081076 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 04:54:07.129892 tst handover.py: using LAC 19206 04:54:07.264746 tst handover.py: using RAC 81 04:54:07.390282 tst handover.py: using CellId 19206 04:54:07.514505 tst handover.py: using BVCI 19207 04:54:07.630633 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 04:54:07.641866 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 04:54:07.653180 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 04:54:07.664052 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 04:54:07.675130 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 04:54:07.686380 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 04:54:07.801770 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 04:54:07.917173 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:54:08.354545 run create_hlr_db(pid=27351): Launched 04:54:08.469190 bus /sierra_2: Setting Powered False 04:54:09.534221 run create_hlr_db(pid=27351): Terminated: ok {rc=0} 04:54:09.952063 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27353): Launched 04:54:10.271471 run osmo-hlr_10.42.42.2(pid=27354): Launched 04:54:10.394216 run osmo-stp_10.42.42.5: Starting osmo-stp 04:54:10.919789 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27356): Launched 04:54:11.239556 run osmo-stp_10.42.42.5(pid=27357): Launched 04:54:11.362923 run osmo-msc_10.42.42.6: Starting osmo-msc 04:54:11.913650 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27359): Launched 04:54:12.232081 run osmo-msc_10.42.42.6(pid=27360): Launched 04:54:12.411211 run osmo-stp_10.42.42.5(pid=27357): ERR: Terminated: ERROR {rc=1} [trial-2354↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27357)] 04:54:12.546132 run osmo-stp_10.42.42.5(pid=27357): stdout: | (launched: 2022-12-09_04:54:11.181632) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:54:12.682483 run osmo-stp_10.42.42.5(pid=27357): stderr: | 20221209045411372 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209045411372 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209045411373 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209045411373 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209045411374 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209045411374 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209045411374 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:54:12.817417 run osmo-stp_10.42.42.5(pid=27357): stdout: | (launched: 2022-12-09_04:54:11.181632) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:54:12.944015 run osmo-stp_10.42.42.5(pid=27357): stderr: | 20221209045411372 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209045411372 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209045411373 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209045411373 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209045411374 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209045411374 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209045411374 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:54:13.095716 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27357): Process ended prematurely: osmo-stp_10.42.42.5(pid=27357) [trial-2354↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27357)] [trial-2354↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18] 04:54:13.104499 tst handover.py:18: Test FAILED (6.6 sec) 04:54:13.131878 run osmo-hlr_10.42.42.2(pid=27354): ERR: Terminated: ERROR {rc=237} [trial-2354↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27354)] 04:54:13.182240 run osmo-hlr_10.42.42.2(pid=27354): stdout: | (launched: 2022-12-09_04:54:10.213780) 04:54:13.234216 run osmo-hlr_10.42.42.2(pid=27354): stderr: | 20221209045410410 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209045410410 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209045410411 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209045410411 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209045410411 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209045410411 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209045410423 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/handover_2G:oc2g+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209045410431 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209045410432 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209045410432 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:54:13.306683 run osmo-msc_10.42.42.6(pid=27360): ERR: Terminated: ERROR {rc=2} [trial-2354↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27360)] 04:54:13.356704 run osmo-msc_10.42.42.6(pid=27360): stdout: | (launched: 2022-12-09_04:54:12.174365) 04:54:13.408395 run osmo-msc_10.42.42.6(pid=27360): stderr: | 20221209045412497 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209045412497 DLGLOBAL DEBUG validating counter group 0x7f1c809f9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209045412497 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209045412497 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209045412497 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209045412498 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209045412499 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209045412500 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209045412500 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209045412500 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:54:13.460392 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27353): Terminating (SIGTERM) 04:54:13.502024 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27356): Terminating (SIGTERM) 04:54:13.543549 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27359): Terminating (SIGTERM) 04:54:13.585526 --- ParallelTerminationStrategy: PID 27353 died... 04:54:13.605402 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27353): Terminated: ok {rc=0} 04:54:13.651766 --- ParallelTerminationStrategy: PID 27356 died... 04:54:13.671169 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27356): Terminated: ok {rc=0} 04:54:13.716899 --- ParallelTerminationStrategy: PID 27359 died... 04:54:13.736670 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27359): Terminated: ok {rc=0} 04:54:13.823609 bus /sierra_3: Setting Powered False 04:54:14.924524 bus /sierra_3: Setting Powered False 04:54:16.052631 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 handover_2G:oc2g+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 handover_2G:oc2g+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 04:54:17.318759 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:54:17.324126 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 04:54:17.370725 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 04:54:17.397622 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 04:54:17.450006 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 04:54:17.496744 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 04:54:17.523412 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 04:54:18.076076 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OC-2G LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 handover_2G:oc2g+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 04:54:18.081466 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:54:18.092691 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 04:54:18.127477 tst handover.py: using LAC 19207 04:54:18.252817 tst handover.py: using RAC 82 04:54:18.378147 tst handover.py: using CellId 19207 04:54:18.500455 tst handover.py: using BVCI 19208 04:54:18.613156 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 04:54:18.656531 tst handover.py: using LAC 19208 04:54:18.783268 tst handover.py: using RAC 83 04:54:18.910875 tst handover.py: using CellId 19208 04:54:19.033078 tst handover.py: using BVCI 19209 04:54:19.143655 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:54:19.154508 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:54:19.165267 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:54:19.176115 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:54:19.187140 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:54:19.198012 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 04:54:19.316619 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 04:54:19.432160 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:54:19.869986 run create_hlr_db(pid=27374): Launched 04:54:19.983547 bus /sierra_2: Setting Powered False 04:54:21.043590 run create_hlr_db(pid=27374): Terminated: ok {rc=0} 04:54:21.455421 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27376): Launched 04:54:21.777384 run osmo-hlr_10.42.42.2(pid=27377): Launched 04:54:21.900420 run osmo-stp_10.42.42.5: Starting osmo-stp 04:54:22.427915 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27379): Launched 04:54:22.748397 run osmo-stp_10.42.42.5(pid=27380): Launched 04:54:22.870887 run osmo-msc_10.42.42.6: Starting osmo-msc 04:54:23.423251 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27382): Launched 04:54:23.744131 run osmo-msc_10.42.42.6(pid=27383): Launched 04:54:23.922983 run osmo-stp_10.42.42.5(pid=27380): ERR: Terminated: ERROR {rc=1} [trial-2354↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27380)] 04:54:24.058088 run osmo-stp_10.42.42.5(pid=27380): stdout: | (launched: 2022-12-09_04:54:22.690259) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:54:24.194191 run osmo-stp_10.42.42.5(pid=27380): stderr: | 20221209045422884 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209045422884 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209045422884 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209045422884 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209045422885 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209045422885 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209045422885 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:54:24.329834 run osmo-stp_10.42.42.5(pid=27380): stdout: | (launched: 2022-12-09_04:54:22.690259) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:54:24.457081 run osmo-stp_10.42.42.5(pid=27380): stderr: | 20221209045422884 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209045422884 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209045422884 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209045422884 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209045422885 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209045422885 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209045422885 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:54:24.610352 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27380): Process ended prematurely: osmo-stp_10.42.42.5(pid=27380) [trial-2354↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27380)] [trial-2354↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18] 04:54:24.619029 tst handover.py:18: Test FAILED (6.5 sec) 04:54:24.646632 run osmo-hlr_10.42.42.2(pid=27377): ERR: Terminated: ERROR {rc=237} [trial-2354↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27377)] 04:54:24.697450 run osmo-hlr_10.42.42.2(pid=27377): stdout: | (launched: 2022-12-09_04:54:21.719134) 04:54:24.749640 run osmo-hlr_10.42.42.2(pid=27377): stderr: | 20221209045421917 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209045421917 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209045421917 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209045421917 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209045421918 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209045421918 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209045421930 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/handover_2G:oc2g+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209045421938 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209045421938 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209045421938 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:54:24.822247 run osmo-msc_10.42.42.6(pid=27383): ERR: Terminated: ERROR {rc=2} [trial-2354↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27383)] 04:54:24.872516 run osmo-msc_10.42.42.6(pid=27383): stdout: | (launched: 2022-12-09_04:54:23.685811) 04:54:24.924545 run osmo-msc_10.42.42.6(pid=27383): stderr: | 20221209045424010 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209045424010 DLGLOBAL DEBUG validating counter group 0x7fb86508ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209045424010 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209045424010 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209045424010 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209045424010 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209045424012 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209045424012 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209045424013 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209045424013 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:54:24.977041 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27376): Terminating (SIGTERM) 04:54:25.018825 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27379): Terminating (SIGTERM) 04:54:25.060643 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27382): Terminating (SIGTERM) 04:54:25.103366 --- ParallelTerminationStrategy: PID 27376 died... 04:54:25.123449 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27376): Terminated: ok {rc=0} 04:54:25.169763 --- ParallelTerminationStrategy: PID 27379 died... 04:54:25.189339 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27379): Terminated: ok {rc=0} 04:54:25.235688 --- ParallelTerminationStrategy: PID 27382 died... 04:54:25.255255 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27382): Terminated: ok {rc=0} 04:54:25.343857 bus /sierra_3: Setting Powered False 04:54:26.443401 bus /sierra_3: Setting Powered False 04:54:27.559774 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 handover_2G:oc2g+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 handover_2G:oc2g+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 04:54:28.816386 tst handover_2G:oc2g+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:54:28.821889 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 04:54:28.873256 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 04:54:28.900133 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 04:54:28.952632 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 04:54:29.003990 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 04:54:29.030786 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 04:54:29.583903 tst handover_2G:oc2g+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 handover_2G:oc2g+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 04:54:29.590260 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:54:29.602591 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 04:54:29.636521 tst handover.py: using LAC 19209 04:54:29.758466 tst handover.py: using RAC 84 04:54:29.876304 tst handover.py: using CellId 19209 04:54:29.991812 tst handover.py: using BVCI 19210 04:54:30.100175 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 04:54:30.152162 tst handover.py: using LAC 19210 04:54:30.278904 tst handover.py: using RAC 85 04:54:30.405856 tst handover.py: using CellId 19210 04:54:30.532075 tst handover.py: using BVCI 19211 04:54:30.642894 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:54:30.653997 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:54:30.664703 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:54:30.675784 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:54:30.687005 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:54:30.698167 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 04:54:30.815578 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 04:54:30.943842 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:54:31.441087 run create_hlr_db(pid=27388): Launched 04:54:31.597905 bus /sierra_2: Setting Powered False 04:54:32.662012 run create_hlr_db(pid=27388): Terminated: ok {rc=0} 04:54:33.063207 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27390): Launched 04:54:33.363435 run osmo-hlr_10.42.42.2(pid=27391): Launched 04:54:33.478442 run osmo-stp_10.42.42.5: Starting osmo-stp 04:54:33.978200 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27393): Launched 04:54:34.276262 run osmo-stp_10.42.42.5(pid=27394): Launched 04:54:34.391132 run osmo-msc_10.42.42.6: Starting osmo-msc 04:54:34.905999 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27396): Launched 04:54:35.205197 run osmo-msc_10.42.42.6(pid=27397): Launched 04:54:35.374113 run osmo-stp_10.42.42.5(pid=27394): ERR: Terminated: ERROR {rc=1} [trial-2354↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27394)] 04:54:35.502612 run osmo-stp_10.42.42.5(pid=27394): stdout: | (launched: 2022-12-09_04:54:34.222142) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:54:35.630471 run osmo-stp_10.42.42.5(pid=27394): stderr: | 20221209045434391 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209045434391 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209045434392 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209045434392 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209045434394 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209045434394 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209045434394 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:54:35.755618 run osmo-stp_10.42.42.5(pid=27394): stdout: | (launched: 2022-12-09_04:54:34.222142) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:54:35.874290 run osmo-stp_10.42.42.5(pid=27394): stderr: | 20221209045434391 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209045434391 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209045434392 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209045434392 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209045434394 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209045434394 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209045434394 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:54:36.016622 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27394): Process ended prematurely: osmo-stp_10.42.42.5(pid=27394) [trial-2354↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27394)] [trial-2354↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18] 04:54:36.024986 tst handover.py:18: Test FAILED (6.4 sec) 04:54:36.051726 run osmo-hlr_10.42.42.2(pid=27391): ERR: Terminated: ERROR {rc=237} [trial-2354↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27391)] 04:54:36.099956 run osmo-hlr_10.42.42.2(pid=27391): stdout: | (launched: 2022-12-09_04:54:33.308382) 04:54:36.150286 run osmo-hlr_10.42.42.2(pid=27391): stderr: | 20221209045433482 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209045433482 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209045433482 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209045433483 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209045433483 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209045433483 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209045433495 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/handover_2G:oc2g+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209045433505 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209045433505 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209045433505 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:54:36.219866 run osmo-msc_10.42.42.6(pid=27397): ERR: Terminated: ERROR {rc=2} [trial-2354↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27397)] 04:54:36.268226 run osmo-msc_10.42.42.6(pid=27397): stdout: | (launched: 2022-12-09_04:54:35.150635) 04:54:36.318177 run osmo-msc_10.42.42.6(pid=27397): stderr: | 20221209045435424 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209045435424 DLGLOBAL DEBUG validating counter group 0x7f6be2a73c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209045435424 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209045435424 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209045435425 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209045435425 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209045435427 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209045435427 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209045435427 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209045435427 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:54:36.368687 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27390): Terminating (SIGTERM) 04:54:36.408875 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27393): Terminating (SIGTERM) 04:54:36.449022 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27396): Terminating (SIGTERM) 04:54:36.489524 --- ParallelTerminationStrategy: PID 27390 died... 04:54:36.508718 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27390): Terminated: ok {rc=0} 04:54:36.553684 --- ParallelTerminationStrategy: PID 27393 died... 04:54:36.572411 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27393): Terminated: ok {rc=0} 04:54:36.617759 --- ParallelTerminationStrategy: PID 27396 died... 04:54:36.636618 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27396): Terminated: ok {rc=0} 04:54:36.724300 bus /sierra_3: Setting Powered False 04:54:37.825856 bus /sierra_3: Setting Powered False 04:54:38.943208 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 handover_2G:oc2g+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 handover_2G:oc2g+bts1-sysmo --------------------------------------------------------------------- 04:54:40.202174 tst handover_2G:oc2g+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:54:40.209165 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x bts (candidates: 11) 04:54:40.249018 tst handover_2G:oc2g+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 04:54:40.276187 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x modem (candidates: 12) 04:54:40.328584 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x bts (candidates: 11) 04:54:40.367274 tst handover_2G:oc2g+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 04:54:40.394089 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x modem (candidates: 12) 04:54:40.945039 tst handover_2G:oc2g+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 handover_2G:oc2g+bts1-sysmo handover.py ---------------------------------------------- 04:54:40.950368 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:54:40.961501 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 04:54:40.996382 tst handover.py: using LAC 19211 04:54:41.122443 tst handover.py: using RAC 86 04:54:41.249147 tst handover.py: using CellId 19211 04:54:41.376359 tst handover.py: using BVCI 19212 04:54:41.494746 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 04:54:41.529960 tst handover.py: using LAC 19212 04:54:41.656736 tst handover.py: using RAC 87 04:54:41.783123 tst handover.py: using CellId 19212 04:54:41.908557 tst handover.py: using BVCI 19213 04:54:42.024575 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:54:42.035635 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:54:42.046543 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:54:42.057536 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:54:42.068390 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:54:42.079353 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 04:54:42.193402 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 04:54:42.314456 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:54:42.751361 run create_hlr_db(pid=27402): Launched 04:54:42.865880 bus /sierra_2: Setting Powered False 04:54:43.925701 run create_hlr_db(pid=27402): Terminated: ok {rc=0} 04:54:44.317063 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27404): Launched 04:54:44.615131 run osmo-hlr_10.42.42.2(pid=27405): Launched 04:54:44.728732 run osmo-stp_10.42.42.5: Starting osmo-stp 04:54:45.233393 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27407): Launched 04:54:45.532808 run osmo-stp_10.42.42.5(pid=27408): Launched 04:54:45.647460 run osmo-msc_10.42.42.6: Starting osmo-msc 04:54:46.201764 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27410): Launched 04:54:46.528552 run osmo-msc_10.42.42.6(pid=27411): Launched 04:54:46.847927 run osmo-stp_10.42.42.5(pid=27408): ERR: Terminated: ERROR {rc=1} [trial-2354↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27408)] 04:54:46.996462 run osmo-stp_10.42.42.5(pid=27408): stdout: | (launched: 2022-12-09_04:54:45.478315) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:54:47.149365 run osmo-stp_10.42.42.5(pid=27408): stderr: | 20221209045445647 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209045445647 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209045445647 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209045445648 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209045445648 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209045445648 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209045445648 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:54:47.329884 run osmo-stp_10.42.42.5(pid=27408): stdout: | (launched: 2022-12-09_04:54:45.478315) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:54:47.449908 run osmo-stp_10.42.42.5(pid=27408): stderr: | 20221209045445647 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209045445647 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209045445647 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209045445648 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209045445648 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209045445648 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209045445648 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:54:47.592388 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27408): Process ended prematurely: osmo-stp_10.42.42.5(pid=27408) [trial-2354↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27408)] [trial-2354↪handover_2G:oc2g+bts1-sysmo↪handover.py:18] 04:54:47.600912 tst handover.py:18: Test FAILED (6.6 sec) 04:54:47.627894 run osmo-hlr_10.42.42.2(pid=27405): ERR: Terminated: ERROR {rc=237} [trial-2354↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27405)] 04:54:47.677292 run osmo-hlr_10.42.42.2(pid=27405): stdout: | (launched: 2022-12-09_04:54:44.560627) 04:54:47.728205 run osmo-hlr_10.42.42.2(pid=27405): stderr: | 20221209045444737 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209045444737 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209045444737 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209045444737 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209045444737 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209045444737 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209045444750 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/handover_2G:oc2g+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209045444759 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209045444759 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209045444759 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:54:47.798538 run osmo-msc_10.42.42.6(pid=27411): ERR: Terminated: ERROR {rc=2} [trial-2354↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27411)] 04:54:47.847132 run osmo-msc_10.42.42.6(pid=27411): stdout: | (launched: 2022-12-09_04:54:46.460124) 04:54:47.897244 run osmo-msc_10.42.42.6(pid=27411): stderr: | 20221209045447040 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209045447040 DLGLOBAL DEBUG validating counter group 0x7f00507a1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209045447040 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209045447040 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209045447050 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209045447051 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209045447052 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209045447058 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209045447058 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209045447058 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:54:47.947361 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27404): Terminating (SIGTERM) 04:54:47.987572 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27407): Terminating (SIGTERM) 04:54:48.027670 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27410): Terminating (SIGTERM) 04:54:48.067923 --- ParallelTerminationStrategy: PID 27404 died... 04:54:48.086632 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27404): Terminated: ok {rc=0} 04:54:48.131329 --- ParallelTerminationStrategy: PID 27407 died... 04:54:48.149963 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27407): Terminated: ok {rc=0} 04:54:48.194287 --- ParallelTerminationStrategy: PID 27410 died... 04:54:48.213017 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27410): Terminated: ok {rc=0} 04:54:48.297673 bus /sierra_3: Setting Powered False 04:54:49.396886 bus /sierra_3: Setting Powered False 04:54:50.515930 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 handover_2G:oc2g+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 handover_2G:oc2g+bts1-trx-b200 --------------------------------------------------------------------- 04:54:51.752803 tst handover_2G:oc2g+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:54:51.757767 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 04:54:51.807304 tst handover_2G:oc2g+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 04:54:51.833347 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 04:54:51.885993 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 04:54:51.935292 tst handover_2G:oc2g+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 04:54:51.961118 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 04:54:52.512633 tst handover_2G:oc2g+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OC-2G Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 handover_2G:oc2g+bts1-trx-b200 handover.py ---------------------------------------------- 04:54:52.518054 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:54:52.528647 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 04:54:52.562662 tst handover.py: using LAC 19213 04:54:52.679161 tst handover.py: using RAC 88 04:54:52.797638 tst handover.py: using CellId 19213 04:54:52.914546 tst handover.py: using BVCI 19214 04:54:53.022378 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 04:54:53.072747 tst handover.py: using LAC 19214 04:54:53.191443 tst handover.py: using RAC 89 04:54:53.306936 tst handover.py: using CellId 19214 04:54:53.422139 tst handover.py: using BVCI 19215 04:54:53.532365 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:54:53.543027 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:54:53.553611 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:54:53.564272 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:54:53.575040 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:54:53.585759 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 04:54:53.700820 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 04:54:53.818804 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:54:54.287380 run create_hlr_db(pid=27416): Launched 04:54:54.418376 bus /sierra_2: Setting Powered False 04:54:55.482155 run create_hlr_db(pid=27416): Terminated: ok {rc=0} 04:54:55.901976 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27418): Launched 04:54:56.222038 run osmo-hlr_10.42.42.2(pid=27419): Launched 04:54:56.344058 run osmo-stp_10.42.42.5: Starting osmo-stp 04:54:56.870786 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27421): Launched 04:54:57.191153 run osmo-stp_10.42.42.5(pid=27422): Launched 04:54:57.313845 run osmo-msc_10.42.42.6: Starting osmo-msc 04:54:57.866989 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27424): Launched 04:54:58.187129 run osmo-msc_10.42.42.6(pid=27425): Launched 04:54:58.366843 run osmo-stp_10.42.42.5(pid=27422): ERR: Terminated: ERROR {rc=1} [trial-2354↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27422)] 04:54:58.501614 run osmo-stp_10.42.42.5(pid=27422): stdout: | (launched: 2022-12-09_04:54:57.133077) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:54:58.637242 run osmo-stp_10.42.42.5(pid=27422): stderr: | 20221209045457324 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209045457324 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209045457325 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209045457325 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209045457327 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209045457327 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209045457327 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:54:58.772173 run osmo-stp_10.42.42.5(pid=27422): stdout: | (launched: 2022-12-09_04:54:57.133077) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:54:58.899497 run osmo-stp_10.42.42.5(pid=27422): stderr: | 20221209045457324 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209045457324 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209045457325 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209045457325 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209045457327 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209045457327 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209045457327 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:54:59.051943 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27422): Process ended prematurely: osmo-stp_10.42.42.5(pid=27422) [trial-2354↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27422)] [trial-2354↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18] 04:54:59.060723 tst handover.py:18: Test FAILED (6.5 sec) 04:54:59.088252 run osmo-hlr_10.42.42.2(pid=27419): ERR: Terminated: ERROR {rc=237} [trial-2354↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27419)] 04:54:59.138622 run osmo-hlr_10.42.42.2(pid=27419): stdout: | (launched: 2022-12-09_04:54:56.164069) 04:54:59.191005 run osmo-hlr_10.42.42.2(pid=27419): stderr: | 20221209045456364 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209045456364 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209045456364 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209045456364 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209045456364 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209045456364 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209045456377 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/handover_2G:oc2g+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209045456385 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209045456386 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209045456386 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:54:59.263690 run osmo-msc_10.42.42.6(pid=27425): ERR: Terminated: ERROR {rc=2} [trial-2354↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27425)] 04:54:59.314054 run osmo-msc_10.42.42.6(pid=27425): stdout: | (launched: 2022-12-09_04:54:58.128885) 04:54:59.366039 run osmo-msc_10.42.42.6(pid=27425): stderr: | 20221209045458451 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209045458451 DLGLOBAL DEBUG validating counter group 0x7f99f0d7cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209045458451 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209045458451 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209045458451 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209045458452 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209045458453 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209045458454 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209045458454 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209045458454 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:54:59.418433 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27418): Terminating (SIGTERM) 04:54:59.460295 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27421): Terminating (SIGTERM) 04:54:59.502361 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27424): Terminating (SIGTERM) 04:54:59.545089 --- ParallelTerminationStrategy: PID 27418 died... 04:54:59.565144 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27418): Terminated: ok {rc=0} 04:54:59.611364 --- ParallelTerminationStrategy: PID 27421 died... 04:54:59.630910 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27421): Terminated: ok {rc=0} 04:54:59.677451 --- ParallelTerminationStrategy: PID 27424 died... 04:54:59.696753 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27424): Terminated: ok {rc=0} 04:54:59.784073 bus /sierra_3: Setting Powered False 04:55:00.886126 bus /sierra_3: Setting Powered False 04:55:02.035978 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 handover_2G:oc2g+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 handover_2G:oc2g+bts1-trx-umtrx --------------------------------------------------------------------- 04:55:03.318877 tst handover_2G:oc2g+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:55:03.323870 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 04:55:03.373365 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 04:55:03.399570 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 04:55:03.451842 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 04:55:03.502423 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 04:55:03.529431 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 04:55:04.074904 tst handover_2G:oc2g+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OC-2G UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 handover_2G:oc2g+bts1-trx-umtrx handover.py ---------------------------------------------- 04:55:04.080343 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:55:04.091041 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 04:55:04.125509 tst handover.py: using LAC 19215 04:55:04.244687 tst handover.py: using RAC 90 04:55:04.361831 tst handover.py: using CellId 19215 04:55:04.479726 tst handover.py: using BVCI 19216 04:55:04.589578 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 04:55:04.637109 tst handover.py: using LAC 19216 04:55:04.753379 tst handover.py: using RAC 91 04:55:04.869625 tst handover.py: using CellId 19216 04:55:04.986154 tst handover.py: using BVCI 19217 04:55:05.093915 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:55:05.104618 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:55:05.115130 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:55:05.125913 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:55:05.136603 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:55:05.147358 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 04:55:05.266015 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 04:55:05.382615 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:55:05.819275 run create_hlr_db(pid=27440): Launched 04:55:05.932424 bus /sierra_2: Setting Powered False 04:55:06.991910 run create_hlr_db(pid=27440): Terminated: ok {rc=0} 04:55:07.401935 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27442): Launched 04:55:07.723893 run osmo-hlr_10.42.42.2(pid=27443): Launched 04:55:07.846494 run osmo-stp_10.42.42.5: Starting osmo-stp 04:55:08.369695 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27445): Launched 04:55:08.689715 run osmo-stp_10.42.42.5(pid=27446): Launched 04:55:08.812678 run osmo-msc_10.42.42.6: Starting osmo-msc 04:55:09.365395 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27448): Launched 04:55:09.686429 run osmo-msc_10.42.42.6(pid=27449): Launched 04:55:09.866868 run osmo-stp_10.42.42.5(pid=27446): ERR: Terminated: ERROR {rc=1} [trial-2354↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27446)] 04:55:10.002615 run osmo-stp_10.42.42.5(pid=27446): stdout: | (launched: 2022-12-09_04:55:08.631181) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:55:10.139326 run osmo-stp_10.42.42.5(pid=27446): stderr: | 20221209045508822 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209045508823 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209045508823 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209045508823 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209045508824 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209045508824 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209045508824 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:55:10.275109 run osmo-stp_10.42.42.5(pid=27446): stdout: | (launched: 2022-12-09_04:55:08.631181) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:55:10.402874 run osmo-stp_10.42.42.5(pid=27446): stderr: | 20221209045508822 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209045508823 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209045508823 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209045508823 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209045508824 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209045508824 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209045508824 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:55:10.555798 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27446): Process ended prematurely: osmo-stp_10.42.42.5(pid=27446) [trial-2354↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27446)] [trial-2354↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18] 04:55:10.564612 tst handover.py:18: Test FAILED (6.5 sec) 04:55:10.592276 run osmo-hlr_10.42.42.2(pid=27443): ERR: Terminated: ERROR {rc=237} [trial-2354↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27443)] 04:55:10.642987 run osmo-hlr_10.42.42.2(pid=27443): stdout: | (launched: 2022-12-09_04:55:07.665479) 04:55:10.695417 run osmo-hlr_10.42.42.2(pid=27443): stderr: | 20221209045507864 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209045507864 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209045507864 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209045507864 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209045507864 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209045507864 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209045507875 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/handover_2G:oc2g+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209045507884 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209045507884 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209045507884 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:55:10.768333 run osmo-msc_10.42.42.6(pid=27449): ERR: Terminated: ERROR {rc=2} [trial-2354↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27449)] 04:55:10.818652 run osmo-msc_10.42.42.6(pid=27449): stdout: | (launched: 2022-12-09_04:55:09.627576) 04:55:10.871043 run osmo-msc_10.42.42.6(pid=27449): stderr: | 20221209045509950 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209045509950 DLGLOBAL DEBUG validating counter group 0x7f336fe4ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209045509950 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209045509951 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209045509951 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209045509951 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209045509953 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209045509953 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209045509953 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209045509953 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:55:10.923427 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27442): Terminating (SIGTERM) 04:55:10.965524 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27445): Terminating (SIGTERM) 04:55:11.007725 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27448): Terminating (SIGTERM) 04:55:11.050144 --- ParallelTerminationStrategy: PID 27442 died... 04:55:11.070351 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27442): Terminated: ok {rc=0} 04:55:11.117143 --- ParallelTerminationStrategy: PID 27445 died... 04:55:11.136840 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27445): Terminated: ok {rc=0} 04:55:11.183361 --- ParallelTerminationStrategy: PID 27448 died... 04:55:11.203040 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27448): Terminated: ok {rc=0} 04:55:11.291954 bus /sierra_3: Setting Powered False 04:55:12.388492 bus /sierra_3: Setting Powered False 04:55:13.516002 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 handover_2G:oc2g+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 handover_2G:octphy+bts1-trx-lms --------------------------------------------------------------------- 04:55:14.775482 tst handover_2G:octphy+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:55:14.781299 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 04:55:14.830795 tst handover_2G:octphy+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 04:55:14.858027 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 04:55:14.911443 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 04:55:14.960785 tst handover_2G:octphy+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 04:55:14.987809 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 04:55:15.538088 tst handover_2G:octphy+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 handover_2G:octphy+bts1-trx-lms handover.py ---------------------------------------------- 04:55:15.543403 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 04:55:15.554600 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 04:55:15.588387 tst handover.py: using LAC 19217 04:55:15.718419 tst handover.py: using RAC 92 04:55:15.861536 tst handover.py: using CellId 19217 04:55:16.006907 tst handover.py: using BVCI 19218 04:55:16.128761 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 04:55:16.176881 tst handover.py: using LAC 19218 04:55:16.301745 tst handover.py: using RAC 93 04:55:16.429863 tst handover.py: using CellId 19218 04:55:16.555501 tst handover.py: using BVCI 19219 04:55:16.667877 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 04:55:16.679566 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 04:55:16.691193 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 04:55:16.706108 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 04:55:16.718781 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 04:55:16.730397 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 04:55:16.851909 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 04:55:16.974002 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:55:17.450321 run create_hlr_db(pid=27806): Launched 04:55:17.580587 bus /sierra_2: Setting Powered False 04:55:18.644676 run create_hlr_db(pid=27806): Terminated: ok {rc=0} 04:55:19.047574 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27808): Launched 04:55:19.346792 run osmo-hlr_10.42.42.2(pid=27809): Launched 04:55:19.461736 run osmo-stp_10.42.42.5: Starting osmo-stp 04:55:19.968137 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27811): Launched 04:55:20.267738 run osmo-stp_10.42.42.5(pid=27812): Launched 04:55:20.382548 run osmo-msc_10.42.42.6: Starting osmo-msc 04:55:20.900796 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27814): Launched 04:55:21.223224 run osmo-msc_10.42.42.6(pid=27815): Launched 04:55:21.403520 run osmo-stp_10.42.42.5(pid=27812): ERR: Terminated: ERROR {rc=1} [trial-2354↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27812)] 04:55:21.540230 run osmo-stp_10.42.42.5(pid=27812): stdout: | (launched: 2022-12-09_04:55:20.212862) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:55:21.677620 run osmo-stp_10.42.42.5(pid=27812): stderr: | 20221209045520382 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209045520382 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209045520383 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209045520383 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209045520384 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209045520384 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209045520384 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:55:21.813959 run osmo-stp_10.42.42.5(pid=27812): stdout: | (launched: 2022-12-09_04:55:20.212862) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:55:21.942265 run osmo-stp_10.42.42.5(pid=27812): stderr: | 20221209045520382 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209045520382 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209045520383 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209045520383 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209045520384 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209045520384 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209045520384 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:55:22.095186 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27812): Process ended prematurely: osmo-stp_10.42.42.5(pid=27812) [trial-2354↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27812)] [trial-2354↪handover_2G:octphy+bts1-trx-lms↪handover.py:18] 04:55:22.104255 tst handover.py:18: Test FAILED (6.6 sec) 04:55:22.132011 run osmo-hlr_10.42.42.2(pid=27809): ERR: Terminated: ERROR {rc=237} [trial-2354↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27809)] 04:55:22.182499 run osmo-hlr_10.42.42.2(pid=27809): stdout: | (launched: 2022-12-09_04:55:19.291914) 04:55:22.235167 run osmo-hlr_10.42.42.2(pid=27809): stderr: | 20221209045519465 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209045519465 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209045519465 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209045519465 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209045519465 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209045519465 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209045519477 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/handover_2G:octphy+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209045519485 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209045519485 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209045519485 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:55:22.308082 run osmo-msc_10.42.42.6(pid=27815): ERR: Terminated: ERROR {rc=2} [trial-2354↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27815)] 04:55:22.358349 run osmo-msc_10.42.42.6(pid=27815): stdout: | (launched: 2022-12-09_04:55:21.165156) 04:55:22.410376 run osmo-msc_10.42.42.6(pid=27815): stderr: | 20221209045521487 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209045521487 DLGLOBAL DEBUG validating counter group 0x7fbea6867c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209045521487 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209045521487 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209045521487 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209045521487 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209045521489 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209045521490 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209045521490 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209045521490 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:55:22.462545 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27808): Terminating (SIGTERM) 04:55:22.504528 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27811): Terminating (SIGTERM) 04:55:22.546524 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27814): Terminating (SIGTERM) 04:55:22.588684 --- ParallelTerminationStrategy: PID 27808 died... 04:55:22.608765 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27808): Terminated: ok {rc=0} 04:55:22.655457 --- ParallelTerminationStrategy: PID 27811 died... 04:55:22.675137 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27811): Terminated: ok {rc=0} 04:55:22.721632 --- ParallelTerminationStrategy: PID 27814 died... 04:55:22.741521 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27814): Terminated: ok {rc=0} 04:55:22.829927 bus /sierra_3: Setting Powered False 04:55:23.929652 bus /sierra_3: Setting Powered False 04:55:25.045579 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 handover_2G:octphy+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 handover_2G:octphy+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 04:55:26.304650 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:55:26.310762 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 04:55:26.356746 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 04:55:26.383731 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 04:55:26.435025 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 04:55:26.480234 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 04:55:26.507200 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 04:55:27.058768 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 handover_2G:octphy+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 04:55:27.064423 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:55:27.075664 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 04:55:27.109590 tst handover.py: using LAC 19219 04:55:27.228794 tst handover.py: using RAC 94 04:55:27.344879 tst handover.py: using CellId 19219 04:55:27.461707 tst handover.py: using BVCI 19220 04:55:27.579350 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 04:55:27.623017 tst handover.py: using LAC 19220 04:55:27.750235 tst handover.py: using RAC 95 04:55:27.876568 tst handover.py: using CellId 19220 04:55:28.000651 tst handover.py: using BVCI 19221 04:55:28.116926 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:55:28.128339 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:55:28.139513 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:55:28.150787 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:55:28.162000 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:55:28.173234 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 04:55:28.287418 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 04:55:28.407855 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:55:28.880470 run create_hlr_db(pid=27820): Launched 04:55:29.011165 bus /sierra_2: Setting Powered False 04:55:30.074643 run create_hlr_db(pid=27820): Terminated: ok {rc=0} 04:55:30.496287 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27822): Launched 04:55:30.817679 run osmo-hlr_10.42.42.2(pid=27823): Launched 04:55:31.009931 run osmo-stp_10.42.42.5: Starting osmo-stp 04:55:31.674281 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27825): Launched 04:55:32.011330 run osmo-stp_10.42.42.5(pid=27826): Launched 04:55:32.195704 run osmo-msc_10.42.42.6: Starting osmo-msc 04:55:32.793704 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27828): Launched 04:55:33.121704 run osmo-msc_10.42.42.6(pid=27854): Launched 04:55:33.404063 run osmo-stp_10.42.42.5(pid=27826): ERR: Terminated: ERROR {rc=1} [trial-2354↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27826)] 04:55:33.589255 run osmo-stp_10.42.42.5(pid=27826): stdout: | (launched: 2022-12-09_04:55:31.945723) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:55:33.808402 run osmo-stp_10.42.42.5(pid=27826): stderr: | 20221209045532216 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209045532216 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209045532217 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209045532217 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209045532218 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209045532218 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209045532218 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:55:34.002678 run osmo-stp_10.42.42.5(pid=27826): stdout: | (launched: 2022-12-09_04:55:31.945723) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:55:34.134173 run osmo-stp_10.42.42.5(pid=27826): stderr: | 20221209045532216 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209045532216 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209045532217 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209045532217 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209045532218 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209045532218 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209045532218 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:55:34.289666 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27826): Process ended prematurely: osmo-stp_10.42.42.5(pid=27826) [trial-2354↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27826)] [trial-2354↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18] 04:55:34.298948 tst handover.py:18: Test FAILED (7.2 sec) 04:55:34.327411 run osmo-hlr_10.42.42.2(pid=27823): ERR: Terminated: ERROR {rc=237} [trial-2354↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27823)] 04:55:34.379035 run osmo-hlr_10.42.42.2(pid=27823): stdout: | (launched: 2022-12-09_04:55:30.759665) 04:55:34.432193 run osmo-hlr_10.42.42.2(pid=27823): stderr: | 20221209045531079 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209045531079 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209045531079 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209045531079 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209045531079 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209045531079 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209045531091 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/handover_2G:octphy+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209045531108 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209045531108 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209045531108 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:55:34.506248 run osmo-msc_10.42.42.6(pid=27854): ERR: Terminated: ERROR {rc=2} [trial-2354↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27854)] 04:55:34.557706 run osmo-msc_10.42.42.6(pid=27854): stdout: | (launched: 2022-12-09_04:55:33.050724) 04:55:34.610774 run osmo-msc_10.42.42.6(pid=27854): stderr: | 20221209045533611 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209045533611 DLGLOBAL DEBUG validating counter group 0x7f389578cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209045533611 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209045533611 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209045533611 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209045533611 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209045533622 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209045533622 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209045533622 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209045533622 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:55:34.664221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27822): Terminating (SIGTERM) 04:55:34.708124 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27825): Terminating (SIGTERM) 04:55:34.753710 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27828): Terminating (SIGTERM) 04:55:34.798873 --- ParallelTerminationStrategy: PID 27822 died... 04:55:34.819206 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27822): Terminated: ok {rc=0} 04:55:34.868564 --- ParallelTerminationStrategy: PID 27825 died... 04:55:34.888932 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27825): Terminated: ok {rc=0} 04:55:34.936200 --- ParallelTerminationStrategy: PID 27828 died... 04:55:34.956542 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27828): Terminated: ok {rc=0} 04:55:35.046417 bus /sierra_3: Setting Powered False 04:55:36.147843 bus /sierra_3: Setting Powered False 04:55:37.267979 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 handover_2G:octphy+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 handover_2G:octphy+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 04:55:38.526076 tst handover_2G:octphy+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:55:38.532115 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 04:55:38.585960 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 04:55:38.614446 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 04:55:38.666116 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 04:55:38.716830 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 04:55:38.745408 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 04:55:39.296750 tst handover_2G:octphy+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 handover_2G:octphy+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 04:55:39.303165 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:55:39.314503 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 04:55:39.348361 tst handover.py: using LAC 19221 04:55:39.474283 tst handover.py: using RAC 96 04:55:39.601038 tst handover.py: using CellId 19221 04:55:39.726832 tst handover.py: using BVCI 19222 04:55:39.845179 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 04:55:39.895490 tst handover.py: using LAC 19222 04:55:40.022551 tst handover.py: using RAC 97 04:55:40.149229 tst handover.py: using CellId 19222 04:55:40.274599 tst handover.py: using BVCI 19223 04:55:40.392868 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:55:40.404184 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:55:40.415276 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:55:40.426457 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:55:40.437684 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:55:40.448837 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 04:55:40.562791 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 04:55:40.682992 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:55:41.154004 run create_hlr_db(pid=28012): Launched 04:55:41.283785 bus /sierra_2: Setting Powered False 04:55:42.348114 run create_hlr_db(pid=28012): Terminated: ok {rc=0} 04:55:42.768033 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28014): Launched 04:55:43.088275 run osmo-hlr_10.42.42.2(pid=28015): Launched 04:55:43.211841 run osmo-stp_10.42.42.5: Starting osmo-stp 04:55:43.742729 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28017): Launched 04:55:44.064136 run osmo-stp_10.42.42.5(pid=28018): Launched 04:55:44.187497 run osmo-msc_10.42.42.6: Starting osmo-msc 04:55:44.740721 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28020): Launched 04:55:45.061023 run osmo-msc_10.42.42.6(pid=28021): Launched 04:55:45.241359 run osmo-stp_10.42.42.5(pid=28018): ERR: Terminated: ERROR {rc=1} [trial-2354↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28018)] 04:55:45.377685 run osmo-stp_10.42.42.5(pid=28018): stdout: | (launched: 2022-12-09_04:55:44.005982) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:55:45.514097 run osmo-stp_10.42.42.5(pid=28018): stderr: | 20221209045544198 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209045544199 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209045544199 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209045544199 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209045544200 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209045544200 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209045544200 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:55:45.649321 run osmo-stp_10.42.42.5(pid=28018): stdout: | (launched: 2022-12-09_04:55:44.005982) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:55:45.777642 run osmo-stp_10.42.42.5(pid=28018): stderr: | 20221209045544198 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209045544199 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209045544199 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209045544199 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209045544200 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209045544200 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209045544200 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:55:45.932872 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=28018): Process ended prematurely: osmo-stp_10.42.42.5(pid=28018) [trial-2354↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28018)] [trial-2354↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18] 04:55:45.942343 tst handover.py:18: Test FAILED (6.6 sec) 04:55:45.970526 run osmo-hlr_10.42.42.2(pid=28015): ERR: Terminated: ERROR {rc=237} [trial-2354↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28015)] 04:55:46.021986 run osmo-hlr_10.42.42.2(pid=28015): stdout: | (launched: 2022-12-09_04:55:43.030152) 04:55:46.075049 run osmo-hlr_10.42.42.2(pid=28015): stderr: | 20221209045543230 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209045543230 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209045543230 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209045543230 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209045543230 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209045543230 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209045543243 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/handover_2G:octphy+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209045543251 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209045543251 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209045543251 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:55:46.149147 run osmo-msc_10.42.42.6(pid=28021): ERR: Terminated: ERROR {rc=2} [trial-2354↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28021)] 04:55:46.200260 run osmo-msc_10.42.42.6(pid=28021): stdout: | (launched: 2022-12-09_04:55:45.002752) 04:55:46.254037 run osmo-msc_10.42.42.6(pid=28021): stderr: | 20221209045545327 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209045545327 DLGLOBAL DEBUG validating counter group 0x7f2a5f674c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209045545327 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209045545327 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209045545327 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209045545327 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209045545329 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209045545329 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209045545330 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209045545330 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:55:46.320939 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28014): Terminating (SIGTERM) 04:55:46.372903 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28017): Terminating (SIGTERM) 04:55:46.427207 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28020): Terminating (SIGTERM) 04:55:46.483635 --- ParallelTerminationStrategy: PID 28014 died... 04:55:46.510104 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28014): Terminated: ok {rc=0} 04:55:46.566682 --- ParallelTerminationStrategy: PID 28017 died... 04:55:46.591241 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28017): Terminated: ok {rc=0} 04:55:46.647808 --- ParallelTerminationStrategy: PID 28020 died... 04:55:46.673126 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28020): Terminated: ok {rc=0} 04:55:46.780006 bus /sierra_3: Setting Powered False 04:55:47.883417 bus /sierra_3: Setting Powered False 04:55:49.001890 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 handover_2G:octphy+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 handover_2G:octphy+bts1-sysmo --------------------------------------------------------------------- 04:55:50.265434 tst handover_2G:octphy+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:55:50.271268 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x bts (candidates: 11) 04:55:50.310333 tst handover_2G:octphy+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 04:55:50.337979 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x modem (candidates: 12) 04:55:50.390716 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x bts (candidates: 11) 04:55:50.427971 tst handover_2G:octphy+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 04:55:50.455197 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x modem (candidates: 12) 04:55:51.005825 tst handover_2G:octphy+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 handover_2G:octphy+bts1-sysmo handover.py ---------------------------------------------- 04:55:51.013121 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:55:51.024139 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 04:55:51.062978 tst handover.py: using LAC 19223 04:55:51.188551 tst handover.py: using RAC 98 04:55:51.312745 tst handover.py: using CellId 19223 04:55:51.436558 tst handover.py: using BVCI 19224 04:55:51.553362 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 04:55:51.590728 tst handover.py: using LAC 19224 04:55:51.711770 tst handover.py: using RAC 99 04:55:51.832716 tst handover.py: using CellId 19224 04:55:51.950447 tst handover.py: using BVCI 19225 04:55:52.059345 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:55:52.069997 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:55:52.080578 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:55:52.091397 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:55:52.102194 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:55:52.112843 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 04:55:52.230743 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 04:55:52.345929 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:55:52.784900 run create_hlr_db(pid=28026): Launched 04:55:52.899434 bus /sierra_2: Setting Powered False 04:55:53.959329 run create_hlr_db(pid=28026): Terminated: ok {rc=0} 04:55:54.370792 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28028): Launched 04:55:54.692021 run osmo-hlr_10.42.42.2(pid=28029): Launched 04:55:54.815448 run osmo-stp_10.42.42.5: Starting osmo-stp 04:55:55.343763 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28031): Launched 04:55:55.663996 run osmo-stp_10.42.42.5(pid=28032): Launched 04:55:55.787529 run osmo-msc_10.42.42.6: Starting osmo-msc 04:55:56.339229 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28034): Launched 04:55:56.659821 run osmo-msc_10.42.42.6(pid=28035): Launched 04:55:56.840813 run osmo-stp_10.42.42.5(pid=28032): ERR: Terminated: ERROR {rc=1} [trial-2354↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28032)] 04:55:56.976407 run osmo-stp_10.42.42.5(pid=28032): stdout: | (launched: 2022-12-09_04:55:55.605805) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:55:57.112783 run osmo-stp_10.42.42.5(pid=28032): stderr: | 20221209045555799 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209045555799 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209045555799 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209045555800 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209045555800 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209045555801 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209045555801 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:55:57.248017 run osmo-stp_10.42.42.5(pid=28032): stdout: | (launched: 2022-12-09_04:55:55.605805) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:55:57.375254 run osmo-stp_10.42.42.5(pid=28032): stderr: | 20221209045555799 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209045555799 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209045555799 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209045555800 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209045555800 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209045555801 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209045555801 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:55:57.527951 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=28032): Process ended prematurely: osmo-stp_10.42.42.5(pid=28032) [trial-2354↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28032)] [trial-2354↪handover_2G:octphy+bts1-sysmo↪handover.py:18] 04:55:57.536743 tst handover.py:18: Test FAILED (6.5 sec) 04:55:57.564389 run osmo-hlr_10.42.42.2(pid=28029): ERR: Terminated: ERROR {rc=237} [trial-2354↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28029)] 04:55:57.614931 run osmo-hlr_10.42.42.2(pid=28029): stdout: | (launched: 2022-12-09_04:55:54.633964) 04:55:57.667400 run osmo-hlr_10.42.42.2(pid=28029): stderr: | 20221209045554834 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209045554834 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209045554834 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209045554834 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209045554834 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209045554834 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209045554846 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/handover_2G:octphy+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209045554854 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209045554854 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209045554854 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:55:57.740911 run osmo-msc_10.42.42.6(pid=28035): ERR: Terminated: ERROR {rc=2} [trial-2354↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28035)] 04:55:57.791662 run osmo-msc_10.42.42.6(pid=28035): stdout: | (launched: 2022-12-09_04:55:56.601782) 04:55:57.843978 run osmo-msc_10.42.42.6(pid=28035): stderr: | 20221209045556924 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209045556924 DLGLOBAL DEBUG validating counter group 0x7f03a4354c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209045556924 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209045556924 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209045556925 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209045556925 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209045556926 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209045556927 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209045556927 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209045556927 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:55:57.896529 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28028): Terminating (SIGTERM) 04:55:57.938752 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28031): Terminating (SIGTERM) 04:55:57.981027 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28034): Terminating (SIGTERM) 04:55:58.023808 --- ParallelTerminationStrategy: PID 28028 died... 04:55:58.043945 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28028): Terminated: ok {rc=0} 04:55:58.090600 --- ParallelTerminationStrategy: PID 28031 died... 04:55:58.110265 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28031): Terminated: ok {rc=0} 04:55:58.156676 --- ParallelTerminationStrategy: PID 28034 died... 04:55:58.176395 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28034): Terminated: ok {rc=0} 04:55:58.264439 bus /sierra_3: Setting Powered False 04:55:59.363639 bus /sierra_3: Setting Powered False 04:56:00.480016 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 handover_2G:octphy+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 handover_2G:octphy+bts1-trx-b200 --------------------------------------------------------------------- 04:56:01.759836 tst handover_2G:octphy+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:56:01.769639 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 04:56:01.832647 tst handover_2G:octphy+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 04:56:01.864433 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 04:56:01.930558 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 04:56:01.997851 tst handover_2G:octphy+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 04:56:02.033566 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 04:56:02.556646 tst handover_2G:octphy+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 handover_2G:octphy+bts1-trx-b200 handover.py ---------------------------------------------- 04:56:02.561968 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:56:02.573075 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 04:56:02.610380 tst handover.py: using LAC 19225 04:56:02.735671 tst handover.py: using RAC 100 04:56:02.859596 tst handover.py: using CellId 19225 04:56:02.977580 tst handover.py: using BVCI 19226 04:56:03.095815 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 04:56:03.143865 tst handover.py: using LAC 19226 04:56:03.269733 tst handover.py: using RAC 101 04:56:03.388925 tst handover.py: using CellId 19226 04:56:03.505392 tst handover.py: using BVCI 19227 04:56:03.614751 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:56:03.625617 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:56:03.636260 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:56:03.647716 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:56:03.659223 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:56:03.670420 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 04:56:03.788317 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 04:56:03.907944 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:56:04.378990 run create_hlr_db(pid=28040): Launched 04:56:04.509436 bus /sierra_2: Setting Powered False 04:56:05.572654 run create_hlr_db(pid=28040): Terminated: ok {rc=0} 04:56:05.976803 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28042): Launched 04:56:06.276882 run osmo-hlr_10.42.42.2(pid=28043): Launched 04:56:06.393695 run osmo-stp_10.42.42.5: Starting osmo-stp 04:56:06.895214 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28045): Launched 04:56:07.193632 run osmo-stp_10.42.42.5(pid=28046): Launched 04:56:07.307954 run osmo-msc_10.42.42.6: Starting osmo-msc 04:56:07.822463 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28048): Launched 04:56:08.121208 run osmo-msc_10.42.42.6(pid=28049): Launched 04:56:08.289410 run osmo-stp_10.42.42.5(pid=28046): ERR: Terminated: ERROR {rc=1} [trial-2354↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28046)] 04:56:08.417176 run osmo-stp_10.42.42.5(pid=28046): stdout: | (launched: 2022-12-09_04:56:07.139305) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:56:08.544214 run osmo-stp_10.42.42.5(pid=28046): stderr: | 20221209045607309 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209045607309 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209045607309 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209045607310 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209045607310 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209045607310 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209045607310 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:56:08.669223 run osmo-stp_10.42.42.5(pid=28046): stdout: | (launched: 2022-12-09_04:56:07.139305) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:56:08.787943 run osmo-stp_10.42.42.5(pid=28046): stderr: | 20221209045607309 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209045607309 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209045607309 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209045607310 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209045607310 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209045607310 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209045607310 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:56:08.930173 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=28046): Process ended prematurely: osmo-stp_10.42.42.5(pid=28046) [trial-2354↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28046)] [trial-2354↪handover_2G:octphy+bts1-trx-b200↪handover.py:18] 04:56:08.938557 tst handover.py:18: Test FAILED (6.4 sec) 04:56:08.965928 run osmo-hlr_10.42.42.2(pid=28043): ERR: Terminated: ERROR {rc=237} [trial-2354↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28043)] 04:56:09.014863 run osmo-hlr_10.42.42.2(pid=28043): stdout: | (launched: 2022-12-09_04:56:06.222200) 04:56:09.064839 run osmo-hlr_10.42.42.2(pid=28043): stderr: | 20221209045606398 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209045606398 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209045606398 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209045606398 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209045606398 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209045606398 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209045606410 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/handover_2G:octphy+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209045606419 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209045606419 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209045606419 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:56:09.134773 run osmo-msc_10.42.42.6(pid=28049): ERR: Terminated: ERROR {rc=2} [trial-2354↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28049)] 04:56:09.182923 run osmo-msc_10.42.42.6(pid=28049): stdout: | (launched: 2022-12-09_04:56:08.065644) 04:56:09.232663 run osmo-msc_10.42.42.6(pid=28049): stderr: | 20221209045608337 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209045608338 DLGLOBAL DEBUG validating counter group 0x7f98f94afc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209045608338 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209045608338 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209045608338 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209045608338 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209045608342 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209045608342 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209045608343 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209045608343 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:56:09.282948 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28042): Terminating (SIGTERM) 04:56:09.322875 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28045): Terminating (SIGTERM) 04:56:09.362899 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28048): Terminating (SIGTERM) 04:56:09.403108 --- ParallelTerminationStrategy: PID 28042 died... 04:56:09.421852 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28042): Terminated: ok {rc=0} 04:56:09.466509 --- ParallelTerminationStrategy: PID 28045 died... 04:56:09.485244 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28045): Terminated: ok {rc=0} 04:56:09.530126 --- ParallelTerminationStrategy: PID 28048 died... 04:56:09.548705 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28048): Terminated: ok {rc=0} 04:56:09.633331 bus /sierra_3: Setting Powered False 04:56:10.732544 bus /sierra_3: Setting Powered False 04:56:11.851610 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 handover_2G:octphy+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 handover_2G:octphy+bts1-trx-umtrx --------------------------------------------------------------------- 04:56:13.107142 tst handover_2G:octphy+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:56:13.113101 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 04:56:13.162046 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 04:56:13.188867 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 04:56:13.240432 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 04:56:13.288812 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 04:56:13.315443 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 04:56:13.865261 tst handover_2G:octphy+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 handover_2G:octphy+bts1-trx-umtrx handover.py ---------------------------------------------- 04:56:13.870657 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:56:13.881633 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 04:56:13.916226 tst handover.py: using LAC 19227 04:56:14.033563 tst handover.py: using RAC 102 04:56:14.149614 tst handover.py: using CellId 19227 04:56:14.278816 tst handover.py: using BVCI 19228 04:56:14.397734 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 04:56:14.447965 tst handover.py: using LAC 19228 04:56:14.574826 tst handover.py: using RAC 103 04:56:14.701306 tst handover.py: using CellId 19228 04:56:14.819550 tst handover.py: using BVCI 19229 04:56:14.928493 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:56:14.939195 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:56:14.949829 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:56:14.960562 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:56:14.971472 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:56:14.982233 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 04:56:15.099618 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 04:56:15.222719 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:56:15.692556 run create_hlr_db(pid=28054): Launched 04:56:15.823855 bus /sierra_2: Setting Powered False 04:56:16.887810 run create_hlr_db(pid=28054): Terminated: ok {rc=0} 04:56:17.299364 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28056): Launched 04:56:17.626762 run osmo-hlr_10.42.42.2(pid=28057): Launched 04:56:17.750544 run osmo-stp_10.42.42.5: Starting osmo-stp 04:56:18.278686 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28059): Launched 04:56:18.599466 run osmo-stp_10.42.42.5(pid=28060): Launched 04:56:18.722787 run osmo-msc_10.42.42.6: Starting osmo-msc 04:56:19.274912 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28062): Launched 04:56:19.596527 run osmo-msc_10.42.42.6(pid=28063): Launched 04:56:19.777402 run osmo-stp_10.42.42.5(pid=28060): ERR: Terminated: ERROR {rc=1} [trial-2354↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28060)] 04:56:19.913490 run osmo-stp_10.42.42.5(pid=28060): stdout: | (launched: 2022-12-09_04:56:18.541360) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:56:20.050021 run osmo-stp_10.42.42.5(pid=28060): stderr: | 20221209045618734 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209045618734 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209045618735 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209045618735 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209045618735 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209045618735 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209045618736 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:56:20.185934 run osmo-stp_10.42.42.5(pid=28060): stdout: | (launched: 2022-12-09_04:56:18.541360) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:56:20.314088 run osmo-stp_10.42.42.5(pid=28060): stderr: | 20221209045618734 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209045618734 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209045618735 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209045618735 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209045618735 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209045618735 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209045618736 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:56:20.467315 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=28060): Process ended prematurely: osmo-stp_10.42.42.5(pid=28060) [trial-2354↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28060)] [trial-2354↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18] 04:56:20.476179 tst handover.py:18: Test FAILED (6.6 sec) 04:56:20.503901 run osmo-hlr_10.42.42.2(pid=28057): ERR: Terminated: ERROR {rc=237} [trial-2354↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28057)] 04:56:20.554154 run osmo-hlr_10.42.42.2(pid=28057): stdout: | (launched: 2022-12-09_04:56:17.568141) 04:56:20.606187 run osmo-hlr_10.42.42.2(pid=28057): stderr: | 20221209045617765 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209045617765 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209045617765 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209045617765 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209045617766 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209045617766 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209045617778 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/handover_2G:octphy+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209045617788 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209045617788 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209045617788 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:56:20.678832 run osmo-msc_10.42.42.6(pid=28063): ERR: Terminated: ERROR {rc=2} [trial-2354↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28063)] 04:56:20.729381 run osmo-msc_10.42.42.6(pid=28063): stdout: | (launched: 2022-12-09_04:56:19.538243) 04:56:20.781463 run osmo-msc_10.42.42.6(pid=28063): stderr: | 20221209045619862 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209045619863 DLGLOBAL DEBUG validating counter group 0x7fbb0b775c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209045619863 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209045619863 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209045619863 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209045619863 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209045619865 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209045619865 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209045619865 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209045619865 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:56:20.833596 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28056): Terminating (SIGTERM) 04:56:20.875507 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28059): Terminating (SIGTERM) 04:56:20.917377 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28062): Terminating (SIGTERM) 04:56:20.959503 --- ParallelTerminationStrategy: PID 28056 died... 04:56:20.979575 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28056): Terminated: ok {rc=0} 04:56:21.026144 --- ParallelTerminationStrategy: PID 28059 died... 04:56:21.045766 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28059): Terminated: ok {rc=0} 04:56:21.092171 --- ParallelTerminationStrategy: PID 28062 died... 04:56:21.111854 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28062): Terminated: ok {rc=0} 04:56:21.199966 bus /sierra_3: Setting Powered False 04:56:22.299629 bus /sierra_3: Setting Powered False 04:56:23.416260 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 handover_2G:octphy+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 handover_2G:trx-lms+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 04:56:24.672753 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:56:24.678690 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 04:56:24.738320 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 04:56:24.765467 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 04:56:24.819247 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 04:56:24.879261 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 04:56:24.906082 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 04:56:25.457987 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 04:56:25.464433 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:56:25.476330 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 04:56:25.525864 tst handover.py: using LAC 19229 04:56:25.646910 tst handover.py: using RAC 104 04:56:25.765808 tst handover.py: using CellId 19229 04:56:25.882793 tst handover.py: using BVCI 19230 04:56:25.993060 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 04:56:26.037150 tst handover.py: using LAC 19230 04:56:26.156298 tst handover.py: using RAC 105 04:56:26.273991 tst handover.py: using CellId 19230 04:56:26.392096 tst handover.py: using BVCI 19231 04:56:26.500394 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:56:26.511720 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:56:26.522619 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:56:26.533859 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:56:26.544852 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:56:26.555871 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 04:56:26.674564 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 04:56:26.793964 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:56:27.264555 run create_hlr_db(pid=28068): Launched 04:56:27.395391 bus /sierra_2: Setting Powered False 04:56:28.458584 run create_hlr_db(pid=28068): Terminated: ok {rc=0} 04:56:28.879510 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28070): Launched 04:56:29.200825 run osmo-hlr_10.42.42.2(pid=28071): Launched 04:56:29.324061 run osmo-stp_10.42.42.5: Starting osmo-stp 04:56:29.847951 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28073): Launched 04:56:30.167715 run osmo-stp_10.42.42.5(pid=28074): Launched 04:56:30.291024 run osmo-msc_10.42.42.6: Starting osmo-msc 04:56:30.851186 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28076): Launched 04:56:31.206293 run osmo-msc_10.42.42.6(pid=28077): Launched 04:56:31.427455 run osmo-stp_10.42.42.5(pid=28074): ERR: Terminated: ERROR {rc=1} [trial-2354↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28074)] 04:56:31.560357 run osmo-stp_10.42.42.5(pid=28074): stdout: | (launched: 2022-12-09_04:56:30.109673) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:56:31.715895 run osmo-stp_10.42.42.5(pid=28074): stderr: | 20221209045630303 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209045630304 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209045630304 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209045630304 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209045630306 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209045630307 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209045630307 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:56:31.978018 run osmo-stp_10.42.42.5(pid=28074): stdout: | (launched: 2022-12-09_04:56:30.109673) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:56:32.180392 run osmo-stp_10.42.42.5(pid=28074): stderr: | 20221209045630303 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209045630304 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209045630304 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209045630304 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209045630306 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209045630307 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209045630307 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:56:32.338582 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=28074): Process ended prematurely: osmo-stp_10.42.42.5(pid=28074) [trial-2354↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28074)] [trial-2354↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18] 04:56:32.348059 tst handover.py:18: Test FAILED (6.9 sec) 04:56:32.376676 run osmo-hlr_10.42.42.2(pid=28071): ERR: Terminated: ERROR {rc=237} [trial-2354↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28071)] 04:56:32.428809 run osmo-hlr_10.42.42.2(pid=28071): stdout: | (launched: 2022-12-09_04:56:29.142624) 04:56:32.483171 run osmo-hlr_10.42.42.2(pid=28071): stderr: | 20221209045629341 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209045629341 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209045629341 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209045629341 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209045629341 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209045629341 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209045629396 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/handover_2G:trx-lms+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209045629406 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209045629406 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209045629406 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:56:32.558766 run osmo-msc_10.42.42.6(pid=28077): ERR: Terminated: ERROR {rc=2} [trial-2354↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28077)] 04:56:32.609856 run osmo-msc_10.42.42.6(pid=28077): stdout: | (launched: 2022-12-09_04:56:31.137703) 04:56:32.661966 run osmo-msc_10.42.42.6(pid=28077): stderr: | 20221209045631761 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209045631762 DLGLOBAL DEBUG validating counter group 0x7ff70752fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209045631762 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209045631762 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209045631762 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209045631762 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209045631764 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209045631764 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209045631764 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209045631764 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:56:32.714795 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28070): Terminating (SIGTERM) 04:56:32.757037 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28073): Terminating (SIGTERM) 04:56:32.799461 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28076): Terminating (SIGTERM) 04:56:32.842109 --- ParallelTerminationStrategy: PID 28070 died... 04:56:32.862050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28070): Terminated: ok {rc=0} 04:56:32.908668 --- ParallelTerminationStrategy: PID 28073 died... 04:56:32.928387 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28073): Terminated: ok {rc=0} 04:56:32.975091 --- ParallelTerminationStrategy: PID 28076 died... 04:56:32.994712 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28076): Terminated: ok {rc=0} 04:56:33.083152 bus /sierra_3: Setting Powered False 04:56:34.183187 bus /sierra_3: Setting Powered False 04:56:35.299592 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 handover_2G:trx-lms+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 handover_2G:trx-lms+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 04:56:36.568565 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:56:36.574053 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 04:56:36.638297 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 04:56:36.665500 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 04:56:36.719976 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 04:56:36.784792 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 04:56:36.811843 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 04:56:37.362602 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 handover_2G:trx-lms+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 04:56:37.368053 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:56:37.379307 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 04:56:37.427416 tst handover.py: using LAC 19231 04:56:37.554845 tst handover.py: using RAC 106 04:56:37.691666 tst handover.py: using CellId 19231 04:56:37.816847 tst handover.py: using BVCI 19232 04:56:37.927233 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 04:56:37.974433 tst handover.py: using LAC 19232 04:56:38.093286 tst handover.py: using RAC 107 04:56:38.213095 tst handover.py: using CellId 19232 04:56:38.330260 tst handover.py: using BVCI 19233 04:56:38.441247 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:56:38.452260 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:56:38.463240 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:56:38.474833 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:56:38.486058 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:56:38.497390 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 04:56:38.617371 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 04:56:38.738454 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:56:39.209037 run create_hlr_db(pid=28082): Launched 04:56:39.339847 bus /sierra_2: Setting Powered False 04:56:40.403315 run create_hlr_db(pid=28082): Terminated: ok {rc=0} 04:56:40.822620 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28084): Launched 04:56:41.143176 run osmo-hlr_10.42.42.2(pid=28085): Launched 04:56:41.266210 run osmo-stp_10.42.42.5: Starting osmo-stp 04:56:41.795406 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28087): Launched 04:56:42.115570 run osmo-stp_10.42.42.5(pid=28088): Launched 04:56:42.238715 run osmo-msc_10.42.42.6: Starting osmo-msc 04:56:42.792241 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28090): Launched 04:56:43.115312 run osmo-msc_10.42.42.6(pid=28091): Launched 04:56:43.295772 run osmo-stp_10.42.42.5(pid=28088): ERR: Terminated: ERROR {rc=1} [trial-2354↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28088)] 04:56:43.431673 run osmo-stp_10.42.42.5(pid=28088): stdout: | (launched: 2022-12-09_04:56:42.057500) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:56:43.568139 run osmo-stp_10.42.42.5(pid=28088): stderr: | 20221209045642248 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209045642248 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209045642248 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209045642249 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209045642249 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209045642249 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209045642249 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:56:43.704233 run osmo-stp_10.42.42.5(pid=28088): stdout: | (launched: 2022-12-09_04:56:42.057500) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:56:43.832814 run osmo-stp_10.42.42.5(pid=28088): stderr: | 20221209045642248 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209045642248 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209045642248 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209045642249 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209045642249 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209045642249 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209045642249 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:56:43.986017 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=28088): Process ended prematurely: osmo-stp_10.42.42.5(pid=28088) [trial-2354↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28088)] [trial-2354↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18] 04:56:43.995002 tst handover.py:18: Test FAILED (6.6 sec) 04:56:44.022740 run osmo-hlr_10.42.42.2(pid=28085): ERR: Terminated: ERROR {rc=237} [trial-2354↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28085)] 04:56:44.073680 run osmo-hlr_10.42.42.2(pid=28085): stdout: | (launched: 2022-12-09_04:56:41.085040) 04:56:44.126142 run osmo-hlr_10.42.42.2(pid=28085): stderr: | 20221209045641283 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209045641283 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209045641283 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209045641283 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209045641283 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209045641283 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209045641297 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/handover_2G:trx-lms+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209045641307 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209045641308 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209045641308 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:56:44.199454 run osmo-msc_10.42.42.6(pid=28091): ERR: Terminated: ERROR {rc=2} [trial-2354↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28091)] 04:56:44.249752 run osmo-msc_10.42.42.6(pid=28091): stdout: | (launched: 2022-12-09_04:56:43.056580) 04:56:44.301748 run osmo-msc_10.42.42.6(pid=28091): stderr: | 20221209045643379 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209045643379 DLGLOBAL DEBUG validating counter group 0x7f379b2e6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209045643379 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209045643379 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209045643379 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209045643379 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209045643381 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209045643382 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209045643382 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209045643382 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:56:44.353931 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28084): Terminating (SIGTERM) 04:56:44.396532 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28087): Terminating (SIGTERM) 04:56:44.438919 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28090): Terminating (SIGTERM) 04:56:44.481222 --- ParallelTerminationStrategy: PID 28084 died... 04:56:44.501518 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28084): Terminated: ok {rc=0} 04:56:44.548241 --- ParallelTerminationStrategy: PID 28087 died... 04:56:44.568213 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28087): Terminated: ok {rc=0} 04:56:44.614686 --- ParallelTerminationStrategy: PID 28090 died... 04:56:44.634451 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28090): Terminated: ok {rc=0} 04:56:44.723143 bus /sierra_3: Setting Powered False 04:56:45.821766 bus /sierra_3: Setting Powered False 04:56:46.944439 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 handover_2G:trx-lms+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 handover_2G:trx-lms+bts1-sysmo --------------------------------------------------------------------- 04:56:48.220347 tst handover_2G:trx-lms+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:56:48.225820 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x bts (candidates: 11) 04:56:48.277399 tst handover_2G:trx-lms+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 04:56:48.304738 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x modem (candidates: 12) 04:56:48.355686 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x bts (candidates: 11) 04:56:48.407103 tst handover_2G:trx-lms+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 04:56:48.434197 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x modem (candidates: 12) 04:56:48.986719 tst handover_2G:trx-lms+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 handover_2G:trx-lms+bts1-sysmo handover.py ---------------------------------------------- 04:56:48.992177 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:56:49.003394 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 04:56:49.051761 tst handover.py: using LAC 19233 04:56:49.178730 tst handover.py: using RAC 108 04:56:49.308642 tst handover.py: using CellId 19233 04:56:49.435130 tst handover.py: using BVCI 19234 04:56:49.551689 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 04:56:49.585742 tst handover.py: using LAC 19234 04:56:49.709674 tst handover.py: using RAC 109 04:56:49.834326 tst handover.py: using CellId 19234 04:56:49.963268 tst handover.py: using BVCI 19235 04:56:50.081641 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:56:50.092687 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:56:50.103774 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:56:50.114775 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:56:50.125967 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:56:50.136840 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 04:56:50.254221 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 04:56:50.372308 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:56:50.843433 run create_hlr_db(pid=28096): Launched 04:56:50.973148 bus /sierra_2: Setting Powered False 04:56:52.036741 run create_hlr_db(pid=28096): Terminated: ok {rc=0} 04:56:52.439564 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28098): Launched 04:56:52.738665 run osmo-hlr_10.42.42.2(pid=28099): Launched 04:56:52.853340 run osmo-stp_10.42.42.5: Starting osmo-stp 04:56:53.345900 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28101): Launched 04:56:53.645900 run osmo-stp_10.42.42.5(pid=28102): Launched 04:56:53.761151 run osmo-msc_10.42.42.6: Starting osmo-msc 04:56:54.277304 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28104): Launched 04:56:54.577198 run osmo-msc_10.42.42.6(pid=28105): Launched 04:56:54.745637 run osmo-stp_10.42.42.5(pid=28102): ERR: Terminated: ERROR {rc=1} [trial-2354↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28102)] 04:56:54.873339 run osmo-stp_10.42.42.5(pid=28102): stdout: | (launched: 2022-12-09_04:56:53.590200) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:56:55.001345 run osmo-stp_10.42.42.5(pid=28102): stderr: | 20221209045653760 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209045653760 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209045653760 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209045653761 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209045653761 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209045653761 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209045653761 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:56:55.126636 run osmo-stp_10.42.42.5(pid=28102): stdout: | (launched: 2022-12-09_04:56:53.590200) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:56:55.245789 run osmo-stp_10.42.42.5(pid=28102): stderr: | 20221209045653760 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209045653760 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209045653760 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209045653761 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209045653761 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209045653761 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209045653761 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:56:55.388442 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=28102): Process ended prematurely: osmo-stp_10.42.42.5(pid=28102) [trial-2354↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28102)] [trial-2354↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18] 04:56:55.397084 tst handover.py:18: Test FAILED (6.4 sec) 04:56:55.423946 run osmo-hlr_10.42.42.2(pid=28099): ERR: Terminated: ERROR {rc=237} [trial-2354↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28099)] 04:56:55.473083 run osmo-hlr_10.42.42.2(pid=28099): stdout: | (launched: 2022-12-09_04:56:52.684245) 04:56:55.523420 run osmo-hlr_10.42.42.2(pid=28099): stderr: | 20221209045652860 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209045652860 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209045652860 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209045652860 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209045652860 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209045652860 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209045652872 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/handover_2G:trx-lms+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209045652880 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209045652880 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209045652880 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:56:55.593698 run osmo-msc_10.42.42.6(pid=28105): ERR: Terminated: ERROR {rc=2} [trial-2354↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28105)] 04:56:55.642458 run osmo-msc_10.42.42.6(pid=28105): stdout: | (launched: 2022-12-09_04:56:54.522404) 04:56:55.692778 run osmo-msc_10.42.42.6(pid=28105): stderr: | 20221209045654795 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209045654795 DLGLOBAL DEBUG validating counter group 0x7f964d310c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209045654796 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209045654796 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209045654796 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209045654796 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209045654798 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209045654798 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209045654798 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209045654798 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:56:55.743403 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28098): Terminating (SIGTERM) 04:56:55.783984 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28101): Terminating (SIGTERM) 04:56:55.824781 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28104): Terminating (SIGTERM) 04:56:55.865418 --- ParallelTerminationStrategy: PID 28098 died... 04:56:55.884480 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28098): Terminated: ok {rc=0} 04:56:55.929574 --- ParallelTerminationStrategy: PID 28101 died... 04:56:55.948198 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28101): Terminated: ok {rc=0} 04:56:55.993332 --- ParallelTerminationStrategy: PID 28104 died... 04:56:56.012119 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28104): Terminated: ok {rc=0} 04:56:56.098554 bus /sierra_3: Setting Powered False 04:56:57.199622 bus /sierra_3: Setting Powered False 04:56:58.316905 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 handover_2G:trx-lms+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 handover_2G:trx-lms+bts1-trx-b200 --------------------------------------------------------------------- 04:56:59.572570 tst handover_2G:trx-lms+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:56:59.577708 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 04:56:59.641066 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 04:56:59.667943 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 04:56:59.720093 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 04:56:59.782414 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 04:56:59.809078 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 04:57:00.356385 tst handover_2G:trx-lms+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 handover_2G:trx-lms+bts1-trx-b200 handover.py ---------------------------------------------- 04:57:00.361649 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:57:00.372309 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 04:57:00.420904 tst handover.py: using LAC 19235 04:57:00.541241 tst handover.py: using RAC 110 04:57:00.668558 tst handover.py: using CellId 19235 04:57:00.800370 tst handover.py: using BVCI 19236 04:57:00.925726 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 04:57:00.975575 tst handover.py: using LAC 19236 04:57:01.105662 tst handover.py: using RAC 111 04:57:01.267537 tst handover.py: using CellId 19236 04:57:01.395448 tst handover.py: using BVCI 19237 04:57:01.557218 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:57:01.571593 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:57:01.585673 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:57:01.600588 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:57:01.615662 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:57:01.631202 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 04:57:01.747594 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 04:57:01.883818 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:57:02.440886 run create_hlr_db(pid=28110): Launched 04:57:02.573230 bus /sierra_2: Setting Powered False 04:57:03.636687 run create_hlr_db(pid=28110): Terminated: ok {rc=0} 04:57:04.040185 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28112): Launched 04:57:04.340612 run osmo-hlr_10.42.42.2(pid=28113): Launched 04:57:04.456281 run osmo-stp_10.42.42.5: Starting osmo-stp 04:57:04.959589 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28115): Launched 04:57:05.259957 run osmo-stp_10.42.42.5(pid=28116): Launched 04:57:05.375605 run osmo-msc_10.42.42.6: Starting osmo-msc 04:57:05.895633 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28118): Launched 04:57:06.195908 run osmo-msc_10.42.42.6(pid=28119): Launched 04:57:06.365158 run osmo-stp_10.42.42.5(pid=28116): ERR: Terminated: ERROR {rc=1} [trial-2354↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28116)] 04:57:06.498816 run osmo-stp_10.42.42.5(pid=28116): stdout: | (launched: 2022-12-09_04:57:05.204931) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:57:06.638349 run osmo-stp_10.42.42.5(pid=28116): stderr: | 20221209045705374 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209045705374 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209045705374 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209045705375 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209045705377 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209045705377 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209045705377 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:57:06.774278 run osmo-stp_10.42.42.5(pid=28116): stdout: | (launched: 2022-12-09_04:57:05.204931) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:57:06.902742 run osmo-stp_10.42.42.5(pid=28116): stderr: | 20221209045705374 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209045705374 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209045705374 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209045705375 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209045705377 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209045705377 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209045705377 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:57:07.056510 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=28116): Process ended prematurely: osmo-stp_10.42.42.5(pid=28116) [trial-2354↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28116)] [trial-2354↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18] 04:57:07.065639 tst handover.py:18: Test FAILED (6.7 sec) 04:57:07.093435 run osmo-hlr_10.42.42.2(pid=28113): ERR: Terminated: ERROR {rc=237} [trial-2354↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28113)] 04:57:07.143722 run osmo-hlr_10.42.42.2(pid=28113): stdout: | (launched: 2022-12-09_04:57:04.285581) 04:57:07.195724 run osmo-hlr_10.42.42.2(pid=28113): stderr: | 20221209045704463 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209045704463 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209045704463 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209045704463 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209045704463 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209045704463 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209045704474 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/handover_2G:trx-lms+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209045704483 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209045704483 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209045704484 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:57:07.268173 run osmo-msc_10.42.42.6(pid=28119): ERR: Terminated: ERROR {rc=2} [trial-2354↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28119)] 04:57:07.318523 run osmo-msc_10.42.42.6(pid=28119): stdout: | (launched: 2022-12-09_04:57:06.141076) 04:57:07.370559 run osmo-msc_10.42.42.6(pid=28119): stderr: | 20221209045706411 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209045706411 DLGLOBAL DEBUG validating counter group 0x7f069d8fac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209045706411 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209045706412 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209045706412 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209045706412 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209045706414 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209045706414 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209045706414 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209045706414 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:57:07.423052 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28112): Terminating (SIGTERM) 04:57:07.465435 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28115): Terminating (SIGTERM) 04:57:07.507441 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28118): Terminating (SIGTERM) 04:57:07.549881 --- ParallelTerminationStrategy: PID 28112 died... 04:57:07.570243 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28112): Terminated: ok {rc=0} 04:57:07.617246 --- ParallelTerminationStrategy: PID 28115 died... 04:57:07.637129 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28115): Terminated: ok {rc=0} 04:57:07.683696 --- ParallelTerminationStrategy: PID 28118 died... 04:57:07.703777 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28118): Terminated: ok {rc=0} 04:57:07.793393 bus /sierra_3: Setting Powered False 04:57:08.893782 bus /sierra_3: Setting Powered False 04:57:10.010676 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 handover_2G:trx-lms+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 handover_2G:trx-lms+bts1-trx-umtrx --------------------------------------------------------------------- 04:57:11.281287 tst handover_2G:trx-lms+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:57:11.286560 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 04:57:11.348042 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 04:57:11.374540 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 04:57:11.431303 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 04:57:11.495487 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 04:57:11.522787 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 04:57:12.071545 tst handover_2G:trx-lms+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 handover_2G:trx-lms+bts1-trx-umtrx handover.py ---------------------------------------------- 04:57:12.077314 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:57:12.088482 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 04:57:12.136617 tst handover.py: using LAC 19237 04:57:12.262911 tst handover.py: using RAC 112 04:57:12.390469 tst handover.py: using CellId 19237 04:57:12.517767 tst handover.py: using BVCI 19238 04:57:12.629171 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 04:57:12.676545 tst handover.py: using LAC 19238 04:57:12.809048 tst handover.py: using RAC 113 04:57:12.934615 tst handover.py: using CellId 19238 04:57:13.059294 tst handover.py: using BVCI 19239 04:57:13.176028 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:57:13.187324 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:57:13.198498 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:57:13.209767 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:57:13.220891 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:57:13.232008 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 04:57:13.346295 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 04:57:13.465763 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:57:13.936273 run create_hlr_db(pid=28124): Launched 04:57:14.066579 bus /sierra_2: Setting Powered False 04:57:15.130507 run create_hlr_db(pid=28124): Terminated: ok {rc=0} 04:57:15.533965 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28126): Launched 04:57:15.838722 run osmo-hlr_10.42.42.2(pid=28127): Launched 04:57:16.059129 run osmo-stp_10.42.42.5: Starting osmo-stp 04:57:16.672028 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28129): Launched 04:57:17.015169 run osmo-stp_10.42.42.5(pid=28130): Launched 04:57:17.267090 run osmo-msc_10.42.42.6: Starting osmo-msc 04:57:17.860869 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28132): Launched 04:57:18.181550 run osmo-msc_10.42.42.6(pid=28133): Launched 04:57:18.361467 run osmo-stp_10.42.42.5(pid=28130): ERR: Terminated: ERROR {rc=1} [trial-2354↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28130)] 04:57:18.496355 run osmo-stp_10.42.42.5(pid=28130): stdout: | (launched: 2022-12-09_04:57:16.952095) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:57:18.633774 run osmo-stp_10.42.42.5(pid=28130): stderr: | 20221209045717220 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209045717220 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209045717220 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209045717221 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209045717221 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209045717221 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209045717221 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:57:18.770397 run osmo-stp_10.42.42.5(pid=28130): stdout: | (launched: 2022-12-09_04:57:16.952095) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:57:18.899568 run osmo-stp_10.42.42.5(pid=28130): stderr: | 20221209045717220 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209045717220 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209045717220 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209045717221 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209045717221 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209045717221 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209045717221 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:57:19.052406 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=28130): Process ended prematurely: osmo-stp_10.42.42.5(pid=28130) [trial-2354↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28130)] [trial-2354↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18] 04:57:19.061253 tst handover.py:18: Test FAILED (7.0 sec) 04:57:19.088696 run osmo-hlr_10.42.42.2(pid=28127): ERR: Terminated: ERROR {rc=237} [trial-2354↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28127)] 04:57:19.139285 run osmo-hlr_10.42.42.2(pid=28127): stdout: | (launched: 2022-12-09_04:57:15.777930) 04:57:19.191151 run osmo-hlr_10.42.42.2(pid=28127): stderr: | 20221209045716073 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209045716073 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209045716073 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209045716073 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209045716073 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209045716073 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209045716093 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/handover_2G:trx-lms+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209045716116 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209045716118 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209045716118 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:57:19.263740 run osmo-msc_10.42.42.6(pid=28133): ERR: Terminated: ERROR {rc=2} [trial-2354↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28133)] 04:57:19.314056 run osmo-msc_10.42.42.6(pid=28133): stdout: | (launched: 2022-12-09_04:57:18.123131) 04:57:19.366306 run osmo-msc_10.42.42.6(pid=28133): stderr: | 20221209045718446 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209045718446 DLGLOBAL DEBUG validating counter group 0x7fa7c885cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209045718446 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209045718446 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209045718446 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209045718446 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209045718448 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209045718448 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209045718448 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209045718449 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:57:19.418670 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28126): Terminating (SIGTERM) 04:57:19.460536 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28129): Terminating (SIGTERM) 04:57:19.502669 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28132): Terminating (SIGTERM) 04:57:19.544916 --- ParallelTerminationStrategy: PID 28126 died... 04:57:19.565045 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28126): Terminated: ok {rc=0} 04:57:19.611696 --- ParallelTerminationStrategy: PID 28129 died... 04:57:19.631351 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28129): Terminated: ok {rc=0} 04:57:19.677529 --- ParallelTerminationStrategy: PID 28132 died... 04:57:19.697131 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28132): Terminated: ok {rc=0} 04:57:19.786033 bus /sierra_3: Setting Powered False 04:57:20.885718 bus /sierra_3: Setting Powered False 04:57:22.002391 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 handover_2G:trx-lms+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 04:57:23.266884 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:57:23.272053 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 04:57:23.331279 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 04:57:23.357977 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 04:57:23.409241 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 04:57:23.467984 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 04:57:23.494563 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 04:57:24.047190 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 04:57:24.052747 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:57:24.064076 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 04:57:24.108341 tst handover.py: using LAC 19239 04:57:24.226439 tst handover.py: using RAC 114 04:57:24.346119 tst handover.py: using CellId 19239 04:57:24.470690 tst handover.py: using BVCI 19240 04:57:24.580783 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 04:57:24.628087 tst handover.py: using LAC 19240 04:57:24.746139 tst handover.py: using RAC 115 04:57:24.862503 tst handover.py: using CellId 19240 04:57:24.980751 tst handover.py: using BVCI 19241 04:57:25.089511 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:57:25.100730 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:57:25.111884 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:57:25.123312 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:57:25.134791 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:57:25.146271 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 04:57:25.265212 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 04:57:25.385118 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:57:25.856118 run create_hlr_db(pid=28139): Launched 04:57:25.987325 bus /sierra_2: Setting Powered False 04:57:27.050729 run create_hlr_db(pid=28139): Terminated: ok {rc=0} 04:57:27.453849 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28141): Launched 04:57:27.753731 run osmo-hlr_10.42.42.2(pid=28142): Launched 04:57:27.868173 run osmo-stp_10.42.42.5: Starting osmo-stp 04:57:28.362420 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28144): Launched 04:57:28.661867 run osmo-stp_10.42.42.5(pid=28145): Launched 04:57:28.776764 run osmo-msc_10.42.42.6: Starting osmo-msc 04:57:29.294657 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28147): Launched 04:57:29.594121 run osmo-msc_10.42.42.6(pid=28148): Launched 04:57:29.763119 run osmo-stp_10.42.42.5(pid=28145): ERR: Terminated: ERROR {rc=1} [trial-2354↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28145)] 04:57:29.890550 run osmo-stp_10.42.42.5(pid=28145): stdout: | (launched: 2022-12-09_04:57:28.607185) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:57:30.018475 run osmo-stp_10.42.42.5(pid=28145): stderr: | 20221209045728777 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209045728777 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209045728777 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209045728778 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209045728780 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209045728780 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209045728780 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:57:30.144170 run osmo-stp_10.42.42.5(pid=28145): stdout: | (launched: 2022-12-09_04:57:28.607185) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:57:30.263910 run osmo-stp_10.42.42.5(pid=28145): stderr: | 20221209045728777 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209045728777 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209045728777 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209045728778 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209045728780 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209045728780 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209045728780 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:57:30.406685 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=28145): Process ended prematurely: osmo-stp_10.42.42.5(pid=28145) [trial-2354↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28145)] [trial-2354↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18] 04:57:30.415140 tst handover.py:18: Test FAILED (6.4 sec) 04:57:30.442292 run osmo-hlr_10.42.42.2(pid=28142): ERR: Terminated: ERROR {rc=237} [trial-2354↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28142)] 04:57:30.490706 run osmo-hlr_10.42.42.2(pid=28142): stdout: | (launched: 2022-12-09_04:57:27.698675) 04:57:30.540717 run osmo-hlr_10.42.42.2(pid=28142): stderr: | 20221209045727871 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209045727871 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209045727872 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209045727872 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209045727872 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209045727872 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209045727883 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209045727892 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209045727892 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209045727892 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:57:30.610508 run osmo-msc_10.42.42.6(pid=28148): ERR: Terminated: ERROR {rc=2} [trial-2354↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28148)] 04:57:30.658648 run osmo-msc_10.42.42.6(pid=28148): stdout: | (launched: 2022-12-09_04:57:29.539179) 04:57:30.708514 run osmo-msc_10.42.42.6(pid=28148): stderr: | 20221209045729810 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209045729811 DLGLOBAL DEBUG validating counter group 0x7f39d31b7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209045729811 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209045729811 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209045729811 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209045729811 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209045729813 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209045729813 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209045729813 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209045729813 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:57:30.759480 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28141): Terminating (SIGTERM) 04:57:30.799762 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28144): Terminating (SIGTERM) 04:57:30.844532 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28147): Terminating (SIGTERM) 04:57:30.893987 --- ParallelTerminationStrategy: PID 28141 died... 04:57:30.921028 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28141): Terminated: ok {rc=0} 04:57:30.971913 --- ParallelTerminationStrategy: PID 28144 died... 04:57:30.991557 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28144): Terminated: ok {rc=0} 04:57:31.038215 --- ParallelTerminationStrategy: PID 28147 died... 04:57:31.057782 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28147): Terminated: ok {rc=0} 04:57:31.144040 bus /sierra_3: Setting Powered False 04:57:32.243969 bus /sierra_3: Setting Powered False 04:57:33.362120 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 handover_2G:trx-lms-limenet-micro+bts1-sysmo --------------------------------------------------------------------- 04:57:34.636259 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:57:34.641817 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x bts (candidates: 11) 04:57:34.689412 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 04:57:34.716419 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x modem (candidates: 12) 04:57:34.771499 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x bts (candidates: 11) 04:57:34.818880 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 04:57:34.845675 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x modem (candidates: 12) 04:57:35.392531 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover.py ---------------------------------------------- 04:57:35.398911 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:57:35.410722 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 04:57:35.457391 tst handover.py: using LAC 19241 04:57:35.584282 tst handover.py: using RAC 116 04:57:35.710311 tst handover.py: using CellId 19241 04:57:35.840015 tst handover.py: using BVCI 19242 04:57:35.958671 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 04:57:35.993521 tst handover.py: using LAC 19242 04:57:36.119910 tst handover.py: using RAC 117 04:57:36.246004 tst handover.py: using CellId 19242 04:57:36.377135 tst handover.py: using BVCI 19243 04:57:36.494709 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:57:36.506149 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:57:36.517259 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:57:36.529071 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:57:36.540703 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:57:36.552498 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 04:57:36.670210 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 04:57:36.788942 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:57:37.259828 run create_hlr_db(pid=28155): Launched 04:57:37.390716 bus /sierra_2: Setting Powered False 04:57:38.454186 run create_hlr_db(pid=28155): Terminated: ok {rc=0} 04:57:38.858781 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28157): Launched 04:57:39.158603 run osmo-hlr_10.42.42.2(pid=28158): Launched 04:57:39.273815 run osmo-stp_10.42.42.5: Starting osmo-stp 04:57:39.766981 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28160): Launched 04:57:40.067508 run osmo-stp_10.42.42.5(pid=28161): Launched 04:57:40.182284 run osmo-msc_10.42.42.6: Starting osmo-msc 04:57:40.699098 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28163): Launched 04:57:40.999675 run osmo-msc_10.42.42.6(pid=28164): Launched 04:57:41.168777 run osmo-stp_10.42.42.5(pid=28161): ERR: Terminated: ERROR {rc=1} [trial-2354↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28161)] 04:57:41.296581 run osmo-stp_10.42.42.5(pid=28161): stdout: | (launched: 2022-12-09_04:57:40.012387) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:57:41.424834 run osmo-stp_10.42.42.5(pid=28161): stderr: | 20221209045740181 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209045740181 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209045740182 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209045740182 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209045740184 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209045740184 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209045740185 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:57:41.551072 run osmo-stp_10.42.42.5(pid=28161): stdout: | (launched: 2022-12-09_04:57:40.012387) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:57:41.670693 run osmo-stp_10.42.42.5(pid=28161): stderr: | 20221209045740181 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209045740181 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209045740182 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209045740182 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209045740184 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209045740184 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209045740185 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:57:41.813574 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=28161): Process ended prematurely: osmo-stp_10.42.42.5(pid=28161) [trial-2354↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28161)] [trial-2354↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18] 04:57:41.821982 tst handover.py:18: Test FAILED (6.4 sec) 04:57:41.848891 run osmo-hlr_10.42.42.2(pid=28158): ERR: Terminated: ERROR {rc=237} [trial-2354↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28158)] 04:57:41.897824 run osmo-hlr_10.42.42.2(pid=28158): stdout: | (launched: 2022-12-09_04:57:39.103691) 04:57:41.948205 run osmo-hlr_10.42.42.2(pid=28158): stderr: | 20221209045739279 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209045739279 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209045739279 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209045739279 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209045739279 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209045739279 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209045739292 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/handover_2G:trx-lms-limenet-micro+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209045739300 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209045739301 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209045739301 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:57:42.018313 run osmo-msc_10.42.42.6(pid=28164): ERR: Terminated: ERROR {rc=2} [trial-2354↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28164)] 04:57:42.066681 run osmo-msc_10.42.42.6(pid=28164): stdout: | (launched: 2022-12-09_04:57:40.944685) 04:57:42.117447 run osmo-msc_10.42.42.6(pid=28164): stderr: | 20221209045741215 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209045741216 DLGLOBAL DEBUG validating counter group 0x7f340620dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209045741216 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209045741216 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209045741216 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209045741216 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209045741218 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209045741218 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209045741218 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209045741218 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:57:42.168120 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28157): Terminating (SIGTERM) 04:57:42.208261 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28160): Terminating (SIGTERM) 04:57:42.248496 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28163): Terminating (SIGTERM) 04:57:42.289100 --- ParallelTerminationStrategy: PID 28157 died... 04:57:42.308283 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28157): Terminated: ok {rc=0} 04:57:42.353439 --- ParallelTerminationStrategy: PID 28160 died... 04:57:42.372507 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28160): Terminated: ok {rc=0} 04:57:42.417387 --- ParallelTerminationStrategy: PID 28163 died... 04:57:42.436371 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28163): Terminated: ok {rc=0} 04:57:42.521495 bus /sierra_3: Setting Powered False 04:57:43.620538 bus /sierra_3: Setting Powered False 04:57:44.736758 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 handover_2G:trx-lms-limenet-micro+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 --------------------------------------------------------------------- 04:57:46.012329 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:57:46.021353 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 04:57:46.083672 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 04:57:46.112443 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 04:57:46.165432 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 04:57:46.241878 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 04:57:46.277098 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 04:57:46.806804 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover.py ---------------------------------------------- 04:57:46.813177 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:57:46.825293 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 04:57:46.870760 tst handover.py: using LAC 19243 04:57:47.008601 tst handover.py: using RAC 118 04:57:47.134746 tst handover.py: using CellId 19243 04:57:47.276144 tst handover.py: using BVCI 19244 04:57:47.388211 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 04:57:47.435997 tst handover.py: using LAC 19244 04:57:47.552639 tst handover.py: using RAC 119 04:57:47.669083 tst handover.py: using CellId 19244 04:57:47.785351 tst handover.py: using BVCI 19245 04:57:47.894551 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:57:47.905751 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:57:47.916689 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:57:47.928643 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:57:47.940511 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:57:47.952221 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 04:57:48.072031 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 04:57:48.188095 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:57:48.629033 run create_hlr_db(pid=28169): Launched 04:57:48.744199 bus /sierra_2: Setting Powered False 04:57:49.804300 run create_hlr_db(pid=28169): Terminated: ok {rc=0} 04:57:50.198998 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28171): Launched 04:57:50.499524 run osmo-hlr_10.42.42.2(pid=28172): Launched 04:57:50.615193 run osmo-stp_10.42.42.5: Starting osmo-stp 04:57:51.120330 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28174): Launched 04:57:51.420792 run osmo-stp_10.42.42.5(pid=28175): Launched 04:57:51.536434 run osmo-msc_10.42.42.6: Starting osmo-msc 04:57:52.054501 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28177): Launched 04:57:52.353768 run osmo-msc_10.42.42.6(pid=28178): Launched 04:57:52.521500 run osmo-stp_10.42.42.5(pid=28175): ERR: Terminated: ERROR {rc=1} [trial-2354↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28175)] 04:57:52.649334 run osmo-stp_10.42.42.5(pid=28175): stdout: | (launched: 2022-12-09_04:57:51.365784) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:57:52.777416 run osmo-stp_10.42.42.5(pid=28175): stderr: | 20221209045751536 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209045751536 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209045751537 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209045751537 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209045751537 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209045751537 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209045751538 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:57:52.902828 run osmo-stp_10.42.42.5(pid=28175): stdout: | (launched: 2022-12-09_04:57:51.365784) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:57:53.022316 run osmo-stp_10.42.42.5(pid=28175): stderr: | 20221209045751536 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209045751536 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209045751537 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209045751537 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209045751537 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209045751537 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209045751538 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:57:53.164733 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=28175): Process ended prematurely: osmo-stp_10.42.42.5(pid=28175) [trial-2354↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28175)] [trial-2354↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18] 04:57:53.173069 tst handover.py:18: Test FAILED (6.4 sec) 04:57:53.199850 run osmo-hlr_10.42.42.2(pid=28172): ERR: Terminated: ERROR {rc=237} [trial-2354↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28172)] 04:57:53.247713 run osmo-hlr_10.42.42.2(pid=28172): stdout: | (launched: 2022-12-09_04:57:50.444572) 04:57:53.297198 run osmo-hlr_10.42.42.2(pid=28172): stderr: | 20221209045750620 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209045750620 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209045750620 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209045750620 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209045750620 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209045750620 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209045750631 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/handover_2G:trx-lms-limenet-micro+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209045750639 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209045750639 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209045750640 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:57:53.366752 run osmo-msc_10.42.42.6(pid=28178): ERR: Terminated: ERROR {rc=2} [trial-2354↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28178)] 04:57:53.414670 run osmo-msc_10.42.42.6(pid=28178): stdout: | (launched: 2022-12-09_04:57:52.299037) 04:57:53.464085 run osmo-msc_10.42.42.6(pid=28178): stderr: | 20221209045752570 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209045752571 DLGLOBAL DEBUG validating counter group 0x7fe35100bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209045752571 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209045752571 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209045752571 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209045752571 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209045752573 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209045752574 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209045752574 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209045752574 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:57:53.513865 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28171): Terminating (SIGTERM) 04:57:53.553691 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28174): Terminating (SIGTERM) 04:57:53.593544 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28177): Terminating (SIGTERM) 04:57:53.633692 --- ParallelTerminationStrategy: PID 28171 died... 04:57:53.652839 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28171): Terminated: ok {rc=0} 04:57:53.697398 --- ParallelTerminationStrategy: PID 28174 died... 04:57:53.715818 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28174): Terminated: ok {rc=0} 04:57:53.760432 --- ParallelTerminationStrategy: PID 28177 died... 04:57:53.779157 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28177): Terminated: ok {rc=0} 04:57:53.863670 bus /sierra_3: Setting Powered False 04:57:54.960941 bus /sierra_3: Setting Powered False 04:57:56.077533 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx --------------------------------------------------------------------- 04:57:57.346181 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:57:57.351342 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 04:57:57.409030 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 04:57:57.435274 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 04:57:57.488449 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 04:57:57.545333 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 04:57:57.571367 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 04:57:58.126620 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover.py ---------------------------------------------- 04:57:58.133126 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:57:58.145159 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 04:57:58.191807 tst handover.py: using LAC 19245 04:57:58.320084 tst handover.py: using RAC 120 04:57:58.447116 tst handover.py: using CellId 19245 04:57:58.574953 tst handover.py: using BVCI 19246 04:57:58.693642 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 04:57:58.741905 tst handover.py: using LAC 19246 04:57:58.868617 tst handover.py: using RAC 121 04:57:58.996751 tst handover.py: using CellId 19246 04:57:59.124324 tst handover.py: using BVCI 19247 04:57:59.241309 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:57:59.252688 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:57:59.263983 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:57:59.275377 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:57:59.286697 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:57:59.298006 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 04:57:59.417938 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 04:57:59.536267 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:58:00.008442 run create_hlr_db(pid=28183): Launched 04:58:00.139839 bus /sierra_2: Setting Powered False 04:58:01.220599 run create_hlr_db(pid=28183): Terminated: ok {rc=0} 04:58:01.678949 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28185): Launched 04:58:01.994877 run osmo-hlr_10.42.42.2(pid=28186): Launched 04:58:02.124852 run osmo-stp_10.42.42.5: Starting osmo-stp 04:58:02.664683 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28188): Launched 04:58:02.964886 run osmo-stp_10.42.42.5(pid=28189): Launched 04:58:03.080835 run osmo-msc_10.42.42.6: Starting osmo-msc 04:58:03.596871 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28191): Launched 04:58:03.896163 run osmo-msc_10.42.42.6(pid=28192): Launched 04:58:04.065214 run osmo-stp_10.42.42.5(pid=28189): ERR: Terminated: ERROR {rc=1} [trial-2354↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28189)] 04:58:04.192627 run osmo-stp_10.42.42.5(pid=28189): stdout: | (launched: 2022-12-09_04:58:02.910108) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:58:04.319872 run osmo-stp_10.42.42.5(pid=28189): stderr: | 20221209045803077 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209045803078 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209045803078 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209045803078 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209045803079 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209045803079 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209045803079 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:58:04.445415 run osmo-stp_10.42.42.5(pid=28189): stdout: | (launched: 2022-12-09_04:58:02.910108) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:58:04.564316 run osmo-stp_10.42.42.5(pid=28189): stderr: | 20221209045803077 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209045803078 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209045803078 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209045803078 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209045803079 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209045803079 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209045803079 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:58:04.706594 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=28189): Process ended prematurely: osmo-stp_10.42.42.5(pid=28189) [trial-2354↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28189)] [trial-2354↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18] 04:58:04.714685 tst handover.py:18: Test FAILED (6.6 sec) 04:58:04.741733 run osmo-hlr_10.42.42.2(pid=28186): ERR: Terminated: ERROR {rc=237} [trial-2354↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28186)] 04:58:04.790254 run osmo-hlr_10.42.42.2(pid=28186): stdout: | (launched: 2022-12-09_04:58:01.935817) 04:58:04.840248 run osmo-hlr_10.42.42.2(pid=28186): stderr: | 20221209045802251 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209045802251 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209045802251 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209045802251 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209045802251 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209045802251 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209045802263 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209045802271 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209045802271 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209045802271 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:58:04.909969 run osmo-msc_10.42.42.6(pid=28192): ERR: Terminated: ERROR {rc=2} [trial-2354↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28192)] 04:58:04.958081 run osmo-msc_10.42.42.6(pid=28192): stdout: | (launched: 2022-12-09_04:58:03.841332) 04:58:05.009268 run osmo-msc_10.42.42.6(pid=28192): stderr: | 20221209045804112 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209045804112 DLGLOBAL DEBUG validating counter group 0x7f973dab8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209045804112 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209045804112 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209045804113 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209045804113 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209045804115 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209045804115 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209045804115 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209045804115 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:58:05.059755 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28185): Terminating (SIGTERM) 04:58:05.099472 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28188): Terminating (SIGTERM) 04:58:05.139536 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28191): Terminating (SIGTERM) 04:58:05.179658 --- ParallelTerminationStrategy: PID 28185 died... 04:58:05.198823 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28185): Terminated: ok {rc=0} 04:58:05.243308 --- ParallelTerminationStrategy: PID 28188 died... 04:58:05.262013 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28188): Terminated: ok {rc=0} 04:58:05.306464 --- ParallelTerminationStrategy: PID 28191 died... 04:58:05.325447 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28191): Terminated: ok {rc=0} 04:58:05.412076 bus /sierra_3: Setting Powered False 04:58:06.513385 bus /sierra_3: Setting Powered False 04:58:07.629888 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 handover_2G:trx-sysmocell5000+bts1-sysmo --------------------------------------------------------------------- 04:58:08.894550 tst handover_2G:trx-sysmocell5000+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:58:08.899681 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x bts (candidates: 11) 04:58:08.950586 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 04:58:08.977093 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x modem (candidates: 12) 04:58:09.029110 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x bts (candidates: 11) 04:58:09.079653 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 04:58:09.106254 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x modem (candidates: 12) 04:58:09.656171 tst handover_2G:trx-sysmocell5000+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 handover_2G:trx-sysmocell5000+bts1-sysmo handover.py ---------------------------------------------- 04:58:09.661637 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:58:09.672628 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 04:58:09.720683 tst handover.py: using LAC 19247 04:58:09.851637 tst handover.py: using RAC 122 04:58:09.978568 tst handover.py: using CellId 19247 04:58:10.104379 tst handover.py: using BVCI 19248 04:58:10.222038 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 04:58:10.262097 tst handover.py: using LAC 19248 04:58:10.388645 tst handover.py: using RAC 123 04:58:10.513592 tst handover.py: using CellId 19248 04:58:10.640791 tst handover.py: using BVCI 19249 04:58:10.758114 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:58:10.769728 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:58:10.780817 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:58:10.792417 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:58:10.804126 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:58:10.815764 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 04:58:10.933506 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 04:58:11.047929 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:58:11.489111 run create_hlr_db(pid=28197): Launched 04:58:11.604770 bus /sierra_2: Setting Powered False 04:58:12.665131 run create_hlr_db(pid=28197): Terminated: ok {rc=0} 04:58:13.059448 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28199): Launched 04:58:13.360392 run osmo-hlr_10.42.42.2(pid=28200): Launched 04:58:13.476075 run osmo-stp_10.42.42.5: Starting osmo-stp 04:58:13.970680 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28202): Launched 04:58:14.270433 run osmo-stp_10.42.42.5(pid=28203): Launched 04:58:14.385163 run osmo-msc_10.42.42.6: Starting osmo-msc 04:58:14.900787 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28205): Launched 04:58:15.201907 run osmo-msc_10.42.42.6(pid=28206): Launched 04:58:15.371989 run osmo-stp_10.42.42.5(pid=28203): ERR: Terminated: ERROR {rc=1} [trial-2354↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28203)] 04:58:15.499743 run osmo-stp_10.42.42.5(pid=28203): stdout: | (launched: 2022-12-09_04:58:14.215541) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:58:15.627461 run osmo-stp_10.42.42.5(pid=28203): stderr: | 20221209045814385 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209045814385 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209045814385 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209045814386 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209045814386 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209045814386 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209045814386 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:58:15.753175 run osmo-stp_10.42.42.5(pid=28203): stdout: | (launched: 2022-12-09_04:58:14.215541) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:58:15.873862 run osmo-stp_10.42.42.5(pid=28203): stderr: | 20221209045814385 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209045814385 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209045814385 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209045814386 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209045814386 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209045814386 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209045814386 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:58:16.019816 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=28203): Process ended prematurely: osmo-stp_10.42.42.5(pid=28203) [trial-2354↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28203)] [trial-2354↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18] 04:58:16.029085 tst handover.py:18: Test FAILED (6.4 sec) 04:58:16.058113 run osmo-hlr_10.42.42.2(pid=28200): ERR: Terminated: ERROR {rc=237} [trial-2354↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28200)] 04:58:16.108335 run osmo-hlr_10.42.42.2(pid=28200): stdout: | (launched: 2022-12-09_04:58:13.305354) 04:58:16.160188 run osmo-hlr_10.42.42.2(pid=28200): stderr: | 20221209045813483 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209045813483 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209045813483 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209045813483 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209045813483 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209045813483 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209045813495 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/handover_2G:trx-sysmocell5000+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209045813503 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209045813503 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209045813503 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:58:16.232351 run osmo-msc_10.42.42.6(pid=28206): ERR: Terminated: ERROR {rc=2} [trial-2354↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28206)] 04:58:16.282836 run osmo-msc_10.42.42.6(pid=28206): stdout: | (launched: 2022-12-09_04:58:15.146903) 04:58:16.334945 run osmo-msc_10.42.42.6(pid=28206): stderr: | 20221209045815417 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209045815417 DLGLOBAL DEBUG validating counter group 0x7f6f10729c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209045815417 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209045815417 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209045815417 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209045815418 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209045815419 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209045815420 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209045815420 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209045815420 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:58:16.387630 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28199): Terminating (SIGTERM) 04:58:16.430873 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28202): Terminating (SIGTERM) 04:58:16.474915 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28205): Terminating (SIGTERM) 04:58:16.517874 --- ParallelTerminationStrategy: PID 28199 died... 04:58:16.537752 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28199): Terminated: ok {rc=0} 04:58:16.585732 --- ParallelTerminationStrategy: PID 28202 died... 04:58:16.605457 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28202): Terminated: ok {rc=0} 04:58:16.653325 --- ParallelTerminationStrategy: PID 28205 died... 04:58:16.673193 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28205): Terminated: ok {rc=0} 04:58:16.763840 bus /sierra_3: Setting Powered False 04:58:17.862023 bus /sierra_3: Setting Powered False 04:58:18.979882 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 handover_2G:trx-sysmocell5000+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 handover_2G:trx-sysmocell5000+bts1-trx-b200 --------------------------------------------------------------------- 04:58:20.241353 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:58:20.247180 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 04:58:20.312074 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 04:58:20.339702 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 04:58:20.391616 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 04:58:20.458944 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 04:58:20.485855 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 04:58:21.036634 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 handover_2G:trx-sysmocell5000+bts1-trx-b200 handover.py ---------------------------------------------- 04:58:21.042093 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:58:21.053365 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 04:58:21.103197 tst handover.py: using LAC 19249 04:58:21.230431 tst handover.py: using RAC 124 04:58:21.356386 tst handover.py: using CellId 19249 04:58:21.482091 tst handover.py: using BVCI 19250 04:58:21.600360 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 04:58:21.649606 tst handover.py: using LAC 19250 04:58:21.776743 tst handover.py: using RAC 125 04:58:21.902435 tst handover.py: using CellId 19250 04:58:22.029314 tst handover.py: using BVCI 19251 04:58:22.147690 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:58:22.159014 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:58:22.170199 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:58:22.181546 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:58:22.192713 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:58:22.204013 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 04:58:22.322998 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 04:58:22.438605 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:58:22.879509 run create_hlr_db(pid=28211): Launched 04:58:22.995081 bus /sierra_2: Setting Powered False 04:58:24.057831 run create_hlr_db(pid=28211): Terminated: ok {rc=0} 04:58:24.461499 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28213): Launched 04:58:24.762040 run osmo-hlr_10.42.42.2(pid=28214): Launched 04:58:24.877543 run osmo-stp_10.42.42.5: Starting osmo-stp 04:58:25.367552 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28216): Launched 04:58:25.669351 run osmo-stp_10.42.42.5(pid=28217): Launched 04:58:25.785351 run osmo-msc_10.42.42.6: Starting osmo-msc 04:58:26.302801 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28219): Launched 04:58:26.602318 run osmo-msc_10.42.42.6(pid=28220): Launched 04:58:26.769962 run osmo-stp_10.42.42.5(pid=28217): ERR: Terminated: ERROR {rc=1} [trial-2354↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28217)] 04:58:26.896896 run osmo-stp_10.42.42.5(pid=28217): stdout: | (launched: 2022-12-09_04:58:25.613978) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:58:27.024320 run osmo-stp_10.42.42.5(pid=28217): stderr: | 20221209045825786 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209045825786 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209045825786 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209045825786 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209045825787 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209045825787 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209045825787 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:58:27.149843 run osmo-stp_10.42.42.5(pid=28217): stdout: | (launched: 2022-12-09_04:58:25.613978) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:58:27.269398 run osmo-stp_10.42.42.5(pid=28217): stderr: | 20221209045825786 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209045825786 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209045825786 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209045825786 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209045825787 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209045825787 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209045825787 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:58:27.412003 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=28217): Process ended prematurely: osmo-stp_10.42.42.5(pid=28217) [trial-2354↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28217)] [trial-2354↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18] 04:58:27.420314 tst handover.py:18: Test FAILED (6.4 sec) 04:58:27.447314 run osmo-hlr_10.42.42.2(pid=28214): ERR: Terminated: ERROR {rc=237} [trial-2354↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28214)] 04:58:27.495331 run osmo-hlr_10.42.42.2(pid=28214): stdout: | (launched: 2022-12-09_04:58:24.707193) 04:58:27.544920 run osmo-hlr_10.42.42.2(pid=28214): stderr: | 20221209045824882 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209045824882 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209045824882 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209045824882 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209045824883 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209045824883 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209045824904 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/handover_2G:trx-sysmocell5000+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209045824915 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209045824915 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209045824915 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:58:27.614104 run osmo-msc_10.42.42.6(pid=28220): ERR: Terminated: ERROR {rc=2} [trial-2354↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28220)] 04:58:27.661860 run osmo-msc_10.42.42.6(pid=28220): stdout: | (launched: 2022-12-09_04:58:26.547290) 04:58:27.711356 run osmo-msc_10.42.42.6(pid=28220): stderr: | 20221209045826818 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209045826818 DLGLOBAL DEBUG validating counter group 0x7f9a774d8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209045826818 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209045826818 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209045826818 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209045826819 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209045826821 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209045826821 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209045826822 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209045826822 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:58:27.761564 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28213): Terminating (SIGTERM) 04:58:27.801540 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28216): Terminating (SIGTERM) 04:58:27.841699 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28219): Terminating (SIGTERM) 04:58:27.881947 --- ParallelTerminationStrategy: PID 28213 died... 04:58:27.900924 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28213): Terminated: ok {rc=0} 04:58:27.945819 --- ParallelTerminationStrategy: PID 28216 died... 04:58:27.964617 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28216): Terminated: ok {rc=0} 04:58:28.009435 --- ParallelTerminationStrategy: PID 28219 died... 04:58:28.028174 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28219): Terminated: ok {rc=0} 04:58:28.114019 bus /sierra_3: Setting Powered False 04:58:29.212072 bus /sierra_3: Setting Powered False 04:58:30.326192 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 handover_2G:trx-sysmocell5000+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 handover_2G:trx-sysmocell5000+bts1-trx-umtrx --------------------------------------------------------------------- 04:58:31.640175 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:58:31.648459 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 04:58:31.732916 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 04:58:31.768400 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 04:58:31.832831 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 04:58:31.916192 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 04:58:31.944278 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 04:58:32.477041 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover.py ---------------------------------------------- 04:58:32.482644 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:58:32.494257 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 04:58:32.543621 tst handover.py: using LAC 19251 04:58:32.674264 tst handover.py: using RAC 126 04:58:32.800866 tst handover.py: using CellId 19251 04:58:32.925379 tst handover.py: using BVCI 19252 04:58:33.042002 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 04:58:33.089146 tst handover.py: using LAC 19252 04:58:33.213915 tst handover.py: using RAC 127 04:58:33.338943 tst handover.py: using CellId 19252 04:58:33.462937 tst handover.py: using BVCI 19253 04:58:33.579722 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:58:33.591130 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:58:33.602461 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:58:33.613821 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:58:33.625263 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:58:33.636606 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 04:58:33.752502 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 04:58:33.871709 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:58:34.341903 run create_hlr_db(pid=28225): Launched 04:58:34.472231 bus /sierra_2: Setting Powered False 04:58:35.535974 run create_hlr_db(pid=28225): Terminated: ok {rc=0} 04:58:35.940328 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28227): Launched 04:58:36.239381 run osmo-hlr_10.42.42.2(pid=28228): Launched 04:58:36.354670 run osmo-stp_10.42.42.5: Starting osmo-stp 04:58:36.856246 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28230): Launched 04:58:37.156299 run osmo-stp_10.42.42.5(pid=28231): Launched 04:58:37.271635 run osmo-msc_10.42.42.6: Starting osmo-msc 04:58:37.787531 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28233): Launched 04:58:38.087794 run osmo-msc_10.42.42.6(pid=28234): Launched 04:58:38.256318 run osmo-stp_10.42.42.5(pid=28231): ERR: Terminated: ERROR {rc=1} [trial-2354↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28231)] 04:58:38.383866 run osmo-stp_10.42.42.5(pid=28231): stdout: | (launched: 2022-12-09_04:58:37.101340) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:58:38.511525 run osmo-stp_10.42.42.5(pid=28231): stderr: | 20221209045837271 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209045837272 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209045837272 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209045837272 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209045837273 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209045837273 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209045837273 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:58:38.637327 run osmo-stp_10.42.42.5(pid=28231): stdout: | (launched: 2022-12-09_04:58:37.101340) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:58:38.756543 run osmo-stp_10.42.42.5(pid=28231): stderr: | 20221209045837271 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209045837272 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209045837272 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209045837272 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209045837273 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209045837273 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209045837273 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:58:38.899732 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=28231): Process ended prematurely: osmo-stp_10.42.42.5(pid=28231) [trial-2354↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28231)] [trial-2354↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18] 04:58:38.908157 tst handover.py:18: Test FAILED (6.4 sec) 04:58:38.935279 run osmo-hlr_10.42.42.2(pid=28228): ERR: Terminated: ERROR {rc=237} [trial-2354↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28228)] 04:58:38.983433 run osmo-hlr_10.42.42.2(pid=28228): stdout: | (launched: 2022-12-09_04:58:36.184326) 04:58:39.033383 run osmo-hlr_10.42.42.2(pid=28228): stderr: | 20221209045836361 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209045836361 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209045836361 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209045836361 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209045836361 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209045836361 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209045836374 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/handover_2G:trx-sysmocell5000+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209045836382 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209045836382 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209045836382 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:58:39.103045 run osmo-msc_10.42.42.6(pid=28234): ERR: Terminated: ERROR {rc=2} [trial-2354↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28234)] 04:58:39.151400 run osmo-msc_10.42.42.6(pid=28234): stdout: | (launched: 2022-12-09_04:58:38.033101) 04:58:39.201355 run osmo-msc_10.42.42.6(pid=28234): stderr: | 20221209045838303 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209045838303 DLGLOBAL DEBUG validating counter group 0x7f7e5e7bac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209045838304 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209045838304 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209045838304 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209045838304 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209045838306 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209045838307 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209045838307 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209045838307 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:58:39.251592 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28227): Terminating (SIGTERM) 04:58:39.291976 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28230): Terminating (SIGTERM) 04:58:39.332003 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28233): Terminating (SIGTERM) 04:58:39.372217 --- ParallelTerminationStrategy: PID 28227 died... 04:58:39.391401 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28227): Terminated: ok {rc=0} 04:58:39.436515 --- ParallelTerminationStrategy: PID 28230 died... 04:58:39.455208 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28230): Terminated: ok {rc=0} 04:58:39.500098 --- ParallelTerminationStrategy: PID 28233 died... 04:58:39.519011 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28233): Terminated: ok {rc=0} 04:58:39.604630 bus /sierra_3: Setting Powered False 04:58:40.704870 bus /sierra_3: Setting Powered False 04:58:41.821304 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 handover_2G:trx-sysmocell5000+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 handover_2G:sysmo+bts1-trx-b200 --------------------------------------------------------------------- 04:58:43.100606 tst handover_2G:sysmo+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:58:43.106248 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 04:58:43.157449 tst handover_2G:sysmo+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 04:58:43.184563 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 04:58:43.236273 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 04:58:43.287618 tst handover_2G:sysmo+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 04:58:43.314922 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 04:58:43.870168 tst handover_2G:sysmo+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 handover_2G:sysmo+bts1-trx-b200 handover.py ---------------------------------------------- 04:58:43.875765 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:58:43.887140 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 04:58:43.925276 tst handover.py: using LAC 19253 04:58:44.049564 tst handover.py: using RAC 128 04:58:44.169198 tst handover.py: using CellId 19253 04:58:44.285592 tst handover.py: using BVCI 19254 04:58:44.404539 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 04:58:44.452664 tst handover.py: using LAC 19254 04:58:44.577177 tst handover.py: using RAC 129 04:58:44.701834 tst handover.py: using CellId 19254 04:58:44.829407 tst handover.py: using BVCI 19255 04:58:44.948389 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:58:44.959643 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:58:44.970634 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:58:44.981668 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:58:44.992716 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:58:45.003750 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 04:58:45.120346 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 04:58:45.236356 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:58:45.675417 run create_hlr_db(pid=28239): Launched 04:58:45.808690 bus /sierra_2: Setting Powered False 04:58:46.888166 run create_hlr_db(pid=28239): Terminated: ok {rc=0} 04:58:47.320848 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28241): Launched 04:58:47.622023 run osmo-hlr_10.42.42.2(pid=28242): Launched 04:58:47.736728 run osmo-stp_10.42.42.5: Starting osmo-stp 04:58:48.227103 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28244): Launched 04:58:48.527024 run osmo-stp_10.42.42.5(pid=28245): Launched 04:58:48.641734 run osmo-msc_10.42.42.6: Starting osmo-msc 04:58:49.157436 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28247): Launched 04:58:49.457844 run osmo-msc_10.42.42.6(pid=28248): Launched 04:58:49.626324 run osmo-stp_10.42.42.5(pid=28245): ERR: Terminated: ERROR {rc=1} [trial-2354↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28245)] 04:58:49.753852 run osmo-stp_10.42.42.5(pid=28245): stdout: | (launched: 2022-12-09_04:58:48.472003) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:58:49.881977 run osmo-stp_10.42.42.5(pid=28245): stderr: | 20221209045848641 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209045848641 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209045848642 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209045848642 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209045848643 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209045848643 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209045848643 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:58:50.008398 run osmo-stp_10.42.42.5(pid=28245): stdout: | (launched: 2022-12-09_04:58:48.472003) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:58:50.128049 run osmo-stp_10.42.42.5(pid=28245): stderr: | 20221209045848641 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209045848641 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209045848642 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209045848642 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209045848643 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209045848643 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209045848643 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:58:50.270957 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=28245): Process ended prematurely: osmo-stp_10.42.42.5(pid=28245) [trial-2354↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28245)] [trial-2354↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18] 04:58:50.279300 tst handover.py:18: Test FAILED (6.4 sec) 04:58:50.306284 run osmo-hlr_10.42.42.2(pid=28242): ERR: Terminated: ERROR {rc=237} [trial-2354↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28242)] 04:58:50.355708 run osmo-hlr_10.42.42.2(pid=28242): stdout: | (launched: 2022-12-09_04:58:47.567294) 04:58:50.406256 run osmo-hlr_10.42.42.2(pid=28242): stderr: | 20221209045847747 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209045847747 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209045847747 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209045847747 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209045847747 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209045847747 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209045847761 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/handover_2G:sysmo+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209045847771 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209045847771 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209045847771 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:58:50.476595 run osmo-msc_10.42.42.6(pid=28248): ERR: Terminated: ERROR {rc=2} [trial-2354↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28248)] 04:58:50.525635 run osmo-msc_10.42.42.6(pid=28248): stdout: | (launched: 2022-12-09_04:58:49.403019) 04:58:50.576226 run osmo-msc_10.42.42.6(pid=28248): stderr: | 20221209045849676 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209045849676 DLGLOBAL DEBUG validating counter group 0x7f59a5788c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209045849676 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209045849676 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209045849677 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209045849677 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209045849679 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209045849679 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209045849679 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209045849679 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:58:50.627347 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28241): Terminating (SIGTERM) 04:58:50.668098 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28244): Terminating (SIGTERM) 04:58:50.709126 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28247): Terminating (SIGTERM) 04:58:50.750502 --- ParallelTerminationStrategy: PID 28241 died... 04:58:50.769751 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28241): Terminated: ok {rc=0} 04:58:50.815403 --- ParallelTerminationStrategy: PID 28244 died... 04:58:50.834239 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28244): Terminated: ok {rc=0} 04:58:50.879823 --- ParallelTerminationStrategy: PID 28247 died... 04:58:50.898605 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28247): Terminated: ok {rc=0} 04:58:50.986775 bus /sierra_3: Setting Powered False 04:58:52.087750 bus /sierra_3: Setting Powered False 04:58:53.207352 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 handover_2G:sysmo+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 handover_2G:sysmo+bts1-trx-umtrx --------------------------------------------------------------------- 04:58:54.471264 tst handover_2G:sysmo+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:58:54.477129 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 04:58:54.528107 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 04:58:54.555270 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 04:58:54.608560 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 04:58:54.659491 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 04:58:54.686623 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 04:58:55.237536 tst handover_2G:sysmo+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 handover_2G:sysmo+bts1-trx-umtrx handover.py ---------------------------------------------- 04:58:55.243091 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:58:55.254338 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 04:58:55.289050 tst handover.py: using LAC 19255 04:58:55.415913 tst handover.py: using RAC 130 04:58:55.544792 tst handover.py: using CellId 19255 04:58:55.670709 tst handover.py: using BVCI 19256 04:58:55.787764 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 04:58:55.836868 tst handover.py: using LAC 19256 04:58:55.964887 tst handover.py: using RAC 131 04:58:56.084128 tst handover.py: using CellId 19256 04:58:56.203070 tst handover.py: using BVCI 19257 04:58:56.313547 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:58:56.324497 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:58:56.335245 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:58:56.346532 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:58:56.357746 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:58:56.368681 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 04:58:56.489187 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 04:58:56.603474 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:58:57.044776 run create_hlr_db(pid=28253): Launched 04:58:57.159939 bus /sierra_2: Setting Powered False 04:58:58.220872 run create_hlr_db(pid=28253): Terminated: ok {rc=0} 04:58:58.634578 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28255): Launched 04:58:58.957958 run osmo-hlr_10.42.42.2(pid=28256): Launched 04:58:59.081418 run osmo-stp_10.42.42.5: Starting osmo-stp 04:58:59.608705 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28258): Launched 04:58:59.931078 run osmo-stp_10.42.42.5(pid=28259): Launched 04:59:00.054742 run osmo-msc_10.42.42.6: Starting osmo-msc 04:59:00.610319 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28261): Launched 04:59:00.970148 run osmo-msc_10.42.42.6(pid=28262): Launched 04:59:01.344318 run osmo-stp_10.42.42.5(pid=28259): ERR: Terminated: ERROR {rc=1} [trial-2354↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28259)] 04:59:01.601220 run osmo-stp_10.42.42.5(pid=28259): stdout: | (launched: 2022-12-09_04:58:59.872156) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:59:01.850446 run osmo-stp_10.42.42.5(pid=28259): stderr: | 20221209045900065 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209045900065 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209045900065 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209045900066 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209045900066 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209045900066 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209045900066 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:59:02.006596 run osmo-stp_10.42.42.5(pid=28259): stdout: | (launched: 2022-12-09_04:58:59.872156) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:59:02.132256 run osmo-stp_10.42.42.5(pid=28259): stderr: | 20221209045900065 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209045900065 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209045900065 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209045900066 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209045900066 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209045900066 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209045900066 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:59:02.279569 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=28259): Process ended prematurely: osmo-stp_10.42.42.5(pid=28259) [trial-2354↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28259)] [trial-2354↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18] 04:59:02.288423 tst handover.py:18: Test FAILED (7.0 sec) 04:59:02.316319 run osmo-hlr_10.42.42.2(pid=28256): ERR: Terminated: ERROR {rc=237} [trial-2354↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28256)] 04:59:02.366234 run osmo-hlr_10.42.42.2(pid=28256): stdout: | (launched: 2022-12-09_04:58:58.899586) 04:59:02.417335 run osmo-hlr_10.42.42.2(pid=28256): stderr: | 20221209045859098 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209045859098 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209045859098 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209045859098 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209045859098 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209045859098 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209045859111 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/handover_2G:sysmo+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209045859119 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209045859120 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209045859120 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:59:02.488471 run osmo-msc_10.42.42.6(pid=28262): ERR: Terminated: ERROR {rc=2} [trial-2354↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28262)] 04:59:02.537644 run osmo-msc_10.42.42.6(pid=28262): stdout: | (launched: 2022-12-09_04:59:00.906180) 04:59:02.588539 run osmo-msc_10.42.42.6(pid=28262): stderr: | 20221209045901492 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209045901492 DLGLOBAL DEBUG validating counter group 0x7f79fde44c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209045901492 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209045901492 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209045901492 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209045901492 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209045901501 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209045901501 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209045901501 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209045901501 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:59:02.639769 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28255): Terminating (SIGTERM) 04:59:02.680911 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28258): Terminating (SIGTERM) 04:59:02.721707 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28261): Terminating (SIGTERM) 04:59:02.762866 --- ParallelTerminationStrategy: PID 28255 died... 04:59:02.781940 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28255): Terminated: ok {rc=0} 04:59:02.827942 --- ParallelTerminationStrategy: PID 28258 died... 04:59:02.847187 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28258): Terminated: ok {rc=0} 04:59:02.892840 --- ParallelTerminationStrategy: PID 28261 died... 04:59:02.912051 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28261): Terminated: ok {rc=0} 04:59:03.000450 bus /sierra_3: Setting Powered False 04:59:04.101427 bus /sierra_3: Setting Powered False 04:59:05.216792 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 handover_2G:sysmo+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2354 handover_2G:trx-b200+bts1-trx-umtrx --------------------------------------------------------------------- 04:59:06.477924 tst handover_2G:trx-b200+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:59:06.483542 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 04:59:06.546952 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 04:59:06.574560 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 04:59:06.627713 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 04:59:06.691642 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 04:59:06.718977 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 04:59:07.269209 tst handover_2G:trx-b200+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts Ettus B200 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2354 handover_2G:trx-b200+bts1-trx-umtrx handover.py ---------------------------------------------- 04:59:07.274814 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:59:07.286126 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 04:59:07.334642 tst handover.py: using LAC 19257 04:59:07.461938 tst handover.py: using RAC 132 04:59:07.591767 tst handover.py: using CellId 19257 04:59:07.717793 tst handover.py: using BVCI 19258 04:59:07.828316 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 04:59:07.874215 tst handover.py: using LAC 19258 04:59:07.992781 tst handover.py: using RAC 133 04:59:08.109067 tst handover.py: using CellId 19258 04:59:08.225408 tst handover.py: using BVCI 19259 04:59:08.334122 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:59:08.345127 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:59:08.355740 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:59:08.366850 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:59:08.377834 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:59:08.388758 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 04:59:08.505736 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 04:59:08.622768 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:59:09.062005 run create_hlr_db(pid=28267): Launched 04:59:09.176386 bus /sierra_2: Setting Powered False 04:59:10.236802 run create_hlr_db(pid=28267): Terminated: ok {rc=0} 04:59:10.649182 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28269): Launched 04:59:10.971809 run osmo-hlr_10.42.42.2(pid=28270): Launched 04:59:11.095761 run osmo-stp_10.42.42.5: Starting osmo-stp 04:59:11.627214 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28272): Launched 04:59:11.949450 run osmo-stp_10.42.42.5(pid=28273): Launched 04:59:12.072609 run osmo-msc_10.42.42.6: Starting osmo-msc 04:59:12.625757 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28275): Launched 04:59:12.948341 run osmo-msc_10.42.42.6(pid=28276): Launched 04:59:13.128085 run osmo-stp_10.42.42.5(pid=28273): ERR: Terminated: ERROR {rc=1} [trial-2354↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28273)] 04:59:13.263736 run osmo-stp_10.42.42.5(pid=28273): stdout: | (launched: 2022-12-09_04:59:11.890868) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:59:13.400073 run osmo-stp_10.42.42.5(pid=28273): stderr: | 20221209045912083 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209045912083 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209045912083 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209045912084 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209045912084 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209045912084 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209045912084 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:59:13.535998 run osmo-stp_10.42.42.5(pid=28273): stdout: | (launched: 2022-12-09_04:59:11.890868) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:59:13.664808 run osmo-stp_10.42.42.5(pid=28273): stderr: | 20221209045912083 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209045912083 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209045912083 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209045912084 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209045912084 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209045912084 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209045912084 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:59:13.818601 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=28273): Process ended prematurely: osmo-stp_10.42.42.5(pid=28273) [trial-2354↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28273)] [trial-2354↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18] 04:59:13.827567 tst handover.py:18: Test FAILED (6.5 sec) 04:59:13.855767 run osmo-hlr_10.42.42.2(pid=28270): ERR: Terminated: ERROR {rc=237} [trial-2354↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28270)] 04:59:13.906585 run osmo-hlr_10.42.42.2(pid=28270): stdout: | (launched: 2022-12-09_04:59:10.913562) 04:59:13.959095 run osmo-hlr_10.42.42.2(pid=28270): stderr: | 20221209045911110 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209045911110 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209045911110 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209045911110 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209045911110 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209045911110 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209045911123 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/handover_2G:trx-b200+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209045911131 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209045911131 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209045911131 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:59:14.032344 run osmo-msc_10.42.42.6(pid=28276): ERR: Terminated: ERROR {rc=2} [trial-2354↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28276)] 04:59:14.082872 run osmo-msc_10.42.42.6(pid=28276): stdout: | (launched: 2022-12-09_04:59:12.889836) 04:59:14.134953 run osmo-msc_10.42.42.6(pid=28276): stderr: | 20221209045913211 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209045913211 DLGLOBAL DEBUG validating counter group 0x7f22ec0e9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209045913211 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209045913211 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209045913211 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209045913211 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209045913213 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209045913213 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209045913214 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209045913214 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:59:14.187451 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28269): Terminating (SIGTERM) 04:59:14.229423 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28272): Terminating (SIGTERM) 04:59:14.271446 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28275): Terminating (SIGTERM) 04:59:14.314003 --- ParallelTerminationStrategy: PID 28269 died... 04:59:14.334152 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28269): Terminated: ok {rc=0} 04:59:14.381572 --- ParallelTerminationStrategy: PID 28272 died... 04:59:14.401239 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28272): Terminated: ok {rc=0} 04:59:14.448092 --- ParallelTerminationStrategy: PID 28275 died... 04:59:14.468066 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28275): Terminated: ok {rc=0} 04:59:14.556408 bus /sierra_3: Setting Powered False 04:59:15.655436 bus /sierra_3: Setting Powered False 04:59:16.774167 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2354 handover_2G:trx-b200+bts1-trx-umtrx FAIL --------------------------------------------------------------------- 04:59:18.050207 tst trial-2354: Storing JUnit report in /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354/run.2022-12-09_03-35-04/trial-2354.xml -------------------------------------------------------------------------------------------- trial-2354 FAIL -------------------------------------------------------------------------------------------- 04:59:19.975277 tst trial-2354: trial-2354: FAIL, 200 suites failed FAIL: nitb_sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (5.2 sec) Error: osmo-nitb_10.42.42.2(pid=19280): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19280) [trial-2354↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19280)] FAIL: sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (14.5 sec) Error: osmo-stp_10.42.42.5(pid=19290): Process ended prematurely: osmo-stp_10.42.42.5(pid=19290) [trial-2354↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19290)] FAIL: nitb_ussd:sysmo (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=19305): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19305) [trial-2354↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19305)] FAIL: ussd:sysmo (fail: 1) FAIL: assert_extension.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=19315): Process ended prematurely: osmo-stp_10.42.42.5(pid=19315) [trial-2354↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19315)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=19351): Process ended prematurely: osmo-stp_10.42.42.5(pid=19351) [trial-2354↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19351)] FAIL: mo_mt_call_osmux.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=19611): Process ended prematurely: osmo-stp_10.42.42.5(pid=19611) [trial-2354↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19611)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=19626): Process ended prematurely: osmo-stp_10.42.42.5(pid=19626) [trial-2354↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19626)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=19637): Process ended prematurely: osmo-stp_10.42.42.5(pid=19637) [trial-2354↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19637)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=19651): Process ended prematurely: osmo-stp_10.42.42.5(pid=19651) [trial-2354↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19651)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=19662): Process ended prematurely: osmo-stp_10.42.42.5(pid=19662) [trial-2354↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19662)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=19676): Process ended prematurely: osmo-stp_10.42.42.5(pid=19676) [trial-2354↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19676)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=19688): Process ended prematurely: osmo-stp_10.42.42.5(pid=19688) [trial-2354↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19688)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=19702): Process ended prematurely: osmo-stp_10.42.42.5(pid=19702) [trial-2354↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19702)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=19713): Process ended prematurely: osmo-stp_10.42.42.5(pid=19713) [trial-2354↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19713)] FAIL: voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=19727): Process ended prematurely: osmo-stp_10.42.42.5(pid=19727) [trial-2354↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19727)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=19747): Process ended prematurely: osmo-stp_10.42.42.5(pid=19747) [trial-2354↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19747)] FAIL: voice:sysmo+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=19761): Process ended prematurely: osmo-stp_10.42.42.5(pid=19761) [trial-2354↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19761)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=19772): Process ended prematurely: osmo-stp_10.42.42.5(pid=19772) [trial-2354↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19772)] FAIL: emergency:sysmo (fail: 2) FAIL: emergency_mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=19788): Process ended prematurely: osmo-stp_10.42.42.5(pid=19788) [trial-2354↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19788)] FAIL: emergency_preemptive_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=19800): Process ended prematurely: osmo-stp_10.42.42.5(pid=19800) [trial-2354↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19800)] FAIL: gprs:sysmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.7 sec) Error: osmo-stp_10.42.42.5(pid=19818): Process ended prematurely: osmo-stp_10.42.42.5(pid=19818) [trial-2354↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19818)] FAIL: iperf3.py (8.1 sec) Error: osmo-stp_10.42.42.5(pid=19830): Process ended prematurely: osmo-stp_10.42.42.5(pid=19830) [trial-2354↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19830)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=19848): Process ended prematurely: osmo-stp_10.42.42.5(pid=19848) [trial-2354↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19848)] FAIL: ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=19858): Process ended prematurely: osmo-stp_10.42.42.5(pid=19858) [trial-2354↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19858)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=19868): Process ended prematurely: osmo-stp_10.42.42.5(pid=19868) [trial-2354↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19868)] FAIL: gprs:sysmo+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=19893): Process ended prematurely: osmo-stp_10.42.42.5(pid=19893) [trial-2354↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19893)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=19905): Process ended prematurely: osmo-stp_10.42.42.5(pid=19905) [trial-2354↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19905)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=19923): Process ended prematurely: osmo-stp_10.42.42.5(pid=19923) [trial-2354↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19923)] FAIL: ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=19933): Process ended prematurely: osmo-stp_10.42.42.5(pid=19933) [trial-2354↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19933)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=19943): Process ended prematurely: osmo-stp_10.42.42.5(pid=19943) [trial-2354↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19943)] FAIL: gprs:sysmo+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=19960): Process ended prematurely: osmo-stp_10.42.42.5(pid=19960) [trial-2354↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19960)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=19984): Process ended prematurely: osmo-stp_10.42.42.5(pid=19984) [trial-2354↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19984)] FAIL: iperf3m4.py (11.6 sec) Error: osmo-stp_10.42.42.5(pid=20002): Process ended prematurely: osmo-stp_10.42.42.5(pid=20002) [trial-2354↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20002)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=20012): Process ended prematurely: osmo-stp_10.42.42.5(pid=20012) [trial-2354↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20012)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=20022): Process ended prematurely: osmo-stp_10.42.42.5(pid=20022) [trial-2354↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20022)] FAIL: gprs:sysmo+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=20039): Process ended prematurely: osmo-stp_10.42.42.5(pid=20039) [trial-2354↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20039)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=20051): Process ended prematurely: osmo-stp_10.42.42.5(pid=20051) [trial-2354↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20051)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=20070): Process ended prematurely: osmo-stp_10.42.42.5(pid=20070) [trial-2354↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20070)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=20080): Process ended prematurely: osmo-stp_10.42.42.5(pid=20080) [trial-2354↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20080)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=20091): Process ended prematurely: osmo-stp_10.42.42.5(pid=20091) [trial-2354↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20091)] FAIL: dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=20107): Process ended prematurely: osmo-stp_10.42.42.5(pid=20107) [trial-2354↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20107)] FAIL: dynts:sysmo+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=20120): Process ended prematurely: osmo-stp_10.42.42.5(pid=20120) [trial-2354↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20120)] FAIL: nitb_sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=20129): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20129) [trial-2354↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20129)] FAIL: sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=20139): Process ended prematurely: osmo-stp_10.42.42.5(pid=20139) [trial-2354↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20139)] FAIL: nitb_ussd:oc2g (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=20148): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20148) [trial-2354↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20148)] FAIL: ussd:oc2g (fail: 1) FAIL: assert_extension.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=20158): Process ended prematurely: osmo-stp_10.42.42.5(pid=20158) [trial-2354↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20158)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=20173): Process ended prematurely: osmo-stp_10.42.42.5(pid=20173) [trial-2354↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20173)] FAIL: mo_mt_call_osmux.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=20184): Process ended prematurely: osmo-stp_10.42.42.5(pid=20184) [trial-2354↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20184)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=20198): Process ended prematurely: osmo-stp_10.42.42.5(pid=20198) [trial-2354↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20198)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=20209): Process ended prematurely: osmo-stp_10.42.42.5(pid=20209) [trial-2354↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20209)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=20224): Process ended prematurely: osmo-stp_10.42.42.5(pid=20224) [trial-2354↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20224)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=20235): Process ended prematurely: osmo-stp_10.42.42.5(pid=20235) [trial-2354↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20235)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=20249): Process ended prematurely: osmo-stp_10.42.42.5(pid=20249) [trial-2354↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20249)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=20260): Process ended prematurely: osmo-stp_10.42.42.5(pid=20260) [trial-2354↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20260)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=20274): Process ended prematurely: osmo-stp_10.42.42.5(pid=20274) [trial-2354↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20274)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=20288): Process ended prematurely: osmo-stp_10.42.42.5(pid=20288) [trial-2354↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20288)] FAIL: voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=20302): Process ended prematurely: osmo-stp_10.42.42.5(pid=20302) [trial-2354↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20302)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=20313): Process ended prematurely: osmo-stp_10.42.42.5(pid=20313) [trial-2354↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20313)] FAIL: voice:oc2g+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=20327): Process ended prematurely: osmo-stp_10.42.42.5(pid=20327) [trial-2354↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20327)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=20338): Process ended prematurely: osmo-stp_10.42.42.5(pid=20338) [trial-2354↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20338)] FAIL: emergency:oc2g (fail: 2) FAIL: emergency_mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=20352): Process ended prematurely: osmo-stp_10.42.42.5(pid=20352) [trial-2354↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20352)] FAIL: emergency_preemptive_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=20363): Process ended prematurely: osmo-stp_10.42.42.5(pid=20363) [trial-2354↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20363)] FAIL: gprs:oc2g (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=20381): Process ended prematurely: osmo-stp_10.42.42.5(pid=20381) [trial-2354↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20381)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=20393): Process ended prematurely: osmo-stp_10.42.42.5(pid=20393) [trial-2354↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20393)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=20412): Process ended prematurely: osmo-stp_10.42.42.5(pid=20412) [trial-2354↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20412)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=20423): Process ended prematurely: osmo-stp_10.42.42.5(pid=20423) [trial-2354↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20423)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=20434): Process ended prematurely: osmo-stp_10.42.42.5(pid=20434) [trial-2354↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20434)] FAIL: gprs:oc2g+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=20451): Process ended prematurely: osmo-stp_10.42.42.5(pid=20451) [trial-2354↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20451)] FAIL: iperf3.py (7.2 sec) Error: osmo-stp_10.42.42.5(pid=20466): Process ended prematurely: osmo-stp_10.42.42.5(pid=20466) [trial-2354↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20466)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=20484): Process ended prematurely: osmo-stp_10.42.42.5(pid=20484) [trial-2354↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20484)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=20494): Process ended prematurely: osmo-stp_10.42.42.5(pid=20494) [trial-2354↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20494)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=20504): Process ended prematurely: osmo-stp_10.42.42.5(pid=20504) [trial-2354↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20504)] FAIL: gprs:oc2g+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=20521): Process ended prematurely: osmo-stp_10.42.42.5(pid=20521) [trial-2354↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20521)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=20533): Process ended prematurely: osmo-stp_10.42.42.5(pid=20533) [trial-2354↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20533)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=20551): Process ended prematurely: osmo-stp_10.42.42.5(pid=20551) [trial-2354↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20551)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=20561): Process ended prematurely: osmo-stp_10.42.42.5(pid=20561) [trial-2354↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20561)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=20571): Process ended prematurely: osmo-stp_10.42.42.5(pid=20571) [trial-2354↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20571)] FAIL: gprs:oc2g+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=20590): Process ended prematurely: osmo-stp_10.42.42.5(pid=20590) [trial-2354↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20590)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=20602): Process ended prematurely: osmo-stp_10.42.42.5(pid=20602) [trial-2354↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20602)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=20620): Process ended prematurely: osmo-stp_10.42.42.5(pid=20620) [trial-2354↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20620)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=20634): Process ended prematurely: osmo-stp_10.42.42.5(pid=20634) [trial-2354↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20634)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=20644): Process ended prematurely: osmo-stp_10.42.42.5(pid=20644) [trial-2354↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20644)] FAIL: dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=20657): Process ended prematurely: osmo-stp_10.42.42.5(pid=20657) [trial-2354↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20657)] FAIL: dynts:oc2g+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=20941): Process ended prematurely: osmo-stp_10.42.42.5(pid=20941) [trial-2354↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20941)] FAIL: nitb_sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (3.5 sec) Error: osmo-nitb_10.42.42.2(pid=20950): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20950) [trial-2354↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20950)] FAIL: sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=20960): Process ended prematurely: osmo-stp_10.42.42.5(pid=20960) [trial-2354↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20960)] FAIL: nitb_ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=20969): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20969) [trial-2354↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20969)] FAIL: ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (5.7 sec) Error: osmo-stp_10.42.42.5(pid=20980): Process ended prematurely: osmo-stp_10.42.42.5(pid=20980) [trial-2354↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20980)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=20994): Process ended prematurely: osmo-stp_10.42.42.5(pid=20994) [trial-2354↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20994)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=21005): Process ended prematurely: osmo-stp_10.42.42.5(pid=21005) [trial-2354↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21005)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=21020): Process ended prematurely: osmo-stp_10.42.42.5(pid=21020) [trial-2354↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21020)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=21031): Process ended prematurely: osmo-stp_10.42.42.5(pid=21031) [trial-2354↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21031)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=21046): Process ended prematurely: osmo-stp_10.42.42.5(pid=21046) [trial-2354↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21046)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=21058): Process ended prematurely: osmo-stp_10.42.42.5(pid=21058) [trial-2354↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21058)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=21073): Process ended prematurely: osmo-stp_10.42.42.5(pid=21073) [trial-2354↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21073)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=21087): Process ended prematurely: osmo-stp_10.42.42.5(pid=21087) [trial-2354↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21087)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=21101): Process ended prematurely: osmo-stp_10.42.42.5(pid=21101) [trial-2354↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21101)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=21112): Process ended prematurely: osmo-stp_10.42.42.5(pid=21112) [trial-2354↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21112)] FAIL: voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=21126): Process ended prematurely: osmo-stp_10.42.42.5(pid=21126) [trial-2354↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21126)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=21137): Process ended prematurely: osmo-stp_10.42.42.5(pid=21137) [trial-2354↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21137)] FAIL: voice:trx-b200+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=21151): Process ended prematurely: osmo-stp_10.42.42.5(pid=21151) [trial-2354↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21151)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=21163): Process ended prematurely: osmo-stp_10.42.42.5(pid=21163) [trial-2354↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21163)] FAIL: voice:trx-b200+mod-bts0-trxdversion0 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=21177): Process ended prematurely: osmo-stp_10.42.42.5(pid=21177) [trial-2354↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21177)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=21188): Process ended prematurely: osmo-stp_10.42.42.5(pid=21188) [trial-2354↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21188)] FAIL: voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=21203): Process ended prematurely: osmo-stp_10.42.42.5(pid=21203) [trial-2354↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21203)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=21214): Process ended prematurely: osmo-stp_10.42.42.5(pid=21214) [trial-2354↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21214)] FAIL: emergency:trx-b200 (fail: 2) FAIL: emergency_mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=21228): Process ended prematurely: osmo-stp_10.42.42.5(pid=21228) [trial-2354↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21228)] FAIL: emergency_preemptive_call.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=21239): Process ended prematurely: osmo-stp_10.42.42.5(pid=21239) [trial-2354↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21239)] FAIL: gprs:trx-b200 (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=21257): Process ended prematurely: osmo-stp_10.42.42.5(pid=21257) [trial-2354↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21257)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=21273): Process ended prematurely: osmo-stp_10.42.42.5(pid=21273) [trial-2354↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21273)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=21291): Process ended prematurely: osmo-stp_10.42.42.5(pid=21291) [trial-2354↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21291)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=21302): Process ended prematurely: osmo-stp_10.42.42.5(pid=21302) [trial-2354↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21302)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=21312): Process ended prematurely: osmo-stp_10.42.42.5(pid=21312) [trial-2354↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21312)] FAIL: gprs:trx-b200+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=21329): Process ended prematurely: osmo-stp_10.42.42.5(pid=21329) [trial-2354↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21329)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=21343): Process ended prematurely: osmo-stp_10.42.42.5(pid=21343) [trial-2354↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21343)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=21361): Process ended prematurely: osmo-stp_10.42.42.5(pid=21361) [trial-2354↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21361)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=21371): Process ended prematurely: osmo-stp_10.42.42.5(pid=21371) [trial-2354↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21371)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=21381): Process ended prematurely: osmo-stp_10.42.42.5(pid=21381) [trial-2354↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21381)] FAIL: gprs:trx-b200+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=21398): Process ended prematurely: osmo-stp_10.42.42.5(pid=21398) [trial-2354↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21398)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=21410): Process ended prematurely: osmo-stp_10.42.42.5(pid=21410) [trial-2354↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21410)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=21428): Process ended prematurely: osmo-stp_10.42.42.5(pid=21428) [trial-2354↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21428)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=21442): Process ended prematurely: osmo-stp_10.42.42.5(pid=21442) [trial-2354↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21442)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=21452): Process ended prematurely: osmo-stp_10.42.42.5(pid=21452) [trial-2354↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21452)] FAIL: gprs:trx-b200+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.1 sec) Error: osmo-stp_10.42.42.5(pid=21469): Process ended prematurely: osmo-stp_10.42.42.5(pid=21469) [trial-2354↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21469)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=21481): Process ended prematurely: osmo-stp_10.42.42.5(pid=21481) [trial-2354↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21481)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=21499): Process ended prematurely: osmo-stp_10.42.42.5(pid=21499) [trial-2354↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21499)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=21509): Process ended prematurely: osmo-stp_10.42.42.5(pid=21509) [trial-2354↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21509)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=21519): Process ended prematurely: osmo-stp_10.42.42.5(pid=21519) [trial-2354↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21519)] FAIL: gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=21538): Process ended prematurely: osmo-stp_10.42.42.5(pid=21538) [trial-2354↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21538)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=21550): Process ended prematurely: osmo-stp_10.42.42.5(pid=21550) [trial-2354↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21550)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=21568): Process ended prematurely: osmo-stp_10.42.42.5(pid=21568) [trial-2354↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21568)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=21578): Process ended prematurely: osmo-stp_10.42.42.5(pid=21578) [trial-2354↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21578)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=21588): Process ended prematurely: osmo-stp_10.42.42.5(pid=21588) [trial-2354↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21588)] FAIL: dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=21601): Process ended prematurely: osmo-stp_10.42.42.5(pid=21601) [trial-2354↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21601)] FAIL: dynts:trx-b200+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=21620): Process ended prematurely: osmo-stp_10.42.42.5(pid=21620) [trial-2354↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21620)] FAIL: nitb_sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=21628): Process ended prematurely: osmo-nitb_10.42.42.2(pid=21628) [trial-2354↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21628)] FAIL: sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=21638): Process ended prematurely: osmo-stp_10.42.42.5(pid=21638) [trial-2354↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21638)] FAIL: nitb_ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=21648): Process ended prematurely: osmo-nitb_10.42.42.2(pid=21648) [trial-2354↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21648)] FAIL: ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=21658): Process ended prematurely: osmo-stp_10.42.42.5(pid=21658) [trial-2354↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21658)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=21672): Process ended prematurely: osmo-stp_10.42.42.5(pid=21672) [trial-2354↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21672)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=21683): Process ended prematurely: osmo-stp_10.42.42.5(pid=21683) [trial-2354↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21683)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=21697): Process ended prematurely: osmo-stp_10.42.42.5(pid=21697) [trial-2354↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21697)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=21708): Process ended prematurely: osmo-stp_10.42.42.5(pid=21708) [trial-2354↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21708)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=21722): Process ended prematurely: osmo-stp_10.42.42.5(pid=21722) [trial-2354↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21722)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=21733): Process ended prematurely: osmo-stp_10.42.42.5(pid=21733) [trial-2354↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21733)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=21747): Process ended prematurely: osmo-stp_10.42.42.5(pid=21747) [trial-2354↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21747)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=21758): Process ended prematurely: osmo-stp_10.42.42.5(pid=21758) [trial-2354↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21758)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=21773): Process ended prematurely: osmo-stp_10.42.42.5(pid=21773) [trial-2354↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21773)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=21784): Process ended prematurely: osmo-stp_10.42.42.5(pid=21784) [trial-2354↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21784)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=21801): Process ended prematurely: osmo-stp_10.42.42.5(pid=21801) [trial-2354↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21801)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=21813): Process ended prematurely: osmo-stp_10.42.42.5(pid=21813) [trial-2354↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21813)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=21827): Process ended prematurely: osmo-stp_10.42.42.5(pid=21827) [trial-2354↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21827)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=21838): Process ended prematurely: osmo-stp_10.42.42.5(pid=21838) [trial-2354↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21838)] FAIL: emergency:trx-sysmocell5000 (fail: 2) FAIL: emergency_mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=21853): Process ended prematurely: osmo-stp_10.42.42.5(pid=21853) [trial-2354↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21853)] FAIL: emergency_preemptive_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=21864): Process ended prematurely: osmo-stp_10.42.42.5(pid=21864) [trial-2354↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21864)] FAIL: gprs:trx-sysmocell5000 (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=21886): Process ended prematurely: osmo-stp_10.42.42.5(pid=21886) [trial-2354↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21886)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=21898): Process ended prematurely: osmo-stp_10.42.42.5(pid=21898) [trial-2354↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21898)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=21916): Process ended prematurely: osmo-stp_10.42.42.5(pid=21916) [trial-2354↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21916)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=21927): Process ended prematurely: osmo-stp_10.42.42.5(pid=21927) [trial-2354↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21927)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=21937): Process ended prematurely: osmo-stp_10.42.42.5(pid=21937) [trial-2354↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21937)] FAIL: gprs:trx-sysmocell5000+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=21954): Process ended prematurely: osmo-stp_10.42.42.5(pid=21954) [trial-2354↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21954)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=21968): Process ended prematurely: osmo-stp_10.42.42.5(pid=21968) [trial-2354↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21968)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=21986): Process ended prematurely: osmo-stp_10.42.42.5(pid=21986) [trial-2354↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21986)] FAIL: ping.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=22266): Process ended prematurely: osmo-stp_10.42.42.5(pid=22266) [trial-2354↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22266)] FAIL: ping_idle_ping.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=22278): Process ended prematurely: osmo-stp_10.42.42.5(pid=22278) [trial-2354↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22278)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=22295): Process ended prematurely: osmo-stp_10.42.42.5(pid=22295) [trial-2354↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22295)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=22307): Process ended prematurely: osmo-stp_10.42.42.5(pid=22307) [trial-2354↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22307)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=22325): Process ended prematurely: osmo-stp_10.42.42.5(pid=22325) [trial-2354↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22325)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=22336): Process ended prematurely: osmo-stp_10.42.42.5(pid=22336) [trial-2354↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22336)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=22346): Process ended prematurely: osmo-stp_10.42.42.5(pid=22346) [trial-2354↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22346)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=22365): Process ended prematurely: osmo-stp_10.42.42.5(pid=22365) [trial-2354↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22365)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=22377): Process ended prematurely: osmo-stp_10.42.42.5(pid=22377) [trial-2354↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22377)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=22395): Process ended prematurely: osmo-stp_10.42.42.5(pid=22395) [trial-2354↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22395)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=22417): Process ended prematurely: osmo-stp_10.42.42.5(pid=22417) [trial-2354↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22417)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=22608): Process ended prematurely: osmo-stp_10.42.42.5(pid=22608) [trial-2354↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22608)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=22886): Process ended prematurely: osmo-stp_10.42.42.5(pid=22886) [trial-2354↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22886)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=22981): Process ended prematurely: osmo-stp_10.42.42.5(pid=22981) [trial-2354↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22981)] FAIL: nitb_sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=22990): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22990) [trial-2354↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22990)] FAIL: sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=23000): Process ended prematurely: osmo-stp_10.42.42.5(pid=23000) [trial-2354↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23000)] FAIL: nitb_ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=23009): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23009) [trial-2354↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23009)] FAIL: ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=23020): Process ended prematurely: osmo-stp_10.42.42.5(pid=23020) [trial-2354↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23020)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=23035): Process ended prematurely: osmo-stp_10.42.42.5(pid=23035) [trial-2354↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23035)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=23046): Process ended prematurely: osmo-stp_10.42.42.5(pid=23046) [trial-2354↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23046)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=23060): Process ended prematurely: osmo-stp_10.42.42.5(pid=23060) [trial-2354↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23060)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=23071): Process ended prematurely: osmo-stp_10.42.42.5(pid=23071) [trial-2354↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23071)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=23085): Process ended prematurely: osmo-stp_10.42.42.5(pid=23085) [trial-2354↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23085)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=23096): Process ended prematurely: osmo-stp_10.42.42.5(pid=23096) [trial-2354↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23096)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=23111): Process ended prematurely: osmo-stp_10.42.42.5(pid=23111) [trial-2354↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23111)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=23122): Process ended prematurely: osmo-stp_10.42.42.5(pid=23122) [trial-2354↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23122)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=23136): Process ended prematurely: osmo-stp_10.42.42.5(pid=23136) [trial-2354↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23136)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=23147): Process ended prematurely: osmo-stp_10.42.42.5(pid=23147) [trial-2354↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23147)] FAIL: voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=23161): Process ended prematurely: osmo-stp_10.42.42.5(pid=23161) [trial-2354↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23161)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=23172): Process ended prematurely: osmo-stp_10.42.42.5(pid=23172) [trial-2354↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23172)] FAIL: voice:trx-umtrx+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=23186): Process ended prematurely: osmo-stp_10.42.42.5(pid=23186) [trial-2354↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23186)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=23197): Process ended prematurely: osmo-stp_10.42.42.5(pid=23197) [trial-2354↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23197)] FAIL: voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=23211): Process ended prematurely: osmo-stp_10.42.42.5(pid=23211) [trial-2354↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23211)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=23222): Process ended prematurely: osmo-stp_10.42.42.5(pid=23222) [trial-2354↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23222)] FAIL: emergency:trx-umtrx (fail: 2) FAIL: emergency_mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=23236): Process ended prematurely: osmo-stp_10.42.42.5(pid=23236) [trial-2354↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23236)] FAIL: emergency_preemptive_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=23247): Process ended prematurely: osmo-stp_10.42.42.5(pid=23247) [trial-2354↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23247)] FAIL: gprs:trx-umtrx (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=23267): Process ended prematurely: osmo-stp_10.42.42.5(pid=23267) [trial-2354↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23267)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=23279): Process ended prematurely: osmo-stp_10.42.42.5(pid=23279) [trial-2354↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23279)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=23300): Process ended prematurely: osmo-stp_10.42.42.5(pid=23300) [trial-2354↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23300)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=23310): Process ended prematurely: osmo-stp_10.42.42.5(pid=23310) [trial-2354↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23310)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=23320): Process ended prematurely: osmo-stp_10.42.42.5(pid=23320) [trial-2354↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23320)] FAIL: gprs:trx-umtrx+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=23337): Process ended prematurely: osmo-stp_10.42.42.5(pid=23337) [trial-2354↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23337)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=23349): Process ended prematurely: osmo-stp_10.42.42.5(pid=23349) [trial-2354↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23349)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=23368): Process ended prematurely: osmo-stp_10.42.42.5(pid=23368) [trial-2354↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23368)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=23378): Process ended prematurely: osmo-stp_10.42.42.5(pid=23378) [trial-2354↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23378)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=23388): Process ended prematurely: osmo-stp_10.42.42.5(pid=23388) [trial-2354↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23388)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=23405): Process ended prematurely: osmo-stp_10.42.42.5(pid=23405) [trial-2354↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23405)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=23417): Process ended prematurely: osmo-stp_10.42.42.5(pid=23417) [trial-2354↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23417)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=23438): Process ended prematurely: osmo-stp_10.42.42.5(pid=23438) [trial-2354↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23438)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=23448): Process ended prematurely: osmo-stp_10.42.42.5(pid=23448) [trial-2354↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23448)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=23458): Process ended prematurely: osmo-stp_10.42.42.5(pid=23458) [trial-2354↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23458)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=23476): Process ended prematurely: osmo-stp_10.42.42.5(pid=23476) [trial-2354↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23476)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=23488): Process ended prematurely: osmo-stp_10.42.42.5(pid=23488) [trial-2354↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23488)] FAIL: iperf3m4.py (10.3 sec) Error: osmo-stp_10.42.42.5(pid=23506): Process ended prematurely: osmo-stp_10.42.42.5(pid=23506) [trial-2354↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23506)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=23516): Process ended prematurely: osmo-stp_10.42.42.5(pid=23516) [trial-2354↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23516)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=23526): Process ended prematurely: osmo-stp_10.42.42.5(pid=23526) [trial-2354↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23526)] FAIL: gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=23543): Process ended prematurely: osmo-stp_10.42.42.5(pid=23543) [trial-2354↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23543)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=23555): Process ended prematurely: osmo-stp_10.42.42.5(pid=23555) [trial-2354↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23555)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=23573): Process ended prematurely: osmo-stp_10.42.42.5(pid=23573) [trial-2354↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23573)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=23583): Process ended prematurely: osmo-stp_10.42.42.5(pid=23583) [trial-2354↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23583)] FAIL: ping_idle_ping.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=23593): Process ended prematurely: osmo-stp_10.42.42.5(pid=23593) [trial-2354↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23593)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=23607): Process ended prematurely: osmo-stp_10.42.42.5(pid=23607) [trial-2354↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23607)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=23621): Process ended prematurely: osmo-stp_10.42.42.5(pid=23621) [trial-2354↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23621)] FAIL: nitb_sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=23629): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23629) [trial-2354↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23629)] FAIL: sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=23642): Process ended prematurely: osmo-stp_10.42.42.5(pid=23642) [trial-2354↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23642)] FAIL: nitb_ussd:trx-lms (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=23652): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23652) [trial-2354↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23652)] FAIL: ussd:trx-lms (fail: 1) FAIL: assert_extension.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=23662): Process ended prematurely: osmo-stp_10.42.42.5(pid=23662) [trial-2354↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23662)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=23676): Process ended prematurely: osmo-stp_10.42.42.5(pid=23676) [trial-2354↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23676)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=23687): Process ended prematurely: osmo-stp_10.42.42.5(pid=23687) [trial-2354↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23687)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=23701): Process ended prematurely: osmo-stp_10.42.42.5(pid=23701) [trial-2354↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23701)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=23713): Process ended prematurely: osmo-stp_10.42.42.5(pid=23713) [trial-2354↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23713)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=23727): Process ended prematurely: osmo-stp_10.42.42.5(pid=23727) [trial-2354↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23727)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=23738): Process ended prematurely: osmo-stp_10.42.42.5(pid=23738) [trial-2354↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23738)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=23752): Process ended prematurely: osmo-stp_10.42.42.5(pid=23752) [trial-2354↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23752)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=23763): Process ended prematurely: osmo-stp_10.42.42.5(pid=23763) [trial-2354↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23763)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=23778): Process ended prematurely: osmo-stp_10.42.42.5(pid=23778) [trial-2354↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23778)] FAIL: mo_mt_call_osmux.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=23789): Process ended prematurely: osmo-stp_10.42.42.5(pid=23789) [trial-2354↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23789)] FAIL: voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=23804): Process ended prematurely: osmo-stp_10.42.42.5(pid=23804) [trial-2354↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23804)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=23815): Process ended prematurely: osmo-stp_10.42.42.5(pid=23815) [trial-2354↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23815)] FAIL: voice:trx-lms+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=23830): Process ended prematurely: osmo-stp_10.42.42.5(pid=23830) [trial-2354↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23830)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=23841): Process ended prematurely: osmo-stp_10.42.42.5(pid=23841) [trial-2354↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23841)] FAIL: emergency:trx-lms (fail: 2) FAIL: emergency_mo_mt_call.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=23855): Process ended prematurely: osmo-stp_10.42.42.5(pid=23855) [trial-2354↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23855)] FAIL: emergency_preemptive_call.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=24137): Process ended prematurely: osmo-stp_10.42.42.5(pid=24137) [trial-2354↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24137)] FAIL: gprs:trx-lms (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=24156): Process ended prematurely: osmo-stp_10.42.42.5(pid=24156) [trial-2354↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24156)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=24168): Process ended prematurely: osmo-stp_10.42.42.5(pid=24168) [trial-2354↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24168)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=24186): Process ended prematurely: osmo-stp_10.42.42.5(pid=24186) [trial-2354↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24186)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=24197): Process ended prematurely: osmo-stp_10.42.42.5(pid=24197) [trial-2354↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24197)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=24207): Process ended prematurely: osmo-stp_10.42.42.5(pid=24207) [trial-2354↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24207)] FAIL: gprs:trx-lms+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=24224): Process ended prematurely: osmo-stp_10.42.42.5(pid=24224) [trial-2354↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24224)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=24236): Process ended prematurely: osmo-stp_10.42.42.5(pid=24236) [trial-2354↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24236)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=24254): Process ended prematurely: osmo-stp_10.42.42.5(pid=24254) [trial-2354↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24254)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=24267): Process ended prematurely: osmo-stp_10.42.42.5(pid=24267) [trial-2354↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24267)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=24277): Process ended prematurely: osmo-stp_10.42.42.5(pid=24277) [trial-2354↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24277)] FAIL: gprs:trx-lms+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=24296): Process ended prematurely: osmo-stp_10.42.42.5(pid=24296) [trial-2354↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24296)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=24308): Process ended prematurely: osmo-stp_10.42.42.5(pid=24308) [trial-2354↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24308)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=24326): Process ended prematurely: osmo-stp_10.42.42.5(pid=24326) [trial-2354↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24326)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=24336): Process ended prematurely: osmo-stp_10.42.42.5(pid=24336) [trial-2354↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24336)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=24347): Process ended prematurely: osmo-stp_10.42.42.5(pid=24347) [trial-2354↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24347)] FAIL: gprs:trx-lms+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=24364): Process ended prematurely: osmo-stp_10.42.42.5(pid=24364) [trial-2354↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24364)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=24376): Process ended prematurely: osmo-stp_10.42.42.5(pid=24376) [trial-2354↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24376)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=24394): Process ended prematurely: osmo-stp_10.42.42.5(pid=24394) [trial-2354↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24394)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=24404): Process ended prematurely: osmo-stp_10.42.42.5(pid=24404) [trial-2354↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24404)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=24414): Process ended prematurely: osmo-stp_10.42.42.5(pid=24414) [trial-2354↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24414)] FAIL: dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=24428): Process ended prematurely: osmo-stp_10.42.42.5(pid=24428) [trial-2354↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24428)] FAIL: dynts:trx-lms+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=24444): Process ended prematurely: osmo-stp_10.42.42.5(pid=24444) [trial-2354↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24444)] FAIL: nitb_sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=24452): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24452) [trial-2354↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24452)] FAIL: sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=24462): Process ended prematurely: osmo-stp_10.42.42.5(pid=24462) [trial-2354↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24462)] FAIL: nitb_ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=24471): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24471) [trial-2354↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24471)] FAIL: ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=24481): Process ended prematurely: osmo-stp_10.42.42.5(pid=24481) [trial-2354↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24481)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=24495): Process ended prematurely: osmo-stp_10.42.42.5(pid=24495) [trial-2354↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24495)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=24506): Process ended prematurely: osmo-stp_10.42.42.5(pid=24506) [trial-2354↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24506)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=24520): Process ended prematurely: osmo-stp_10.42.42.5(pid=24520) [trial-2354↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24520)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=24531): Process ended prematurely: osmo-stp_10.42.42.5(pid=24531) [trial-2354↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24531)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=24545): Process ended prematurely: osmo-stp_10.42.42.5(pid=24545) [trial-2354↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24545)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=24556): Process ended prematurely: osmo-stp_10.42.42.5(pid=24556) [trial-2354↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24556)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=24570): Process ended prematurely: osmo-stp_10.42.42.5(pid=24570) [trial-2354↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24570)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=24581): Process ended prematurely: osmo-stp_10.42.42.5(pid=24581) [trial-2354↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24581)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=24597): Process ended prematurely: osmo-stp_10.42.42.5(pid=24597) [trial-2354↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24597)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=24608): Process ended prematurely: osmo-stp_10.42.42.5(pid=24608) [trial-2354↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24608)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=24632): Process ended prematurely: osmo-stp_10.42.42.5(pid=24632) [trial-2354↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24632)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=24994): Process ended prematurely: osmo-stp_10.42.42.5(pid=24994) [trial-2354↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24994)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=25184): Process ended prematurely: osmo-stp_10.42.42.5(pid=25184) [trial-2354↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25184)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=25195): Process ended prematurely: osmo-stp_10.42.42.5(pid=25195) [trial-2354↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25195)] FAIL: emergency:trx-lms-limenet-micro (fail: 2) FAIL: emergency_mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=25210): Process ended prematurely: osmo-stp_10.42.42.5(pid=25210) [trial-2354↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25210)] FAIL: emergency_preemptive_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=25221): Process ended prematurely: osmo-stp_10.42.42.5(pid=25221) [trial-2354↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25221)] FAIL: gprs:trx-lms-limenet-micro (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=25239): Process ended prematurely: osmo-stp_10.42.42.5(pid=25239) [trial-2354↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25239)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=25252): Process ended prematurely: osmo-stp_10.42.42.5(pid=25252) [trial-2354↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25252)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=25271): Process ended prematurely: osmo-stp_10.42.42.5(pid=25271) [trial-2354↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25271)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=25281): Process ended prematurely: osmo-stp_10.42.42.5(pid=25281) [trial-2354↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25281)] FAIL: ping_idle_ping.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=25291): Process ended prematurely: osmo-stp_10.42.42.5(pid=25291) [trial-2354↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25291)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.2 sec) Error: osmo-stp_10.42.42.5(pid=25310): Process ended prematurely: osmo-stp_10.42.42.5(pid=25310) [trial-2354↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25310)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=25322): Process ended prematurely: osmo-stp_10.42.42.5(pid=25322) [trial-2354↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25322)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=25342): Process ended prematurely: osmo-stp_10.42.42.5(pid=25342) [trial-2354↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25342)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=25352): Process ended prematurely: osmo-stp_10.42.42.5(pid=25352) [trial-2354↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25352)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=25363): Process ended prematurely: osmo-stp_10.42.42.5(pid=25363) [trial-2354↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25363)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=25380): Process ended prematurely: osmo-stp_10.42.42.5(pid=25380) [trial-2354↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25380)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=25392): Process ended prematurely: osmo-stp_10.42.42.5(pid=25392) [trial-2354↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25392)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=25410): Process ended prematurely: osmo-stp_10.42.42.5(pid=25410) [trial-2354↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25410)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=25422): Process ended prematurely: osmo-stp_10.42.42.5(pid=25422) [trial-2354↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25422)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=25432): Process ended prematurely: osmo-stp_10.42.42.5(pid=25432) [trial-2354↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25432)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=25449): Process ended prematurely: osmo-stp_10.42.42.5(pid=25449) [trial-2354↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25449)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=25461): Process ended prematurely: osmo-stp_10.42.42.5(pid=25461) [trial-2354↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25461)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=25480): Process ended prematurely: osmo-stp_10.42.42.5(pid=25480) [trial-2354↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25480)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=25490): Process ended prematurely: osmo-stp_10.42.42.5(pid=25490) [trial-2354↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25490)] FAIL: ping_idle_ping.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=25503): Process ended prematurely: osmo-stp_10.42.42.5(pid=25503) [trial-2354↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25503)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=25517): Process ended prematurely: osmo-stp_10.42.42.5(pid=25517) [trial-2354↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25517)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=25530): Process ended prematurely: osmo-stp_10.42.42.5(pid=25530) [trial-2354↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25530)] FAIL: nitb_sms:nanobts (fail: 1) FAIL: mo_mt_sms.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=25538): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25538) [trial-2354↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25538)] FAIL: sms:nanobts+band-1900 (fail: 1) FAIL: mo_mt_sms.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=25548): Process ended prematurely: osmo-stp_10.42.42.5(pid=25548) [trial-2354↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25548)] FAIL: nitb_ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=25557): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25557) [trial-2354↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25557)] FAIL: ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (5.7 sec) Error: osmo-stp_10.42.42.5(pid=25567): Process ended prematurely: osmo-stp_10.42.42.5(pid=25567) [trial-2354↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25567)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=25581): Process ended prematurely: osmo-stp_10.42.42.5(pid=25581) [trial-2354↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25581)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=25592): Process ended prematurely: osmo-stp_10.42.42.5(pid=25592) [trial-2354↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25592)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=25606): Process ended prematurely: osmo-stp_10.42.42.5(pid=25606) [trial-2354↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25606)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=25618): Process ended prematurely: osmo-stp_10.42.42.5(pid=25618) [trial-2354↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25618)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=25633): Process ended prematurely: osmo-stp_10.42.42.5(pid=25633) [trial-2354↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25633)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=25644): Process ended prematurely: osmo-stp_10.42.42.5(pid=25644) [trial-2354↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25644)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=25658): Process ended prematurely: osmo-stp_10.42.42.5(pid=25658) [trial-2354↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25658)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=25669): Process ended prematurely: osmo-stp_10.42.42.5(pid=25669) [trial-2354↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25669)] FAIL: voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=25684): Process ended prematurely: osmo-stp_10.42.42.5(pid=25684) [trial-2354↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25684)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=25695): Process ended prematurely: osmo-stp_10.42.42.5(pid=25695) [trial-2354↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25695)] FAIL: emergency:nanobts+band-1900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=25710): Process ended prematurely: osmo-stp_10.42.42.5(pid=25710) [trial-2354↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25710)] FAIL: emergency_preemptive_call.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=25993): Process ended prematurely: osmo-stp_10.42.42.5(pid=25993) [trial-2354↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25993)] FAIL: gprs:nanobts+band-1900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=26011): Process ended prematurely: osmo-stp_10.42.42.5(pid=26011) [trial-2354↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26011)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=26023): Process ended prematurely: osmo-stp_10.42.42.5(pid=26023) [trial-2354↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26023)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=26041): Process ended prematurely: osmo-stp_10.42.42.5(pid=26041) [trial-2354↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26041)] FAIL: ping.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=26051): Process ended prematurely: osmo-stp_10.42.42.5(pid=26051) [trial-2354↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26051)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=26061): Process ended prematurely: osmo-stp_10.42.42.5(pid=26061) [trial-2354↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26061)] FAIL: gprs:nanobts+band-1900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=26078): Process ended prematurely: osmo-stp_10.42.42.5(pid=26078) [trial-2354↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26078)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=26090): Process ended prematurely: osmo-stp_10.42.42.5(pid=26090) [trial-2354↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26090)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=26108): Process ended prematurely: osmo-stp_10.42.42.5(pid=26108) [trial-2354↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26108)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=26121): Process ended prematurely: osmo-stp_10.42.42.5(pid=26121) [trial-2354↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26121)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=26131): Process ended prematurely: osmo-stp_10.42.42.5(pid=26131) [trial-2354↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26131)] FAIL: gprs:nanobts+band-1900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=26149): Process ended prematurely: osmo-stp_10.42.42.5(pid=26149) [trial-2354↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26149)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=26161): Process ended prematurely: osmo-stp_10.42.42.5(pid=26161) [trial-2354↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26161)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=26179): Process ended prematurely: osmo-stp_10.42.42.5(pid=26179) [trial-2354↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26179)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=26189): Process ended prematurely: osmo-stp_10.42.42.5(pid=26189) [trial-2354↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26189)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=26199): Process ended prematurely: osmo-stp_10.42.42.5(pid=26199) [trial-2354↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26199)] FAIL: dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=26212): Process ended prematurely: osmo-stp_10.42.42.5(pid=26212) [trial-2354↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26212)] FAIL: sms:nanobts+band-900 (fail: 1) FAIL: mo_mt_sms.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=26226): Process ended prematurely: osmo-stp_10.42.42.5(pid=26226) [trial-2354↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26226)] FAIL: nitb_ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=26235): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26235) [trial-2354↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26235)] FAIL: ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (5.7 sec) Error: osmo-stp_10.42.42.5(pid=26246): Process ended prematurely: osmo-stp_10.42.42.5(pid=26246) [trial-2354↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26246)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=26260): Process ended prematurely: osmo-stp_10.42.42.5(pid=26260) [trial-2354↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26260)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=26276): Process ended prematurely: osmo-stp_10.42.42.5(pid=26276) [trial-2354↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26276)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=26290): Process ended prematurely: osmo-stp_10.42.42.5(pid=26290) [trial-2354↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26290)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=26301): Process ended prematurely: osmo-stp_10.42.42.5(pid=26301) [trial-2354↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26301)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=26315): Process ended prematurely: osmo-stp_10.42.42.5(pid=26315) [trial-2354↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26315)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=26326): Process ended prematurely: osmo-stp_10.42.42.5(pid=26326) [trial-2354↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26326)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=26340): Process ended prematurely: osmo-stp_10.42.42.5(pid=26340) [trial-2354↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26340)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=26351): Process ended prematurely: osmo-stp_10.42.42.5(pid=26351) [trial-2354↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26351)] FAIL: voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=26366): Process ended prematurely: osmo-stp_10.42.42.5(pid=26366) [trial-2354↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26366)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=26377): Process ended prematurely: osmo-stp_10.42.42.5(pid=26377) [trial-2354↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26377)] FAIL: voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=26391): Process ended prematurely: osmo-stp_10.42.42.5(pid=26391) [trial-2354↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26391)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=26402): Process ended prematurely: osmo-stp_10.42.42.5(pid=26402) [trial-2354↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26402)] FAIL: emergency:nanobts+band-900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=26416): Process ended prematurely: osmo-stp_10.42.42.5(pid=26416) [trial-2354↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26416)] FAIL: emergency_preemptive_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=26427): Process ended prematurely: osmo-stp_10.42.42.5(pid=26427) [trial-2354↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26427)] FAIL: gprs:nanobts+band-900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=26445): Process ended prematurely: osmo-stp_10.42.42.5(pid=26445) [trial-2354↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26445)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=26457): Process ended prematurely: osmo-stp_10.42.42.5(pid=26457) [trial-2354↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26457)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=26478): Process ended prematurely: osmo-stp_10.42.42.5(pid=26478) [trial-2354↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26478)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=26488): Process ended prematurely: osmo-stp_10.42.42.5(pid=26488) [trial-2354↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26488)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=26498): Process ended prematurely: osmo-stp_10.42.42.5(pid=26498) [trial-2354↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26498)] FAIL: gprs:nanobts+band-900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=26516): Process ended prematurely: osmo-stp_10.42.42.5(pid=26516) [trial-2354↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26516)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=26528): Process ended prematurely: osmo-stp_10.42.42.5(pid=26528) [trial-2354↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26528)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=26546): Process ended prematurely: osmo-stp_10.42.42.5(pid=26546) [trial-2354↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26546)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=26556): Process ended prematurely: osmo-stp_10.42.42.5(pid=26556) [trial-2354↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26556)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=26566): Process ended prematurely: osmo-stp_10.42.42.5(pid=26566) [trial-2354↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26566)] FAIL: gprs:nanobts+band-900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=26583): Process ended prematurely: osmo-stp_10.42.42.5(pid=26583) [trial-2354↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26583)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=26595): Process ended prematurely: osmo-stp_10.42.42.5(pid=26595) [trial-2354↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26595)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=26614): Process ended prematurely: osmo-stp_10.42.42.5(pid=26614) [trial-2354↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26614)] FAIL: ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=26624): Process ended prematurely: osmo-stp_10.42.42.5(pid=26624) [trial-2354↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26624)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=26634): Process ended prematurely: osmo-stp_10.42.42.5(pid=26634) [trial-2354↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26634)] FAIL: gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=26653): Process ended prematurely: osmo-stp_10.42.42.5(pid=26653) [trial-2354↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26653)] FAIL: iperf3.py (7.2 sec) Error: osmo-stp_10.42.42.5(pid=26665): Process ended prematurely: osmo-stp_10.42.42.5(pid=26665) [trial-2354↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26665)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=26683): Process ended prematurely: osmo-stp_10.42.42.5(pid=26683) [trial-2354↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26683)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=26693): Process ended prematurely: osmo-stp_10.42.42.5(pid=26693) [trial-2354↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26693)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=26703): Process ended prematurely: osmo-stp_10.42.42.5(pid=26703) [trial-2354↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26703)] FAIL: dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=26716): Process ended prematurely: osmo-stp_10.42.42.5(pid=26716) [trial-2354↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26716)] FAIL: nitb_smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (2.5 sec) Error: osmo-nitb_10.42.42.2(pid=26724): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26724) [trial-2354↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26724)] FAIL: esme_connect_policy_closed.py (1.9 sec) Error: osmo-nitb_10.42.42.2(pid=26726): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26726) [trial-2354↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26726)] FAIL: esme_ms_sms_storeforward.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=26728): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26728) [trial-2354↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26728)] FAIL: esme_ms_sms_transaction.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=26730): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26730) [trial-2354↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26730)] FAIL: smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (5.5 sec) Error: osmo-hlr_10.42.42.2(pid=26739): Process ended prematurely: osmo-hlr_10.42.42.2(pid=26739) [trial-2354↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26739)] FAIL: esme_connect_policy_closed.py (5.8 sec) Error: osmo-hlr_10.42.42.2(pid=26750): Process ended prematurely: osmo-hlr_10.42.42.2(pid=26750) [trial-2354↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26750)] FAIL: esme_ms_sms_storeforward.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=26762): Process ended prematurely: osmo-stp_10.42.42.5(pid=26762) [trial-2354↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26762)] FAIL: esme_ms_sms_transaction.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=26773): Process ended prematurely: osmo-stp_10.42.42.5(pid=26773) [trial-2354↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26773)] FAIL: encryption (fail: 4) FAIL: register_a5_0_authopt.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=26788): Process ended prematurely: osmo-stp_10.42.42.5(pid=26788) [trial-2354↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26788)] FAIL: register_a5_0_authreq.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=26799): Process ended prematurely: osmo-stp_10.42.42.5(pid=26799) [trial-2354↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26799)] FAIL: register_a5_1_authreq.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=26810): Process ended prematurely: osmo-stp_10.42.42.5(pid=26810) [trial-2354↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26810)] FAIL: register_a5_3_authreq.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=26821): Process ended prematurely: osmo-stp_10.42.42.5(pid=26821) [trial-2354↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26821)] FAIL: 4g:srsenb-rftype@zmq+srsue-rftype@zmq (fail: 7) FAIL: handover.py (20.4 sec) Error: srsepc(pid=26844): Process ended prematurely: srsepc(pid=26844) [trial-2354↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=26844)] FAIL: iperf3_bidir.py (18.6 sec) Error: srsepc(pid=26860): Process ended prematurely: srsepc(pid=26860) [trial-2354↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=26860)] FAIL: iperf3_dl.py (18.5 sec) Error: srsepc(pid=26876): Process ended prematurely: srsepc(pid=26876) [trial-2354↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=26876)] FAIL: iperf3_ul.py (18.9 sec) Error: srsepc(pid=26892): Process ended prematurely: srsepc(pid=26892) [trial-2354↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=26892)] FAIL: ping.py (18.2 sec) Error: srsepc(pid=26908): Process ended prematurely: srsepc(pid=26908) [trial-2354↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=26908)] FAIL: rrc_idle_mo_ping.py (18.3 sec) Error: srsepc(pid=26924): Process ended prematurely: srsepc(pid=26924) [trial-2354↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=26924)] FAIL: rrc_idle_mt_ping.py (18.3 sec) Error: srsepc(pid=26941): Process ended prematurely: srsepc(pid=26941) [trial-2354↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=26941)] FAIL: handover_2G:nanobts+bts1-oc2g (fail: 1) FAIL: handover.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=26956): Process ended prematurely: osmo-stp_10.42.42.5(pid=26956) [trial-2354↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26956)] FAIL: handover_2G:nanobts+bts1-octphy (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=26972): Process ended prematurely: osmo-stp_10.42.42.5(pid=26972) [trial-2354↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26972)] FAIL: handover_2G:nanobts+bts1-trx-lms (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=26986): Process ended prematurely: osmo-stp_10.42.42.5(pid=26986) [trial-2354↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26986)] FAIL: handover_2G:nanobts+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=27000): Process ended prematurely: osmo-stp_10.42.42.5(pid=27000) [trial-2354↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27000)] FAIL: handover_2G:nanobts+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=27286): Process ended prematurely: osmo-stp_10.42.42.5(pid=27286) [trial-2354↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27286)] FAIL: handover_2G:nanobts+bts1-sysmo (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=27301): Process ended prematurely: osmo-stp_10.42.42.5(pid=27301) [trial-2354↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27301)] FAIL: handover_2G:nanobts+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=27315): Process ended prematurely: osmo-stp_10.42.42.5(pid=27315) [trial-2354↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27315)] FAIL: handover_2G:nanobts+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=27329): Process ended prematurely: osmo-stp_10.42.42.5(pid=27329) [trial-2354↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27329)] FAIL: handover_2G:oc2g+bts1-octphy (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=27343): Process ended prematurely: osmo-stp_10.42.42.5(pid=27343) [trial-2354↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27343)] FAIL: handover_2G:oc2g+bts1-trx-lms (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=27357): Process ended prematurely: osmo-stp_10.42.42.5(pid=27357) [trial-2354↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27357)] FAIL: handover_2G:oc2g+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=27380): Process ended prematurely: osmo-stp_10.42.42.5(pid=27380) [trial-2354↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27380)] FAIL: handover_2G:oc2g+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=27394): Process ended prematurely: osmo-stp_10.42.42.5(pid=27394) [trial-2354↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27394)] FAIL: handover_2G:oc2g+bts1-sysmo (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=27408): Process ended prematurely: osmo-stp_10.42.42.5(pid=27408) [trial-2354↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27408)] FAIL: handover_2G:oc2g+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=27422): Process ended prematurely: osmo-stp_10.42.42.5(pid=27422) [trial-2354↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27422)] FAIL: handover_2G:oc2g+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=27446): Process ended prematurely: osmo-stp_10.42.42.5(pid=27446) [trial-2354↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27446)] FAIL: handover_2G:octphy+bts1-trx-lms (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=27812): Process ended prematurely: osmo-stp_10.42.42.5(pid=27812) [trial-2354↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27812)] FAIL: handover_2G:octphy+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (7.2 sec) Error: osmo-stp_10.42.42.5(pid=27826): Process ended prematurely: osmo-stp_10.42.42.5(pid=27826) [trial-2354↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27826)] FAIL: handover_2G:octphy+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=28018): Process ended prematurely: osmo-stp_10.42.42.5(pid=28018) [trial-2354↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28018)] FAIL: handover_2G:octphy+bts1-sysmo (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=28032): Process ended prematurely: osmo-stp_10.42.42.5(pid=28032) [trial-2354↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28032)] FAIL: handover_2G:octphy+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=28046): Process ended prematurely: osmo-stp_10.42.42.5(pid=28046) [trial-2354↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28046)] FAIL: handover_2G:octphy+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=28060): Process ended prematurely: osmo-stp_10.42.42.5(pid=28060) [trial-2354↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28060)] FAIL: handover_2G:trx-lms+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=28074): Process ended prematurely: osmo-stp_10.42.42.5(pid=28074) [trial-2354↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28074)] FAIL: handover_2G:trx-lms+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=28088): Process ended prematurely: osmo-stp_10.42.42.5(pid=28088) [trial-2354↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28088)] FAIL: handover_2G:trx-lms+bts1-sysmo (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=28102): Process ended prematurely: osmo-stp_10.42.42.5(pid=28102) [trial-2354↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28102)] FAIL: handover_2G:trx-lms+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=28116): Process ended prematurely: osmo-stp_10.42.42.5(pid=28116) [trial-2354↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28116)] FAIL: handover_2G:trx-lms+bts1-trx-umtrx (fail: 1) FAIL: handover.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=28130): Process ended prematurely: osmo-stp_10.42.42.5(pid=28130) [trial-2354↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28130)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=28145): Process ended prematurely: osmo-stp_10.42.42.5(pid=28145) [trial-2354↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28145)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-sysmo (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=28161): Process ended prematurely: osmo-stp_10.42.42.5(pid=28161) [trial-2354↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28161)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=28175): Process ended prematurely: osmo-stp_10.42.42.5(pid=28175) [trial-2354↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28175)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=28189): Process ended prematurely: osmo-stp_10.42.42.5(pid=28189) [trial-2354↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28189)] FAIL: handover_2G:trx-sysmocell5000+bts1-sysmo (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=28203): Process ended prematurely: osmo-stp_10.42.42.5(pid=28203) [trial-2354↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28203)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=28217): Process ended prematurely: osmo-stp_10.42.42.5(pid=28217) [trial-2354↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28217)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=28231): Process ended prematurely: osmo-stp_10.42.42.5(pid=28231) [trial-2354↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28231)] FAIL: handover_2G:sysmo+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=28245): Process ended prematurely: osmo-stp_10.42.42.5(pid=28245) [trial-2354↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28245)] FAIL: handover_2G:sysmo+bts1-trx-umtrx (fail: 1) FAIL: handover.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=28259): Process ended prematurely: osmo-stp_10.42.42.5(pid=28259) [trial-2354↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28259)] FAIL: handover_2G:trx-b200+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=28273): Process ended prematurely: osmo-stp_10.42.42.5(pid=28273) [trial-2354↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28273)] + rm -rf trial-2354/inst + cd trial-2354 + command -v journalctl + [ ! -z /bin/journalctl ] + readlink last_run + journalctl -u ofono -o short-precise --since 2022-12-09 03:34:53 + readlink last_run + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354-run.tgz run.2022-12-09_03-35-04 + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2354-bin.tgz checksums.md5 open5gs.build-8.tgz osmo-bsc.build-17650.tgz osmo-bts-oc2g.build-5531.tgz osmo-bts-sysmo.build-8035.tgz osmo-bts.build-7504.tgz osmo-ggsn.build-6677.tgz osmo-hlr.build-8697.tgz osmo-hnbgw.build-2943.tgz osmo-mgw.build-8942.tgz osmo-msc.build-29256.tgz osmo-nitb.build-12964.tgz osmo-pcu-oc2g.build-3905.tgz osmo-pcu-sysmo.build-5187.tgz osmo-pcu.build-5148.tgz osmo-sgsn.build-30031.tgz osmo-stp.build-9237.tgz osmo-trx.build-4673.tgz osmocom-bb.build-4694.tgz srslte.build-19.tgz + exit 1 Build step 'Execute shell' marked build as failure Archiving artifacts Recording test results [Checks API] No suitable checks publisher found. Sending e-mails to: pespin@sysmocom.de Finished: FAILURE